-- Logs begin at Wed 2022-08-24 15:10:01 UTC, end at Wed 2022-08-24 16:27:10 UTC. -- Aug 24 15:42:42.363198 dv-cinder-849325-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 15:42:42.372559 dv-cinder-849325-3-smb devstack@keystone.service[81705]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 15:42:42.374579 dv-cinder-849325-3-smb devstack@keystone.service[81705]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 15:42:42 2022] *** Aug 24 15:42:42.374579 dv-cinder-849325-3-smb devstack@keystone.service[81705]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 15:42:42.374579 dv-cinder-849325-3-smb devstack@keystone.service[81705]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 15:42:42.374579 dv-cinder-849325-3-smb devstack@keystone.service[81705]: nodename: dv-cinder-849325-3-smb Aug 24 15:42:42.374579 dv-cinder-849325-3-smb devstack@keystone.service[81705]: machine: x86_64 Aug 24 15:42:42.374579 dv-cinder-849325-3-smb devstack@keystone.service[81705]: clock source: unix Aug 24 15:42:42.374579 dv-cinder-849325-3-smb devstack@keystone.service[81705]: pcre jit disabled Aug 24 15:42:42.374579 dv-cinder-849325-3-smb devstack@keystone.service[81705]: detected number of CPU cores: 4 Aug 24 15:42:42.374579 dv-cinder-849325-3-smb devstack@keystone.service[81705]: current working directory: / Aug 24 15:42:42.374579 dv-cinder-849325-3-smb devstack@keystone.service[81705]: detected binary path: /usr/bin/uwsgi-core Aug 24 15:42:42.374579 dv-cinder-849325-3-smb devstack@keystone.service[81705]: your processes number limit is 47680 Aug 24 15:42:42.375178 dv-cinder-849325-3-smb devstack@keystone.service[81705]: your memory page size is 4096 bytes Aug 24 15:42:42.375178 dv-cinder-849325-3-smb devstack@keystone.service[81705]: detected max file descriptor number: 2048 Aug 24 15:42:42.375178 dv-cinder-849325-3-smb devstack@keystone.service[81705]: lock engine: pthread robust mutexes Aug 24 15:42:42.375178 dv-cinder-849325-3-smb devstack@keystone.service[81705]: thunder lock: enabled Aug 24 15:42:42.375178 dv-cinder-849325-3-smb devstack@keystone.service[81705]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 15:42:42.375178 dv-cinder-849325-3-smb devstack@keystone.service[81705]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 15:42:42.414678 dv-cinder-849325-3-smb devstack@keystone.service[81705]: Python main interpreter initialized at 0x558a82eb89c0 Aug 24 15:42:42.414678 dv-cinder-849325-3-smb devstack@keystone.service[81705]: python threads support enabled Aug 24 15:42:42.414678 dv-cinder-849325-3-smb devstack@keystone.service[81705]: your server socket listen backlog is limited to 100 connections Aug 24 15:42:42.414678 dv-cinder-849325-3-smb devstack@keystone.service[81705]: your mercy for graceful operations on workers is 90 seconds Aug 24 15:42:42.415065 dv-cinder-849325-3-smb devstack@keystone.service[81705]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 15:42:42.415138 dv-cinder-849325-3-smb devstack@keystone.service[81705]: *** Operational MODE: preforking *** Aug 24 15:42:42.415408 dv-cinder-849325-3-smb devstack@keystone.service[81705]: *** uWSGI is running in multiple interpreter mode *** Aug 24 15:42:42.415408 dv-cinder-849325-3-smb devstack@keystone.service[81705]: spawned uWSGI master process (pid: 81705) Aug 24 15:42:42.415613 dv-cinder-849325-3-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 15:42:42.416816 dv-cinder-849325-3-smb devstack@keystone.service[81705]: spawned uWSGI worker 1 (pid: 81716, cores: 1) Aug 24 15:42:42.416816 dv-cinder-849325-3-smb devstack@keystone.service[81705]: spawned uWSGI worker 2 (pid: 81717, cores: 1) Aug 24 15:42:42.416816 dv-cinder-849325-3-smb devstack@keystone.service[81705]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 15:42:46.807444 dv-cinder-849325-3-smb devstack@keystone.service[81717]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 15:42:46.807444 dv-cinder-849325-3-smb devstack@keystone.service[81717]: from cryptography.utils import int_from_bytes Aug 24 15:42:46.808217 dv-cinder-849325-3-smb devstack@keystone.service[81716]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 15:42:46.808217 dv-cinder-849325-3-smb devstack@keystone.service[81716]: from cryptography.utils import int_from_bytes Aug 24 15:42:46.808641 dv-cinder-849325-3-smb devstack@keystone.service[81717]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 15:42:46.808641 dv-cinder-849325-3-smb devstack@keystone.service[81717]: from cryptography.utils import int_from_bytes Aug 24 15:42:46.808759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 15:42:46.808759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: from cryptography.utils import int_from_bytes Aug 24 15:42:46.859063 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 15:42:46.859254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 15:42:46.859430 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] command line args: [] {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 15:42:46.859704 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 15:42:46.859901 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ================================================================================ {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 15:42:46.860139 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] admin_token = **** {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.860239 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 15:42:46.860388 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 15:42:46.860467 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] config_dir = [] {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.860575 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.860678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] command line args: [] {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 15:42:46.860791 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] config_source = [] {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.860876 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 15:42:46.860975 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] debug = True {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.861058 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ================================================================================ {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 15:42:46.861176 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.861436 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] admin_token = **** {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.861505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] config_dir = [] {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.861566 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.861693 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.861793 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.861894 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] config_source = [] {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.862001 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.862102 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] debug = True {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.862228 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.862337 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.862466 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] list_limit = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.862570 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.862665 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] log_config_append = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.862759 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.862857 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.862959 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.863053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] log_dir = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.863053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] log_file = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.863240 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.863347 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] list_limit = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.863448 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.863572 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] log_config_append = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.863652 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.863727 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.863803 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.863873 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] log_dir = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.863948 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] log_file = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.864017 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.864170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.864263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.864341 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.864464 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.864579 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.864689 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.864853 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.864942 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.865079 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.865161 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.865258 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.865341 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.865505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.865588 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.865750 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.865873 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.865999 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.866104 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.866222 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.866334 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.866444 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.866555 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.866674 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.866887 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.867012 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.867128 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.867244 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] publish_errors = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.867361 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.867485 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.867589 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.867765 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.867879 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.868053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.868174 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] publish_errors = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.868297 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.868426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.868540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] standard_threads = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.871819 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.871819 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.872047 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.872120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.872194 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.872194 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.872328 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.872398 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] use_journal = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.872471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] standard_threads = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.872541 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] use_json = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.872609 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.872758 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] use_stderr = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.872758 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] use_syslog = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.872893 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.872963 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.873032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.873099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.873178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] use_journal = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.873178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] use_json = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.873307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.873382 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] use_stderr = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.873457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.873527 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] use_syslog = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.873717 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.873799 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:42:46.873876 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.873945 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.874019 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.874089 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.874164 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.874240 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.874310 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.874383 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.874459 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.874528 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.874607 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.874678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.874755 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.874831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.874901 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.874968 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.875046 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.875116 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.875196 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.875265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.875333 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.875401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.875480 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.875555 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.875624 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.875698 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.875768 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.875842 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.875921 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.875990 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.876064 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.876132 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.876201 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.876275 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.876346 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.876415 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.876489 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.876558 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.876656 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.876740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.876811 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.876886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.876956 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.877030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.877104 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.877275 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.877356 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.877475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.877549 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.877624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.877700 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.877778 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.877848 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.877916 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.877990 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.878060 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.878128 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.878203 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.878274 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.878342 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.878415 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.878485 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.878558 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.878637 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.878708 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.878833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.878912 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.879083 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.879160 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.879334 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.879410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.879575 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.879649 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.879811 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.879887 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.880043 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.880119 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.880272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.880431 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.880558 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.880686 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.880798 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.880901 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.881003 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.881099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.881194 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.881287 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.881390 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.881486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.881630 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.881750 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.881863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.881975 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.882088 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.882215 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.882334 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.882447 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.882558 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.882670 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.882782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.882906 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.883020 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.883131 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.883242 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.883362 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.883481 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.883602 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.883715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.883833 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.883938 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.884054 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.884168 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.884287 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.884401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.884513 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.884654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.884791 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.884992 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.885149 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.885269 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.885384 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.885384 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.885595 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.885708 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.885829 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.885942 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.886055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.886176 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.886281 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.886398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.886520 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.886639 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.886752 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.886927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.887081 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.887206 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.887328 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.887443 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.887443 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.887653 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.887766 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.887976 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.888176 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.888294 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.888407 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.888527 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.888657 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.888772 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.888898 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.889012 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.889133 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.889254 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.889376 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.889498 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.889611 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.889731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.889845 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.889957 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.890069 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.890182 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.890295 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.890415 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.890415 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.890635 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.890756 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.890869 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.890989 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.891111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.891230 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.891343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.891343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.891561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.891675 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.891795 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.891917 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.892031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.892144 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.892256 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.892369 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.892493 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.892607 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.892736 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.892849 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.892967 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.893091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.893214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.893329 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.893442 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.893555 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.893668 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.893668 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.893891 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.894005 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.894154 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.894302 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.894487 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.894628 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.894751 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.894866 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.894979 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] auth.external = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.895098 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.895212 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.895342 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.895465 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.895581 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.895694 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.895806 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.895918 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] auth.password = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.896030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.896177 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] auth.token = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.896303 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] auth.external = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.896426 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.896550 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.896717 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.896717 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.896933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.897047 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.897176 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.897292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.897406 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] auth.password = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.897406 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] auth.token = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.897625 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.897625 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.897846 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.897961 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] credential.caching = True {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.898075 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.898189 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.898302 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.898302 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.898525 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.898648 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.898762 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.898875 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.898988 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.899102 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.899223 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.899338 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] credential.caching = True {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.899451 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.899570 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.899686 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.899800 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.899922 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.900037 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.900169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.900306 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.900955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.901135 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.901265 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.901382 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.901495 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.901495 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.901710 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.901823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.901944 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.902059 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.902172 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.902294 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] federation.caching = True {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.902408 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.902600 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.902600 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.902817 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.902930 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.903043 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.903156 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.903278 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.903392 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.903507 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.903627 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.903741 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.903864 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.903987 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] federation.caching = True {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.904088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.904201 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.904314 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.904428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.904540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.904680 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.904797 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.904912 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.905033 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] identity.caching = True {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.905152 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.905267 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.905388 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.905502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.905615 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.905728 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.905867 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.905995 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.906158 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.906284 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.906400 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.906514 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.906628 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.906741 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.906863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] identity.caching = True {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.906981 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.907101 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.907216 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.907329 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.907443 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.907564 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.907680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.907794 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.907907 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.908022 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.908136 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.908258 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.908373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.908487 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.908601 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.908769 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.908885 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.909008 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.909124 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.909238 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.909351 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.909464 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.909836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.909961 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.910075 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.910190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.910302 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.910415 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.910528 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.910648 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.910762 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.910875 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.910989 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.911109 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.911255 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.911372 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.911486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.911600 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.911713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.911827 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.911949 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.912064 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.912179 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.912293 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.912407 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.912520 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.912656 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.912772 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.912886 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.913000 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.913113 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.913227 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.913352 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.913467 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.913639 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.913796 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.913931 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.914032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.914138 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.914236 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.914334 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.914429 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.914429 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.914607 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.914711 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.914809 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.914905 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.915000 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.915102 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.915203 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.915307 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.915405 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.915502 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.915598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.915692 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.915800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.915905 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.916009 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.916189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.916939 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.917056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.917153 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.919297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.919536 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.919613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.919684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.919753 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.919823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.user = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.919902 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.919975 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.920045 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.920116 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.920185 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.920255 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.920333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.920405 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.920475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.920545 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.920614 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.920713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.920795 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.user = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.920869 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.920939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.921009 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.921078 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.921197 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.921281 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.921354 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.921424 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.921494 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.921563 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.921633 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.921711 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.921783 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.921853 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.921923 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.921992 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.922062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.922141 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.922213 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.922283 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.922353 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.922421 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.922491 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.922569 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.922641 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.922712 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.922781 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.922850 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.922952 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.923037 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.923157 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.923232 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.923303 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.923367 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.923424 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.923503 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.923574 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.923644 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.923715 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.923785 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.923855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.923933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.924005 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.924157 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.924236 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.924398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.924476 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.924675 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.924797 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.924932 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.925014 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.925171 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.925277 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.925439 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.925517 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.925645 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.925728 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.925888 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.925969 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.926131 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.926214 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] resource.caching = True {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.926370 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.926451 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.926612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.926701 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.926854 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.926934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.927110 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.927224 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.927364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.927463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.927603 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.927684 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.927870 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] resource.caching = True {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.927981 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.928088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.928205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.928334 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.928461 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.928576 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] role.caching = True {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.928730 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.928852 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] role.driver = sql {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.928987 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.929091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.929244 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.929348 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.929485 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.929602 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.929736 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.929856 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.929978 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.930109 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.930221 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.930362 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.930451 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] role.caching = True {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.930614 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.930694 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] role.driver = sql {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.930863 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.930944 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.931117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.931252 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.931357 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.931438 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.931610 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.931768 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.931895 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.931980 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.932135 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.932217 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.932385 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.932473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.932648 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.932934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.933047 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.933179 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.933287 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.933436 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.933538 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.933691 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.933774 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.933944 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.934031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.934403 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.934503 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.934581 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.934655 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.934728 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.934917 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.935000 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.935163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.935247 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.935402 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.935484 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.935641 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.935721 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.935878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.935961 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.936124 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.936234 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.936383 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.936464 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.936659 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.936744 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.936894 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.936974 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.937133 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.937213 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.937375 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.937466 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.937606 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.937688 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] token.caching = True {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.937848 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.937928 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.938102 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.938185 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.938344 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.938425 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.938582 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.938662 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.938822 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.938904 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.939057 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.939138 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.939297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] token.caching = True {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.939377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.939538 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.939621 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.939789 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.939869 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.940025 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.940104 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.940268 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.940350 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.940509 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.940591 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.940771 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.940861 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.941020 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.941103 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.941265 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.941368 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.941513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.941601 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.941758 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.941868 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.941998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.942079 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] database.connection = **** {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.942236 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.942336 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.942483 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.942573 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.942733 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.942814 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.942965 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.943046 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.943210 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.943299 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.943462 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.943542 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.943706 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.943786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] database.connection = **** {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.943950 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.944042 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.944202 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.944291 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.944489 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.944578 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.944716 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.944798 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.944957 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.945116 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.945194 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.945268 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.945463 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.945605 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.945669 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.945753 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.945899 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.945981 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.946137 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.946217 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.946376 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.946465 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.946541 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 15:42:46.946616 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.946856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.947101 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.947375 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.947606 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.947856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.948086 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:42:46.948258 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 15:42:46.976678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81716) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:46.976904 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81716) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:46.977088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81716) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:46.977549 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81717) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:46.977784 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81717) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:46.978012 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81717) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:46.986319 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81716) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:46.987161 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81717) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.015937 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81717) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.016249 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81717) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.017720 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81716) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.017961 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81716) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.082830 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81716) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.083054 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81717) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.141724 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81716) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.141965 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81716) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.143243 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81717) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.143464 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81717) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.311682 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81716) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.311905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81716) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.312127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81716) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.312343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81716) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.312558 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81716) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.312795 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81716) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.312959 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81717) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.313194 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81717) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.313421 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81717) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.313644 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81717) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.313869 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81717) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.314077 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81717) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.349866 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81716) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.350051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81717) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.350144 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81716) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.350226 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81717) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.350302 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81716) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.350376 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81717) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.350449 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81716) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.350576 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81717) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.350660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81716) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.350798 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81717) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.350881 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81716) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.351017 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81717) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.351108 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81716) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.351234 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81717) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.363195 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81716) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.363624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81717) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.377182 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81716) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.377411 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81716) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.377525 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81717) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.377637 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81716) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.377722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81717) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.377864 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81716) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.377948 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81717) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.378083 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81716) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.378167 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81717) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.378301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81716) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.378384 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81717) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.378518 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81716) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.378614 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81717) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.378714 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81717) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:42:47.402602 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.402845 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 15:42:47.403145 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.403471 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 15:42:47.403651 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.403793 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.403929 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 15:42:47.404067 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.404239 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.404433 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.404574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 15:42:47.404790 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.405036 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.405386 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.405997 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.406381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.414385 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.414673 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.414955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.415247 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.416732 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.417192 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.417654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.417989 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.423006 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81716) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.425048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81717) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.425967 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81716) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.426261 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.426555 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.426851 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.427147 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.427413 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.427692 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.427977 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.428058 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81717) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.428298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.428397 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.428577 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.428692 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.428883 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.428964 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.429166 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.429430 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.429701 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.429973 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.430361 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.430639 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.430910 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.452958 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.454468 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81716) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.454801 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.455044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.456540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81717) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.456854 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.459471 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81716) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.459762 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.460055 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.461504 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81717) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.461792 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.462076 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.466747 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81716) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.467046 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.469080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81717) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.469380 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.471197 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81716) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.471504 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.471795 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.472088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.472370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.472674 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.472953 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.473230 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.473469 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81717) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.473764 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.474048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.474338 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.474693 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.474975 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.475252 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.475525 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.491559 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.491876 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.494000 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.494977 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.496435 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81716) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.499224 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81717) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.499703 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.500003 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.502443 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.504521 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.504764 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81716) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.506944 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81717) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.507412 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81716) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.510295 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81717) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.510751 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.511059 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.511356 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.511653 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.511953 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.512251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.513954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.514256 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.514543 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.514826 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.515120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.515408 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.528310 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81716) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.528702 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.528994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.529269 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.531918 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81717) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.532219 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.532488 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.532779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.536445 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.538003 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.538284 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.539888 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.540962 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81716) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.541782 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.544137 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.544243 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.544243 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.544387 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.544463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.545243 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81717) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.545531 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.545822 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.546155 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.546594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.554145 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81716) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.554447 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.554744 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.555038 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.555333 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.555682 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.555998 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.558472 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81717) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.558764 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.559049 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.559331 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.559612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.559889 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.560187 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.571572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81716) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.575080 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81716) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.576218 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81717) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.578033 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.579298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81717) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.579485 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.581008 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81716) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.581299 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.581604 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.582327 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.583759 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.585311 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81717) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.585593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.585889 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.588665 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.590267 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81716) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.593242 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.593454 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.593651 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.594823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.594919 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81717) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.595121 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.597860 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.598257 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.598571 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.598857 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.607675 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81716) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.607675 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.607675 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.608016 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81717) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.608016 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.608016 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.611180 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81716) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.611477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.611769 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.612057 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.612340 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.612646 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.612928 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.613220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.613509 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.613796 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.614078 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.614383 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.614630 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.614767 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81717) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:42:47.614914 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81716) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.615057 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.615338 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.615613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.615886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.616160 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.616434 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.616749 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.617032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.617309 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.617579 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.617851 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.618120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.618388 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81717) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:42:47.650482 dv-cinder-849325-3-smb devstack@keystone.service[81716]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558a82eb89c0 pid: 81716 (default app) Aug 24 15:42:47.654127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462621c7-7787-48a1-ad5e-30d16e673529 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:42:47.654449 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462621c7-7787-48a1-ad5e-30d16e673529 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:42:47.654701 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462621c7-7787-48a1-ad5e-30d16e673529 None None] PATH_INFO: `/v3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:42:47.654825 dv-cinder-849325-3-smb devstack@keystone.service[81717]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558a82eb89c0 pid: 81717 (default app) Aug 24 15:42:47.658898 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 791 bytes} [Wed Aug 24 15:42:47 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:42:55.227918 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f81c72-1f50-4ad1-b531-d5ef2b6a68c6 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:42:55.229266 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f81c72-1f50-4ad1-b531-d5ef2b6a68c6 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:42:55.229266 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f81c72-1f50-4ad1-b531-d5ef2b6a68c6 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:42:55.233258 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1/2] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:42:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:42:55.240315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b4c1e-3a8d-47f8-8e33-d4dd51fdd4c8 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:42:55.240745 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b4c1e-3a8d-47f8-8e33-d4dd51fdd4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:42:55.240893 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b4c1e-3a8d-47f8-8e33-d4dd51fdd4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:42:55.313372 dv-cinder-849325-3-smb devstack@keystone.service[81716]: INFO dbcounter [None req-cb9b4c1e-3a8d-47f8-8e33-d4dd51fdd4c8 None None] Registered counter for database keystone Aug 24 15:42:55.334943 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG oslo_db.sqlalchemy.engines [None req-cb9b4c1e-3a8d-47f8-8e33-d4dd51fdd4c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:42:55.342063 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writer thread running {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:42:55.526872 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG passlib.handlers.bcrypt [None req-cb9b4c1e-3a8d-47f8-8e33-d4dd51fdd4c8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81716) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 15:42:55.527168 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG passlib.handlers.bcrypt [None req-cb9b4c1e-3a8d-47f8-8e33-d4dd51fdd4c8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81716) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 15:42:55.582169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-cb9b4c1e-3a8d-47f8-8e33-d4dd51fdd4c8 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:42:55.583791 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-cb9b4c1e-3a8d-47f8-8e33-d4dd51fdd4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:42:55.719824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 2/3] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:42:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 24 15:42:56.194040 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f81c72-1f50-4ad1-b531-d5ef2b6a68c6 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:42:56.265245 dv-cinder-849325-3-smb devstack@keystone.service[81717]: INFO dbcounter [None req-a3f81c72-1f50-4ad1-b531-d5ef2b6a68c6 None None] Registered counter for database keystone Aug 24 15:42:56.286099 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG oslo_db.sqlalchemy.engines [None req-a3f81c72-1f50-4ad1-b531-d5ef2b6a68c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81717) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:42:56.294080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writer thread running {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:42:56.417091 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f81c72-1f50-4ad1-b531-d5ef2b6a68c6 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:42:56.421534 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947529bc-9361-498a-8e4f-456fedfafab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:42:56.422159 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947529bc-9361-498a-8e4f-456fedfafab6 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:42:56.422435 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947529bc-9361-498a-8e4f-456fedfafab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:42:56.422704 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947529bc-9361-498a-8e4f-456fedfafab6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:42:56.430847 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947529bc-9361-498a-8e4f-456fedfafab6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:42:56.485435 dv-cinder-849325-3-smb devstack@keystone.service[81717]: WARNING keystone.common.rbac_enforcer.enforcer [None req-947529bc-9361-498a-8e4f-456fedfafab6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 15:42:56.485904 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947529bc-9361-498a-8e4f-456fedfafab6 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:42:56.497686 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 2/4] 10.222.0.64 () {58 vars in 1324 bytes} [Wed Aug 24 15:42:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 15:42:56.504231 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b4c1e-3a8d-47f8-8e33-d4dd51fdd4c8 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:42:56.522181 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b4c1e-3a8d-47f8-8e33-d4dd51fdd4c8 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:42:56.527145 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63a5c7-7a90-4be5-9746-225c3c52d531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:42:56.528385 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63a5c7-7a90-4be5-9746-225c3c52d531 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:42:56.528694 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63a5c7-7a90-4be5-9746-225c3c52d531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:42:56.528972 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63a5c7-7a90-4be5-9746-225c3c52d531 admin admin] PATH_INFO: `/v3/projects/23fb7d167a714e0cb4ca2550c38d5f58` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:42:56.530533 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63a5c7-7a90-4be5-9746-225c3c52d531 admin admin] RBAC: Authorizing `identity:get_project(project_id=23fb7d167a714e0cb4ca2550c38d5f58)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:42:56.584043 dv-cinder-849325-3-smb devstack@keystone.service[81716]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bf63a5c7-7a90-4be5-9746-225c3c52d531 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 15:42:56.584384 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63a5c7-7a90-4be5-9746-225c3c52d531 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:42:56.589925 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 3/5] 10.222.0.64 () {56 vars in 1207 bytes} [Wed Aug 24 15:42:56 2022] GET /identity/v3/projects/23fb7d167a714e0cb4ca2550c38d5f58 => generated 344 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:42:58.483373 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91482a23-effb-4303-bde3-ec33486aa72c None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:42:58.483905 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91482a23-effb-4303-bde3-ec33486aa72c None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:42:58.483905 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91482a23-effb-4303-bde3-ec33486aa72c None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:42:58.487958 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 3/6] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:42:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:42:58.493402 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3ab8f-64f4-4c25-8bf0-36356e516616 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:42:58.493857 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3ab8f-64f4-4c25-8bf0-36356e516616 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:42:58.494020 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3ab8f-64f4-4c25-8bf0-36356e516616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:42:58.514166 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-22f3ab8f-64f4-4c25-8bf0-36356e516616 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:42:58.515686 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-22f3ab8f-64f4-4c25-8bf0-36356e516616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:42:58.523540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 4/7] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:42:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 15:42:58.790674 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91482a23-effb-4303-bde3-ec33486aa72c None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:42:58.802913 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91482a23-effb-4303-bde3-ec33486aa72c None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:42:58.807744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4f42a-bb68-4aa4-97ff-a8bbacebbdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:42:58.808360 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4f42a-bb68-4aa4-97ff-a8bbacebbdc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:42:58.808667 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4f42a-bb68-4aa4-97ff-a8bbacebbdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:42:58.808947 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4f42a-bb68-4aa4-97ff-a8bbacebbdc7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:42:58.817166 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4f42a-bb68-4aa4-97ff-a8bbacebbdc7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:42:58.818962 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4f42a-bb68-4aa4-97ff-a8bbacebbdc7 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:42:58.829046 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 4/8] 10.222.0.64 () {58 vars in 1324 bytes} [Wed Aug 24 15:42:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 15:42:58.835011 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3ab8f-64f4-4c25-8bf0-36356e516616 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:42:58.844787 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3ab8f-64f4-4c25-8bf0-36356e516616 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:42:58.849186 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af529c2-69e1-4767-b62d-77791baea921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:42:58.849831 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af529c2-69e1-4767-b62d-77791baea921 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:42:58.850108 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af529c2-69e1-4767-b62d-77791baea921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:42:58.850378 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af529c2-69e1-4767-b62d-77791baea921 admin admin] PATH_INFO: `/v3/users/f3bef6df7d3341a9829325d03a53cc71` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:42:58.851707 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af529c2-69e1-4767-b62d-77791baea921 admin admin] RBAC: Authorizing `identity:get_user(user_id=f3bef6df7d3341a9829325d03a53cc71)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:42:58.853927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af529c2-69e1-4767-b62d-77791baea921 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:42:58.855497 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 5/9] 10.222.0.64 () {56 vars in 1198 bytes} [Wed Aug 24 15:42:58 2022] GET /identity/v3/users/f3bef6df7d3341a9829325d03a53cc71 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:43:00.862001 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de85ee9-bacf-4e78-9fd9-65a2bfa710e2 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:00.862551 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de85ee9-bacf-4e78-9fd9-65a2bfa710e2 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:00.862551 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de85ee9-bacf-4e78-9fd9-65a2bfa710e2 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:00.863885 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 5/10] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:00.869755 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f80186-633c-4eef-bee5-2557ae6bb673 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:00.870238 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f80186-633c-4eef-bee5-2557ae6bb673 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:00.870324 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f80186-633c-4eef-bee5-2557ae6bb673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:00.890883 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-08f80186-633c-4eef-bee5-2557ae6bb673 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:00.892088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-08f80186-633c-4eef-bee5-2557ae6bb673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:00.905048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca62e8c-dd75-4128-a6e4-f02181b97504 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:00.905438 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca62e8c-dd75-4128-a6e4-f02181b97504 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:00.905857 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca62e8c-dd75-4128-a6e4-f02181b97504 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:00.907283 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 6/11] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:00.913884 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd422216-5ba3-4e62-932d-837e6a27cc95 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:00.914322 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd422216-5ba3-4e62-932d-837e6a27cc95 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:00.914679 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd422216-5ba3-4e62-932d-837e6a27cc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:00.957855 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG passlib.handlers.bcrypt [None req-dd422216-5ba3-4e62-932d-837e6a27cc95 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81717) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 15:43:00.958273 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG passlib.handlers.bcrypt [None req-dd422216-5ba3-4e62-932d-837e6a27cc95 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81717) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 15:43:00.978847 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 6/12] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:01.004463 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-dd422216-5ba3-4e62-932d-837e6a27cc95 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:01.006125 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-dd422216-5ba3-4e62-932d-837e6a27cc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:01.108213 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 7/13] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:43:01.252209 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f80186-633c-4eef-bee5-2557ae6bb673 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:01.276112 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:01.359175 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f80186-633c-4eef-bee5-2557ae6bb673 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:01.378861 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd422216-5ba3-4e62-932d-837e6a27cc95 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:01.393713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e820fc-3602-4f44-b4cc-80fac248cde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:01.394355 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e820fc-3602-4f44-b4cc-80fac248cde7 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:01.394635 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e820fc-3602-4f44-b4cc-80fac248cde7 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:01.394910 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e820fc-3602-4f44-b4cc-80fac248cde7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:01.406931 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e820fc-3602-4f44-b4cc-80fac248cde7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:01.415619 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-52e820fc-3602-4f44-b4cc-80fac248cde7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:43:01.415619 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:01.415619 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:01.415619 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:01.415619 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:01.415619 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:01.415619 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:01.415619 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:01.415619 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:01.415619 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:01.415619 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:01.415619 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:01.415619 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:01.415619 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:01.415619 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:01.415619 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:01.416716 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:01.416716 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:01.416716 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:01.416716 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:01.416716 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:01.416716 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:01.416716 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:01.416716 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:01.416716 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:01.416716 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:01.416716 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:01.416716 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:01.416716 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:01.416716 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:01.416716 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:01.416716 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:01.417507 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:01.417507 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:01.417507 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:01.417507 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:01.417507 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:01.417507 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:01.417507 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:01.417507 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:01.417507 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:01.417507 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:01.417507 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:43:01.417507 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:43:01.417507 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 7/14] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:43:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:43:01.422753 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e820fc-3602-4f44-b4cc-80fac248cde7 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:01.484454 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd422216-5ba3-4e62-932d-837e6a27cc95 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:01.486880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:01.524248 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:01.524425 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7da846-9ab8-46bd-8629-defacb074388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:01.524425 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7da846-9ab8-46bd-8629-defacb074388 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:01.524425 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7da846-9ab8-46bd-8629-defacb074388 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:01.524425 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7da846-9ab8-46bd-8629-defacb074388 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:01.531422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e820fc-3602-4f44-b4cc-80fac248cde7 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:01.566175 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfcc327-09fc-4c33-8744-9b6e593fb08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:01.566790 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcc327-09fc-4c33-8744-9b6e593fb08a None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:01.567071 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcc327-09fc-4c33-8744-9b6e593fb08a None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:01.567343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcc327-09fc-4c33-8744-9b6e593fb08a None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:01.568027 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfcc327-09fc-4c33-8744-9b6e593fb08a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:01.568335 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfcc327-09fc-4c33-8744-9b6e593fb08a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:01.569805 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfcc327-09fc-4c33-8744-9b6e593fb08a None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:01.583666 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 8/15] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:43:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:43:01.589438 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfcc327-09fc-4c33-8744-9b6e593fb08a None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:01.599150 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7da846-9ab8-46bd-8629-defacb074388 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:01.600722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7da846-9ab8-46bd-8629-defacb074388 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:01.695995 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfcc327-09fc-4c33-8744-9b6e593fb08a None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:01.706791 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 8/16] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:43:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 15:43:01.712117 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7da846-9ab8-46bd-8629-defacb074388 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:01.715807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:01.739651 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899840cb-583c-4dc2-9505-a1599cd89bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:01.740258 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899840cb-583c-4dc2-9505-a1599cd89bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:01.740541 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899840cb-583c-4dc2-9505-a1599cd89bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:01.740854 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899840cb-583c-4dc2-9505-a1599cd89bf1 None admin] PATH_INFO: `/v3/users/f3bef6df7d3341a9829325d03a53cc71` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:01.742046 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899840cb-583c-4dc2-9505-a1599cd89bf1 None admin] RBAC: Authorizing `identity:get_user(user_id=f3bef6df7d3341a9829325d03a53cc71)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:01.744134 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899840cb-583c-4dc2-9505-a1599cd89bf1 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:01.745824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 9/17] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:01 2022] GET /identity/v3/users/f3bef6df7d3341a9829325d03a53cc71 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:43:01.753436 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899840cb-583c-4dc2-9505-a1599cd89bf1 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:01.771475 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:01.841771 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7da846-9ab8-46bd-8629-defacb074388 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:01.867460 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899840cb-583c-4dc2-9505-a1599cd89bf1 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:01.884718 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62133a5-c25d-48a2-8065-1e8704893a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:01.885648 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62133a5-c25d-48a2-8065-1e8704893a4e None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:01.885868 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62133a5-c25d-48a2-8065-1e8704893a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:01.886144 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62133a5-c25d-48a2-8065-1e8704893a4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:01.905685 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62133a5-c25d-48a2-8065-1e8704893a4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:01.906554 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776af8ad-ed6c-416a-bfd9-3f806b3c15d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:01.907199 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62133a5-c25d-48a2-8065-1e8704893a4e None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:01.907308 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776af8ad-ed6c-416a-bfd9-3f806b3c15d3 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:01.907479 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776af8ad-ed6c-416a-bfd9-3f806b3c15d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:01.907754 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776af8ad-ed6c-416a-bfd9-3f806b3c15d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:01.909310 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776af8ad-ed6c-416a-bfd9-3f806b3c15d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:01.910615 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776af8ad-ed6c-416a-bfd9-3f806b3c15d3 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:01.912225 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 10/18] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:43:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:43:01.918681 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776af8ad-ed6c-416a-bfd9-3f806b3c15d3 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:01.928954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-e62133a5-c25d-48a2-8065-1e8704893a4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:43:01.928954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:01.928954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:01.928954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:01.928954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:01.928954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:01.928954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:01.928954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:01.928954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:01.928954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:01.928954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:01.928954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:01.928954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:43:01.928954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:43:01.928954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:43:01.928954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:43:01.929870 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:01.929870 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:01.929870 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:01.929870 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:01.929870 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:01.929870 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:01.929870 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:01.929870 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:01.929870 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:01.929870 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:01.929870 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:01.929870 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:01.929870 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:01.929870 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:01.929870 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:01.929870 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:01.929870 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:43:01.930692 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:43:01.930692 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:43:01.930692 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:43:01.930692 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 9/19] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:43:01.936025 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62133a5-c25d-48a2-8065-1e8704893a4e None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:01.996942 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:02.003671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:02.022786 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776af8ad-ed6c-416a-bfd9-3f806b3c15d3 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:02.042353 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62133a5-c25d-48a2-8065-1e8704893a4e None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:02.060976 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401c942-74f7-4e9a-9981-9135aad9fd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:02.061609 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401c942-74f7-4e9a-9981-9135aad9fd0e None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:02.061890 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401c942-74f7-4e9a-9981-9135aad9fd0e None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:02.062168 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401c942-74f7-4e9a-9981-9135aad9fd0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:02.062911 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401c942-74f7-4e9a-9981-9135aad9fd0e None admin] RBAC: Adding query filter params (role.id=c6745e08f9da4a2bae8510c9983635c3, scope.domain.id=default, user.id=f3bef6df7d3341a9829325d03a53cc71) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:02.063223 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401c942-74f7-4e9a-9981-9135aad9fd0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:02.064715 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401c942-74f7-4e9a-9981-9135aad9fd0e None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:02.071682 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 11/20] 10.222.0.64 () {56 vars in 1322 bytes} [Wed Aug 24 15:43:01 2022] GET /identity/v3/role_assignments?user.id=f3bef6df7d3341a9829325d03a53cc71&scope.domain.id=default&role.id=c6745e08f9da4a2bae8510c9983635c3 => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:43:02.082193 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86e18c-44a0-4365-ac08-4c0a4168f09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:02.082814 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86e18c-44a0-4365-ac08-4c0a4168f09f None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:02.083097 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86e18c-44a0-4365-ac08-4c0a4168f09f None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:02.083374 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86e18c-44a0-4365-ac08-4c0a4168f09f None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:02.084061 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86e18c-44a0-4365-ac08-4c0a4168f09f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:02.084369 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86e18c-44a0-4365-ac08-4c0a4168f09f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:02.085878 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86e18c-44a0-4365-ac08-4c0a4168f09f None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:02.108085 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 10/21] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:43:04.161787 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1414627-244c-4c83-8101-4fe7c4080256 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:04.162300 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1414627-244c-4c83-8101-4fe7c4080256 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:04.162373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1414627-244c-4c83-8101-4fe7c4080256 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:04.164014 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 12/22] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:04.169578 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac27b66-b42b-4d5b-934a-93a5343e4ca7 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:04.170044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac27b66-b42b-4d5b-934a-93a5343e4ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:04.170118 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac27b66-b42b-4d5b-934a-93a5343e4ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:04.205698 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-cac27b66-b42b-4d5b-934a-93a5343e4ca7 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:04.206925 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-cac27b66-b42b-4d5b-934a-93a5343e4ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:04.290408 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 11/23] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:43:04.667065 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef126d-127c-459a-8f3e-ee04903b6508 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:04.667435 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef126d-127c-459a-8f3e-ee04903b6508 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:04.667625 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef126d-127c-459a-8f3e-ee04903b6508 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:04.669337 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 13/24] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:04.674396 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc93bf-38b3-4873-ad86-c7b9ac14e8dc None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:04.674695 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc93bf-38b3-4873-ad86-c7b9ac14e8dc None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:04.674975 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc93bf-38b3-4873-ad86-c7b9ac14e8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:04.698549 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-10bc93bf-38b3-4873-ad86-c7b9ac14e8dc None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:04.699761 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-10bc93bf-38b3-4873-ad86-c7b9ac14e8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:04.754309 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:04.786352 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 12/25] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:04.863498 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef126d-127c-459a-8f3e-ee04903b6508 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:04.923679 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217f779-c542-4ecf-948f-6679640ecedb None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:04.923997 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217f779-c542-4ecf-948f-6679640ecedb None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:04.924174 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217f779-c542-4ecf-948f-6679640ecedb None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:04.925787 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 13/26] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:43:04.931126 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f615810-db0e-4aeb-aed9-eb56b624c626 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:04.931469 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f615810-db0e-4aeb-aed9-eb56b624c626 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:04.931750 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f615810-db0e-4aeb-aed9-eb56b624c626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:04.974002 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-8f615810-db0e-4aeb-aed9-eb56b624c626 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:04.975235 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-8f615810-db0e-4aeb-aed9-eb56b624c626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:05.015285 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef126d-127c-459a-8f3e-ee04903b6508 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:05.059125 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383795d-5580-4355-8011-5383268f5421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:05.060156 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383795d-5580-4355-8011-5383268f5421 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:05.060662 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383795d-5580-4355-8011-5383268f5421 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:05.061151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383795d-5580-4355-8011-5383268f5421 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:05.076047 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9383795d-5580-4355-8011-5383268f5421 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:05.082823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-9383795d-5580-4355-8011-5383268f5421 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:43:05.082823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:05.082823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:05.082823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:05.082823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:05.082823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:05.082823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:05.082823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:05.082823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:05.082823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:05.082823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:05.082823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:05.082823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:05.082823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:05.082823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:05.082823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:05.083783 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:05.083783 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:05.083783 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:05.083783 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:05.083783 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:05.083783 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:05.083783 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:05.083783 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:05.083783 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:05.083783 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:05.083783 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:05.083783 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:05.083783 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:05.083783 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:05.083783 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:05.083783 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:05.084653 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:05.084653 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:05.084653 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:05.084653 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:05.084653 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:05.084653 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:05.084653 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:05.084653 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:05.084653 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:05.084653 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:05.084653 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:43:05.084653 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:43:05.088714 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 14/27] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:43:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:43:05.098401 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383795d-5580-4355-8011-5383268f5421 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:05.107831 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:05.113992 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 14/28] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 24 15:43:05.202868 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0903077-2daf-4baf-a03b-af9c43976e77 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:05.203546 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0903077-2daf-4baf-a03b-af9c43976e77 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:05.203546 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0903077-2daf-4baf-a03b-af9c43976e77 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:05.204829 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 15/29] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:43:05.211744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9356c-8cd0-4e9b-bbdf-9a205ef4b3ed None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:05.213137 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9356c-8cd0-4e9b-bbdf-9a205ef4b3ed None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:05.213814 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9356c-8cd0-4e9b-bbdf-9a205ef4b3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:05.233276 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-68a9356c-8cd0-4e9b-bbdf-9a205ef4b3ed None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:05.234855 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-68a9356c-8cd0-4e9b-bbdf-9a205ef4b3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:05.248209 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383795d-5580-4355-8011-5383268f5421 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:05.329071 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e804783-1266-4240-8b88-5e123699d408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:05.330119 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e804783-1266-4240-8b88-5e123699d408 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:05.331438 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e804783-1266-4240-8b88-5e123699d408 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:05.331963 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e804783-1266-4240-8b88-5e123699d408 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:05.332896 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e804783-1266-4240-8b88-5e123699d408 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:05.333429 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e804783-1266-4240-8b88-5e123699d408 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:05.335539 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e804783-1266-4240-8b88-5e123699d408 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:05.346904 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 15/30] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:43:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:05.348176 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e804783-1266-4240-8b88-5e123699d408 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:05.359708 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 16/31] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:43:05.360665 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9356c-8cd0-4e9b-bbdf-9a205ef4b3ed None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:05.402898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:05.477003 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:05.536090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9356c-8cd0-4e9b-bbdf-9a205ef4b3ed None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:05.548522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e804783-1266-4240-8b88-5e123699d408 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:05.606218 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae32ec-a961-4bab-8647-3bf9f8bd115b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:05.607477 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae32ec-a961-4bab-8647-3bf9f8bd115b None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:05.608704 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae32ec-a961-4bab-8647-3bf9f8bd115b None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:05.608996 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae32ec-a961-4bab-8647-3bf9f8bd115b None admin] PATH_INFO: `/v3/users/f3bef6df7d3341a9829325d03a53cc71` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:05.611345 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae32ec-a961-4bab-8647-3bf9f8bd115b None admin] RBAC: Authorizing `identity:get_user(user_id=f3bef6df7d3341a9829325d03a53cc71)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:05.612862 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae32ec-a961-4bab-8647-3bf9f8bd115b None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:05.614524 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 17/32] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:05 2022] GET /identity/v3/users/f3bef6df7d3341a9829325d03a53cc71 => generated 247 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:05.615301 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae32ec-a961-4bab-8647-3bf9f8bd115b None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:05.617577 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849891a-5a85-4648-90ba-137b73df3b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:05.618874 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849891a-5a85-4648-90ba-137b73df3b4a None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:05.619170 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849891a-5a85-4648-90ba-137b73df3b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:05.619414 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849891a-5a85-4648-90ba-137b73df3b4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:05.641060 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849891a-5a85-4648-90ba-137b73df3b4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:05.642594 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849891a-5a85-4648-90ba-137b73df3b4a None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:05.679698 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-8849891a-5a85-4648-90ba-137b73df3b4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:43:05.679698 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:05.679698 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:05.679698 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:05.679698 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:05.679698 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:05.679698 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:05.679698 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:05.679698 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:05.679698 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:05.679698 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:05.679698 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:05.679698 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:43:05.679698 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:43:05.679698 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:43:05.679698 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:43:05.681125 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:05.681125 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:05.681125 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:05.681125 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:05.681125 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:05.681125 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:05.681125 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:05.681125 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:05.681125 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:05.681125 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:05.681125 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:05.681125 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:05.681125 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:05.681125 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:05.681125 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:05.681125 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:05.681125 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:43:05.682370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:43:05.682370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:43:05.682370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:43:05.682370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 16/33] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:43:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:43:05.683543 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849891a-5a85-4648-90ba-137b73df3b4a None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:05.809319 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae32ec-a961-4bab-8647-3bf9f8bd115b None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:05.817131 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:05.842772 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849891a-5a85-4648-90ba-137b73df3b4a None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:05.846941 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e4ac9-db3a-4932-93b8-2608acc9facf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:05.847566 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e4ac9-db3a-4932-93b8-2608acc9facf None admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:05.847852 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e4ac9-db3a-4932-93b8-2608acc9facf None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:05.848127 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e4ac9-db3a-4932-93b8-2608acc9facf None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:05.848849 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e4ac9-db3a-4932-93b8-2608acc9facf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:05.850242 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e4ac9-db3a-4932-93b8-2608acc9facf None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:05.863817 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:05.886342 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6fcc9-67bb-4ab0-b862-64b3e1f0910c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:05.886994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6fcc9-67bb-4ab0-b862-64b3e1f0910c None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:05.887280 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6fcc9-67bb-4ab0-b862-64b3e1f0910c None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:05.887561 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6fcc9-67bb-4ab0-b862-64b3e1f0910c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:05.888806 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6fcc9-67bb-4ab0-b862-64b3e1f0910c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:05.890284 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6fcc9-67bb-4ab0-b862-64b3e1f0910c None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:05.891986 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 17/34] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:43:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:05.892781 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6fcc9-67bb-4ab0-b862-64b3e1f0910c None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:06.007238 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6fcc9-67bb-4ab0-b862-64b3e1f0910c None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:06.045261 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7dd40e-5243-4ca8-94e5-6f363bcb7484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:06.045925 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dd40e-5243-4ca8-94e5-6f363bcb7484 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:06.046192 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dd40e-5243-4ca8-94e5-6f363bcb7484 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:06.046473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dd40e-5243-4ca8-94e5-6f363bcb7484 None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:06.047126 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7dd40e-5243-4ca8-94e5-6f363bcb7484 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:06.047431 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7dd40e-5243-4ca8-94e5-6f363bcb7484 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:06.048824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7dd40e-5243-4ca8-94e5-6f363bcb7484 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:06.067608 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 18/35] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:06.068351 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7dd40e-5243-4ca8-94e5-6f363bcb7484 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:06.097682 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 18/36] 10.222.0.64 () {60 vars in 1131 bytes} [Wed Aug 24 15:43:05 2022] POST /identity/v3/roles => generated 219 bytes in 483 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:43:06.098662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e4ac9-db3a-4932-93b8-2608acc9facf None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:06.139234 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:06.205342 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7dd40e-5243-4ca8-94e5-6f363bcb7484 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:06.221076 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e4ac9-db3a-4932-93b8-2608acc9facf None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:06.253755 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4dc728-b0b5-4cd5-b7c9-7477856bc529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:06.254637 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4dc728-b0b5-4cd5-b7c9-7477856bc529 None admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:06.254728 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4dc728-b0b5-4cd5-b7c9-7477856bc529 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:06.255024 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4dc728-b0b5-4cd5-b7c9-7477856bc529 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:06.255718 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4dc728-b0b5-4cd5-b7c9-7477856bc529 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:06.257199 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4dc728-b0b5-4cd5-b7c9-7477856bc529 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:06.267063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21926e1f-bc97-4424-b75a-d4ff0f6d330a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:06.269139 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21926e1f-bc97-4424-b75a-d4ff0f6d330a None admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:06.269139 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21926e1f-bc97-4424-b75a-d4ff0f6d330a None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:06.269139 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21926e1f-bc97-4424-b75a-d4ff0f6d330a None admin] PATH_INFO: `/v3/domains/default/users/f3bef6df7d3341a9829325d03a53cc71/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:06.271545 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21926e1f-bc97-4424-b75a-d4ff0f6d330a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f3bef6df7d3341a9829325d03a53cc71, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:06.273193 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21926e1f-bc97-4424-b75a-d4ff0f6d330a None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:06.364368 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 19/37] 10.222.0.64 () {58 vars in 1361 bytes} [Wed Aug 24 15:43:06 2022] PUT /identity/v3/domains/default/users/f3bef6df7d3341a9829325d03a53cc71/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:43:06.365164 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21926e1f-bc97-4424-b75a-d4ff0f6d330a None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:06.403297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:06.465073 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 19/38] 10.222.0.64 () {60 vars in 1131 bytes} [Wed Aug 24 15:43:06 2022] POST /identity/v3/roles => generated 225 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:43:06.466710 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54af74-f1ab-44b2-95a1-528cc2d84dda None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:06.467043 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54af74-f1ab-44b2-95a1-528cc2d84dda None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:06.467312 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54af74-f1ab-44b2-95a1-528cc2d84dda None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:06.468960 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 20/39] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:06.469994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56246223-2b8b-4870-975c-216124f2bb8e None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:06.470329 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56246223-2b8b-4870-975c-216124f2bb8e None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:06.470610 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56246223-2b8b-4870-975c-216124f2bb8e None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:06.471866 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 21/40] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:06.478318 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a409cb8-4f15-446d-8160-e35a73eb7190 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:06.478815 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a409cb8-4f15-446d-8160-e35a73eb7190 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:06.479225 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a409cb8-4f15-446d-8160-e35a73eb7190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:06.506383 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-6a409cb8-4f15-446d-8160-e35a73eb7190 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:06.508369 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-6a409cb8-4f15-446d-8160-e35a73eb7190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:06.547036 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21926e1f-bc97-4424-b75a-d4ff0f6d330a None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:06.599818 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc204b-ba9f-43c0-bb4d-dda187d6d843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:06.600859 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc204b-ba9f-43c0-bb4d-dda187d6d843 None admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:06.601357 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc204b-ba9f-43c0-bb4d-dda187d6d843 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:06.601860 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc204b-ba9f-43c0-bb4d-dda187d6d843 None admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:06.603344 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc204b-ba9f-43c0-bb4d-dda187d6d843 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:06.605176 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc204b-ba9f-43c0-bb4d-dda187d6d843 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:06.631332 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 22/41] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:06.632671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d75c4-d074-4845-bf44-c212cb35c945 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:06.632979 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d75c4-d074-4845-bf44-c212cb35c945 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:06.633256 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d75c4-d074-4845-bf44-c212cb35c945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:06.653862 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-391d75c4-d074-4845-bf44-c212cb35c945 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:06.655056 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-391d75c4-d074-4845-bf44-c212cb35c945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:06.702493 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:06.747493 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 23/42] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:06.756734 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 20/43] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 24 15:43:06 2022] POST /identity/v3/projects => generated 301 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:43:06.921097 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d75c4-d074-4845-bf44-c212cb35c945 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:07.033440 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc204b-ba9f-43c0-bb4d-dda187d6d843 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:07.121748 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:07.142124 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d75c4-d074-4845-bf44-c212cb35c945 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:07.147441 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc204b-ba9f-43c0-bb4d-dda187d6d843 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:07.183973 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f1053-13d9-4463-9751-c0f71a3bd25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:07.184654 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f1053-13d9-4463-9751-c0f71a3bd25b None admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:07.184969 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f1053-13d9-4463-9751-c0f71a3bd25b None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:07.185363 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f1053-13d9-4463-9751-c0f71a3bd25b None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:07.186056 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f1053-13d9-4463-9751-c0f71a3bd25b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:07.187368 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab48a7b-b0c2-4412-9826-5049b3567c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:07.187612 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f1053-13d9-4463-9751-c0f71a3bd25b None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:07.188328 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab48a7b-b0c2-4412-9826-5049b3567c25 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:07.188827 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab48a7b-b0c2-4412-9826-5049b3567c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:07.189258 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab48a7b-b0c2-4412-9826-5049b3567c25 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:07.197562 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab48a7b-b0c2-4412-9826-5049b3567c25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:07.199305 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab48a7b-b0c2-4412-9826-5049b3567c25 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:07.201023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 21/44] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:43:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:43:07.206538 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab48a7b-b0c2-4412-9826-5049b3567c25 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:07.255984 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 24/45] 10.222.0.64 () {60 vars in 1131 bytes} [Wed Aug 24 15:43:06 2022] POST /identity/v3/roles => generated 223 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:43:07.342416 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab48a7b-b0c2-4412-9826-5049b3567c25 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:07.383383 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b4d74-454b-4853-a113-4b2551ad078a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:07.384578 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b4d74-454b-4853-a113-4b2551ad078a None admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:07.384894 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b4d74-454b-4853-a113-4b2551ad078a None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:07.385172 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b4d74-454b-4853-a113-4b2551ad078a None admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:07.385833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b4d74-454b-4853-a113-4b2551ad078a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:07.387352 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b4d74-454b-4853-a113-4b2551ad078a None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:07.404976 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:07.491409 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 22/46] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 24 15:43:07 2022] POST /identity/v3/projects => generated 312 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:43:08.431373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fb2c4-67ef-491d-8eb4-45c4e309424c None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:08.431888 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fb2c4-67ef-491d-8eb4-45c4e309424c None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:08.431993 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fb2c4-67ef-491d-8eb4-45c4e309424c None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:08.433306 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 25/47] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:08.439038 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d36f1-6944-4400-a3b0-f4b44e8ee4cb None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:08.439538 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d36f1-6944-4400-a3b0-f4b44e8ee4cb None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:08.439625 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d36f1-6944-4400-a3b0-f4b44e8ee4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:08.459359 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-bb3d36f1-6944-4400-a3b0-f4b44e8ee4cb None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:08.461032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-bb3d36f1-6944-4400-a3b0-f4b44e8ee4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:08.530590 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 23/48] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:08.805319 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fb2c4-67ef-491d-8eb4-45c4e309424c None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:08.835756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:08.911256 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fb2c4-67ef-491d-8eb4-45c4e309424c None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:08.947960 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbd2c1-6a85-41e2-89cd-918e9d238671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:08.948600 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbd2c1-6a85-41e2-89cd-918e9d238671 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:08.948915 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbd2c1-6a85-41e2-89cd-918e9d238671 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:08.949197 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbd2c1-6a85-41e2-89cd-918e9d238671 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:08.959338 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fbd2c1-6a85-41e2-89cd-918e9d238671 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:08.964651 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-88fbd2c1-6a85-41e2-89cd-918e9d238671 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:43:08.964651 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:08.964651 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:08.964651 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:08.964651 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:08.964651 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:08.964651 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:08.964651 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:08.964651 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:08.964651 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:08.964651 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:08.964651 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:08.964651 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:08.964651 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:08.964651 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:08.964651 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:08.965523 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:08.965523 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:08.965523 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:08.965523 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:08.965523 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:08.965523 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:08.965523 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:08.965523 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:08.965523 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:08.965523 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:08.965523 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:08.965523 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:08.965523 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:08.965523 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:08.965523 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:08.965523 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:08.966255 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:08.966255 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:08.966255 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:08.966255 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:08.966255 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:08.966255 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:08.966255 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:08.966255 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:08.966255 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:08.966255 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:08.966255 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:43:08.966255 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:43:08.966255 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 26/49] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:43:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:43:08.971886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d36f1-6944-4400-a3b0-f4b44e8ee4cb None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:09.084071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d36f1-6944-4400-a3b0-f4b44e8ee4cb None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:09.113244 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:09.128954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc229774-ed33-4bbc-907c-6ed60148ead0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:09.130001 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc229774-ed33-4bbc-907c-6ed60148ead0 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:09.130502 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc229774-ed33-4bbc-907c-6ed60148ead0 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:09.130991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc229774-ed33-4bbc-907c-6ed60148ead0 None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:09.132135 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc229774-ed33-4bbc-907c-6ed60148ead0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:09.132700 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc229774-ed33-4bbc-907c-6ed60148ead0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:09.135352 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc229774-ed33-4bbc-907c-6ed60148ead0 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:09.255242 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 24/50] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:43:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:43:09.261325 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbd2c1-6a85-41e2-89cd-918e9d238671 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:09.377626 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:09.392690 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbd2c1-6a85-41e2-89cd-918e9d238671 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:09.414147 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624a277-ea22-4ada-895f-e576d82dcf6a None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:09.414431 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624a277-ea22-4ada-895f-e576d82dcf6a None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:09.414743 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624a277-ea22-4ada-895f-e576d82dcf6a None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:09.416918 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 25/51] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:43:09.422227 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9324c09-0308-4b7c-94ab-312051569dd5 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:09.422506 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9324c09-0308-4b7c-94ab-312051569dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:09.422778 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9324c09-0308-4b7c-94ab-312051569dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:09.428459 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c3b0c-b1d5-4951-b7fe-5c314fa508b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:09.429130 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c3b0c-b1d5-4951-b7fe-5c314fa508b0 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:09.429416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c3b0c-b1d5-4951-b7fe-5c314fa508b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:09.429694 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c3b0c-b1d5-4951-b7fe-5c314fa508b0 None admin] PATH_INFO: `/v3/users/f3bef6df7d3341a9829325d03a53cc71` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:09.431052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c3b0c-b1d5-4951-b7fe-5c314fa508b0 None admin] RBAC: Authorizing `identity:get_user(user_id=f3bef6df7d3341a9829325d03a53cc71)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:09.432687 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c3b0c-b1d5-4951-b7fe-5c314fa508b0 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:09.434494 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 27/52] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:09 2022] GET /identity/v3/users/f3bef6df7d3341a9829325d03a53cc71 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:09.439895 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c3b0c-b1d5-4951-b7fe-5c314fa508b0 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:09.440753 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-e9324c09-0308-4b7c-94ab-312051569dd5 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:09.441939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e9324c09-0308-4b7c-94ab-312051569dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:09.523472 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 26/53] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:43:09.561395 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c3b0c-b1d5-4951-b7fe-5c314fa508b0 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:09.595306 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d7a75-142a-4ae1-9de2-f87587aafc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:09.595949 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d7a75-142a-4ae1-9de2-f87587aafc8d None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:09.596234 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d7a75-142a-4ae1-9de2-f87587aafc8d None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:09.596513 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d7a75-142a-4ae1-9de2-f87587aafc8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:09.597686 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d7a75-142a-4ae1-9de2-f87587aafc8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:09.599149 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d7a75-142a-4ae1-9de2-f87587aafc8d None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:09.600765 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 28/54] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:43:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:43:09.607572 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9324c09-0308-4b7c-94ab-312051569dd5 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:09.706600 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9324c09-0308-4b7c-94ab-312051569dd5 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:09.724395 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:09.740941 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a0224-75e9-4946-aac2-d1b9a0b89c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:09.741554 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a0224-75e9-4946-aac2-d1b9a0b89c14 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:09.741833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a0224-75e9-4946-aac2-d1b9a0b89c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:09.742105 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a0224-75e9-4946-aac2-d1b9a0b89c14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:09.742858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a0224-75e9-4946-aac2-d1b9a0b89c14 None admin] RBAC: Adding query filter params (role.id=c6745e08f9da4a2bae8510c9983635c3, scope.domain.id=default, user.id=f3bef6df7d3341a9829325d03a53cc71) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:09.743319 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a0224-75e9-4946-aac2-d1b9a0b89c14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:09.744945 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a0224-75e9-4946-aac2-d1b9a0b89c14 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:09.783093 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 27/55] 10.222.0.64 () {56 vars in 1322 bytes} [Wed Aug 24 15:43:09 2022] GET /identity/v3/role_assignments?user.id=f3bef6df7d3341a9829325d03a53cc71&scope.domain.id=default&role.id=c6745e08f9da4a2bae8510c9983635c3 => generated 530 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:09.796185 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d7a75-142a-4ae1-9de2-f87587aafc8d None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:09.824492 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:09.909705 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d7a75-142a-4ae1-9de2-f87587aafc8d None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:09.951431 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003271f3-9c61-405b-8dab-ee39f80670cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:09.952083 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003271f3-9c61-405b-8dab-ee39f80670cb None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:09.952366 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003271f3-9c61-405b-8dab-ee39f80670cb None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:09.952661 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003271f3-9c61-405b-8dab-ee39f80670cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:09.953808 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003271f3-9c61-405b-8dab-ee39f80670cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:09.955268 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003271f3-9c61-405b-8dab-ee39f80670cb None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:09.956964 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 29/56] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:43:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:09.963408 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a0224-75e9-4946-aac2-d1b9a0b89c14 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:10.066016 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a0224-75e9-4946-aac2-d1b9a0b89c14 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:10.099372 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab09b4-8b2d-4f74-bb64-3fb96738b88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:10.099977 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab09b4-8b2d-4f74-bb64-3fb96738b88c None admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:10.100261 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab09b4-8b2d-4f74-bb64-3fb96738b88c None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:10.100544 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab09b4-8b2d-4f74-bb64-3fb96738b88c None admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:10.101214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab09b4-8b2d-4f74-bb64-3fb96738b88c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:10.102707 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab09b4-8b2d-4f74-bb64-3fb96738b88c None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:10.199560 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 28/57] 10.222.0.64 () {60 vars in 1140 bytes} [Wed Aug 24 15:43:09 2022] POST /identity/v3/projects => generated 298 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:43:12.104957 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe96bce-9b29-4b36-be0e-1a0cdce3f1a0 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:12.105478 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe96bce-9b29-4b36-be0e-1a0cdce3f1a0 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:12.105586 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe96bce-9b29-4b36-be0e-1a0cdce3f1a0 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:12.106856 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 30/58] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:12.111960 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f732543-fccf-4ef2-a56b-72b7da403785 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:12.112370 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f732543-fccf-4ef2-a56b-72b7da403785 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:12.112524 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f732543-fccf-4ef2-a56b-72b7da403785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:12.130876 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-7f732543-fccf-4ef2-a56b-72b7da403785 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:12.132085 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-7f732543-fccf-4ef2-a56b-72b7da403785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:12.157983 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:12.198520 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 29/59] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:12.483844 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe96bce-9b29-4b36-be0e-1a0cdce3f1a0 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:12.574818 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:12.585479 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe96bce-9b29-4b36-be0e-1a0cdce3f1a0 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:12.620776 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b1a30-7fe0-42fb-a386-cba4e36c5729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:12.621410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b1a30-7fe0-42fb-a386-cba4e36c5729 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:12.621692 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b1a30-7fe0-42fb-a386-cba4e36c5729 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:12.621964 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b1a30-7fe0-42fb-a386-cba4e36c5729 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:12.623091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b1a30-7fe0-42fb-a386-cba4e36c5729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:12.624535 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b1a30-7fe0-42fb-a386-cba4e36c5729 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:12.626141 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 31/60] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:43:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:12.631906 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f732543-fccf-4ef2-a56b-72b7da403785 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:12.731644 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f732543-fccf-4ef2-a56b-72b7da403785 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:12.765027 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887d8fc-df2e-43df-babc-0799a2120e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:12.765568 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887d8fc-df2e-43df-babc-0799a2120e4e None admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:12.765850 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887d8fc-df2e-43df-babc-0799a2120e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:12.766124 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887d8fc-df2e-43df-babc-0799a2120e4e None admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:12.766775 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887d8fc-df2e-43df-babc-0799a2120e4e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:12.768291 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887d8fc-df2e-43df-babc-0799a2120e4e None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:12.870446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 30/61] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 24 15:43:12 2022] POST /identity/v3/users => generated 275 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:43:15.953318 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096efd7-8295-4d18-93d1-e30cc70f2062 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:15.953858 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096efd7-8295-4d18-93d1-e30cc70f2062 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:15.953858 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096efd7-8295-4d18-93d1-e30cc70f2062 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:15.955228 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 32/62] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:15.961875 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e54cfc-3816-4fab-8d9e-5949095fff87 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:15.962818 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e54cfc-3816-4fab-8d9e-5949095fff87 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:15.963326 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e54cfc-3816-4fab-8d9e-5949095fff87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:15.994238 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-b6e54cfc-3816-4fab-8d9e-5949095fff87 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:15.995833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-b6e54cfc-3816-4fab-8d9e-5949095fff87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:16.012755 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:16.090638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 31/63] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:16.243473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e84c4e-49d8-49eb-86de-1e3cd27ff921 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:16.244114 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e84c4e-49d8-49eb-86de-1e3cd27ff921 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:16.244592 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e84c4e-49d8-49eb-86de-1e3cd27ff921 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:16.246205 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 33/64] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:16.251947 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea068275-79d1-43af-ad93-68a740c7bb40 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:16.252985 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea068275-79d1-43af-ad93-68a740c7bb40 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:16.252985 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea068275-79d1-43af-ad93-68a740c7bb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:16.254679 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a52beb-e8c0-4d58-8099-d72d07847f0a None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:16.255151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a52beb-e8c0-4d58-8099-d72d07847f0a None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:16.255575 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a52beb-e8c0-4d58-8099-d72d07847f0a None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:16.257122 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 34/65] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:43:16.267209 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e65efc-e1b4-4c89-a0c3-43124953673d None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:16.267791 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e65efc-e1b4-4c89-a0c3-43124953673d None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:16.268234 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e65efc-e1b4-4c89-a0c3-43124953673d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:16.294928 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-ea068275-79d1-43af-ad93-68a740c7bb40 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:16.296498 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-ea068275-79d1-43af-ad93-68a740c7bb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:16.297699 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-00e65efc-e1b4-4c89-a0c3-43124953673d None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:16.299173 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-00e65efc-e1b4-4c89-a0c3-43124953673d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:16.373349 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 32/66] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:16.421791 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea068275-79d1-43af-ad93-68a740c7bb40 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:16.440833 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 35/67] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:16.549079 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:16.577922 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea068275-79d1-43af-ad93-68a740c7bb40 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:16.637776 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6e7eb-e709-4a39-8ab3-d556d87563db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:16.637776 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6e7eb-e709-4a39-8ab3-d556d87563db None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:16.637776 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6e7eb-e709-4a39-8ab3-d556d87563db None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:16.637776 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6e7eb-e709-4a39-8ab3-d556d87563db None admin] PATH_INFO: `/v3/roles/member` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:16.669970 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6e7eb-e709-4a39-8ab3-d556d87563db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:16.681729 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-26b6e7eb-e709-4a39-8ab3-d556d87563db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:43:16.681729 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:16.681729 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:16.681729 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:16.681729 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:16.681729 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:16.681729 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:16.681729 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:16.681729 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:16.681729 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:16.681729 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:16.681729 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:16.681729 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:16.681729 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:16.681729 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:16.681729 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:16.683170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:16.683170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:16.683170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:16.683170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:16.683170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:16.683170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:16.683170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:16.683170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:16.683170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:16.683170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:16.683170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:16.683170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:16.683170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:16.683170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:16.683170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:16.683170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:16.684381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:16.684381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:16.684381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:16.684381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:16.684381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:16.684381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:16.684381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:16.684381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:16.684381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:16.684381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:16.684381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:43:16.684381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:43:16.688104 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 33/68] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:43:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:43:16.697985 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e65efc-e1b4-4c89-a0c3-43124953673d None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:16.701786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f7749-1fa8-42c4-a8e3-b95805aae182 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:16.702069 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f7749-1fa8-42c4-a8e3-b95805aae182 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:16.702516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f7749-1fa8-42c4-a8e3-b95805aae182 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:16.704009 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 34/69] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:43:16.713353 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4840295-ddf8-438e-9492-f6fb2ef521ff None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:16.715905 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4840295-ddf8-438e-9492-f6fb2ef521ff None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:16.717395 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4840295-ddf8-438e-9492-f6fb2ef521ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:16.750478 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-e4840295-ddf8-438e-9492-f6fb2ef521ff None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:16.751946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e4840295-ddf8-438e-9492-f6fb2ef521ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:16.828703 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:16.831675 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 35/70] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:16.833910 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4840295-ddf8-438e-9492-f6fb2ef521ff None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:16.843421 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e65efc-e1b4-4c89-a0c3-43124953673d None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:16.894014 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2f8bb-92b2-4244-836a-367c0e808046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:16.894767 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2f8bb-92b2-4244-836a-367c0e808046 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:16.895065 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2f8bb-92b2-4244-836a-367c0e808046 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:16.895591 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2f8bb-92b2-4244-836a-367c0e808046 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:16.896724 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2f8bb-92b2-4244-836a-367c0e808046 None admin] RBAC: Adding query filter params (name=member) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:16.897025 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2f8bb-92b2-4244-836a-367c0e808046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:16.898520 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2f8bb-92b2-4244-836a-367c0e808046 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:16.912765 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 36/71] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 24 15:43:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:16.913955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2f8bb-92b2-4244-836a-367c0e808046 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:16.928433 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:16.972944 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4840295-ddf8-438e-9492-f6fb2ef521ff None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:17.018424 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc0357-b940-4f50-b749-4bf79b6c528e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:17.019340 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc0357-b940-4f50-b749-4bf79b6c528e None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:17.019775 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc0357-b940-4f50-b749-4bf79b6c528e None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:17.020218 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc0357-b940-4f50-b749-4bf79b6c528e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:17.032908 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc0357-b940-4f50-b749-4bf79b6c528e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:17.034300 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2f8bb-92b2-4244-836a-367c0e808046 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:17.037954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-1ffc0357-b940-4f50-b749-4bf79b6c528e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:43:17.037954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:17.037954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:17.037954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:17.037954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:17.037954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:17.037954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:17.037954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:17.037954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:17.037954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:17.037954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:17.037954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:17.037954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:17.037954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:17.037954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:17.037954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:17.038790 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:17.038790 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:17.038790 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:17.038790 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:17.038790 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:17.038790 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:17.038790 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:17.038790 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:17.038790 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:17.038790 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:17.038790 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:17.038790 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:17.038790 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:17.038790 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:17.038790 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:17.038790 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:17.039677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:17.039677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:17.039677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:17.039677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:17.039677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:17.039677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:17.039677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:17.039677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:17.039677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:17.039677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:17.039677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:43:17.039677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:43:17.039677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 36/72] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 24 15:43:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:43:17.045283 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc05e30-734e-478e-91cf-dbbb789a923a None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:17.045578 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc05e30-734e-478e-91cf-dbbb789a923a None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:17.045861 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc05e30-734e-478e-91cf-dbbb789a923a None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:17.048661 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 37/73] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:17.048661 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc05e30-734e-478e-91cf-dbbb789a923a None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:17.077751 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f82787-d376-4b74-8b0e-f0af020dec1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:17.078982 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f82787-d376-4b74-8b0e-f0af020dec1e None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:17.079210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f82787-d376-4b74-8b0e-f0af020dec1e None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:17.079760 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f82787-d376-4b74-8b0e-f0af020dec1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:17.095127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f82787-d376-4b74-8b0e-f0af020dec1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:17.101715 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-c8f82787-d376-4b74-8b0e-f0af020dec1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:43:17.101715 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:17.101715 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:17.101715 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:17.101715 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:17.101715 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:17.101715 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:17.101715 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:17.101715 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:17.101715 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:17.101715 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:17.101715 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:17.101715 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:17.101715 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:17.101715 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:17.101715 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:17.103184 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:17.103184 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:17.103184 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:17.103184 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:17.103184 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:17.103184 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:17.103184 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:17.103184 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:17.103184 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:17.103184 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:17.103184 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:17.103184 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:17.103184 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:17.103184 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:17.103184 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:17.103184 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:17.103920 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:17.103920 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:17.103920 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:17.103920 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:17.103920 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:17.103920 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:17.103920 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:17.103920 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:17.103920 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:17.103920 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:17.103920 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:43:17.103920 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:43:17.103920 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 37/74] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:43:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:43:17.103920 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f82787-d376-4b74-8b0e-f0af020dec1e None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:17.116713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:17.163326 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc05e30-734e-478e-91cf-dbbb789a923a None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:17.193481 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:17.201779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212bf1b5-814e-4724-a74f-8d3f2602bee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:17.202431 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bf1b5-814e-4724-a74f-8d3f2602bee0 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:17.202709 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bf1b5-814e-4724-a74f-8d3f2602bee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:17.203067 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bf1b5-814e-4724-a74f-8d3f2602bee0 None admin] PATH_INFO: `/v3/users/da731fa9396f47948c6cb3efa385c081` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:17.212297 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f82787-d376-4b74-8b0e-f0af020dec1e None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:17.218642 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212bf1b5-814e-4724-a74f-8d3f2602bee0 None admin] RBAC: Authorizing `identity:get_user(user_id=da731fa9396f47948c6cb3efa385c081)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:17.220145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212bf1b5-814e-4724-a74f-8d3f2602bee0 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:17.221883 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 38/75] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:17 2022] GET /identity/v3/users/da731fa9396f47948c6cb3efa385c081 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:17.223079 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec998bc8-59ef-4cea-935d-2a0d2f52f256 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:17.223360 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec998bc8-59ef-4cea-935d-2a0d2f52f256 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:17.223627 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec998bc8-59ef-4cea-935d-2a0d2f52f256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:17.243357 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-ec998bc8-59ef-4cea-935d-2a0d2f52f256 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:17.244580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-ec998bc8-59ef-4cea-935d-2a0d2f52f256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:17.252293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452adcd0-dd33-4bdd-b726-fcc2736bc0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:17.253053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452adcd0-dd33-4bdd-b726-fcc2736bc0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:17.253339 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452adcd0-dd33-4bdd-b726-fcc2736bc0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:17.253724 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452adcd0-dd33-4bdd-b726-fcc2736bc0d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:17.254289 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452adcd0-dd33-4bdd-b726-fcc2736bc0d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:17.256001 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452adcd0-dd33-4bdd-b726-fcc2736bc0d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:17.256001 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452adcd0-dd33-4bdd-b726-fcc2736bc0d7 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:17.264743 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 38/76] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:43:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:17.265409 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452adcd0-dd33-4bdd-b726-fcc2736bc0d7 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:17.326615 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 39/77] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:17.327288 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec998bc8-59ef-4cea-935d-2a0d2f52f256 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:17.354616 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:17.393475 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452adcd0-dd33-4bdd-b726-fcc2736bc0d7 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:17.436355 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec998bc8-59ef-4cea-935d-2a0d2f52f256 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:17.436573 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4e864-1214-4761-8d43-43b7d1b7d486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:17.437216 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4e864-1214-4761-8d43-43b7d1b7d486 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:17.437500 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4e864-1214-4761-8d43-43b7d1b7d486 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:17.437866 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4e864-1214-4761-8d43-43b7d1b7d486 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:17.452113 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4e864-1214-4761-8d43-43b7d1b7d486 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:17.455030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:17.457740 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-afd4e864-1214-4761-8d43-43b7d1b7d486 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:43:17.457740 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:17.457740 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:17.457740 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:17.457740 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:17.457740 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:17.457740 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:17.457740 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:17.457740 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:17.457740 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:17.457740 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:17.457740 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:17.457740 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:17.457740 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:17.457740 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:17.457740 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:17.458572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:17.458572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:17.458572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:17.458572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:17.458572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:17.458572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:17.458572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:17.458572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:17.458572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:17.458572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:17.458572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:17.458572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:17.458572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:17.458572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:17.458572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:17.458572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:17.459306 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:17.459306 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:17.459306 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:17.459306 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:17.459306 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:17.459306 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:17.459306 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:17.459306 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:17.459306 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:17.459306 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:17.459306 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:43:17.459306 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:43:17.459306 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 39/78] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:43:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:43:17.460015 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4e864-1214-4761-8d43-43b7d1b7d486 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:17.480127 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adeb96-ceac-4daf-ba68-e94eb9c1c17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:17.480781 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adeb96-ceac-4daf-ba68-e94eb9c1c17b None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:17.481067 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adeb96-ceac-4daf-ba68-e94eb9c1c17b None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:17.481344 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adeb96-ceac-4daf-ba68-e94eb9c1c17b None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:17.482018 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25adeb96-ceac-4daf-ba68-e94eb9c1c17b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:17.482324 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25adeb96-ceac-4daf-ba68-e94eb9c1c17b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:17.483713 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25adeb96-ceac-4daf-ba68-e94eb9c1c17b None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:17.498664 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 40/79] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:43:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:17.498664 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adeb96-ceac-4daf-ba68-e94eb9c1c17b None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:17.575622 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4e864-1214-4761-8d43-43b7d1b7d486 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:17.610143 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:17.610304 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adeb96-ceac-4daf-ba68-e94eb9c1c17b None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:17.614938 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02ef7f-6746-4270-bfe2-24364f4207b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:17.615555 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02ef7f-6746-4270-bfe2-24364f4207b0 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:17.615839 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02ef7f-6746-4270-bfe2-24364f4207b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:17.616117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02ef7f-6746-4270-bfe2-24364f4207b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:17.644773 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95052d15-6bdd-44e7-b59d-d2af99787a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:17.645415 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95052d15-6bdd-44e7-b59d-d2af99787a61 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:17.645696 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95052d15-6bdd-44e7-b59d-d2af99787a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:17.645971 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95052d15-6bdd-44e7-b59d-d2af99787a61 None admin] PATH_INFO: `/v3/users/da731fa9396f47948c6cb3efa385c081` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:17.647105 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95052d15-6bdd-44e7-b59d-d2af99787a61 None admin] RBAC: Authorizing `identity:get_user(user_id=da731fa9396f47948c6cb3efa385c081)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:17.649178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95052d15-6bdd-44e7-b59d-d2af99787a61 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:17.650855 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 41/80] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:17 2022] GET /identity/v3/users/da731fa9396f47948c6cb3efa385c081 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:17.651721 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95052d15-6bdd-44e7-b59d-d2af99787a61 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:17.690611 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02ef7f-6746-4270-bfe2-24364f4207b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:17.692083 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02ef7f-6746-4270-bfe2-24364f4207b0 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:17.702063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:17.755697 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95052d15-6bdd-44e7-b59d-d2af99787a61 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:17.794078 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd3033-9192-4aef-a7f4-848ba5550481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:17.794693 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd3033-9192-4aef-a7f4-848ba5550481 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:17.794979 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd3033-9192-4aef-a7f4-848ba5550481 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:17.795252 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd3033-9192-4aef-a7f4-848ba5550481 None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:17.795910 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd3033-9192-4aef-a7f4-848ba5550481 None admin] RBAC: Adding query filter params (name=member) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:17.796213 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd3033-9192-4aef-a7f4-848ba5550481 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:17.797606 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd3033-9192-4aef-a7f4-848ba5550481 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:17.798345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 40/81] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:43:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:17.799264 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02ef7f-6746-4270-bfe2-24364f4207b0 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:17.810915 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 42/82] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 24 15:43:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:17.812197 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd3033-9192-4aef-a7f4-848ba5550481 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:17.832449 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:17.917436 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02ef7f-6746-4270-bfe2-24364f4207b0 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:17.917957 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd3033-9192-4aef-a7f4-848ba5550481 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:17.928529 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:17.952495 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252f1f5-1137-47ec-b4a7-f14a06208fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:17.952837 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54d9ce-c683-443b-8de6-383807933f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:17.953171 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252f1f5-1137-47ec-b4a7-f14a06208fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:17.953478 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54d9ce-c683-443b-8de6-383807933f92 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:17.953580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252f1f5-1137-47ec-b4a7-f14a06208fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:17.953760 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54d9ce-c683-443b-8de6-383807933f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:17.953856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252f1f5-1137-47ec-b4a7-f14a06208fd3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:17.954036 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54d9ce-c683-443b-8de6-383807933f92 None admin] PATH_INFO: `/v3/users/f3bef6df7d3341a9829325d03a53cc71` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:17.954938 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252f1f5-1137-47ec-b4a7-f14a06208fd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:17.955162 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54d9ce-c683-443b-8de6-383807933f92 None admin] RBAC: Authorizing `identity:get_user(user_id=f3bef6df7d3341a9829325d03a53cc71)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:17.956401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252f1f5-1137-47ec-b4a7-f14a06208fd3 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:17.956610 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54d9ce-c683-443b-8de6-383807933f92 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:17.958211 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 43/83] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:43:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:17.958314 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 41/84] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:17 2022] GET /identity/v3/users/f3bef6df7d3341a9829325d03a53cc71 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:17.958970 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54d9ce-c683-443b-8de6-383807933f92 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:17.959138 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252f1f5-1137-47ec-b4a7-f14a06208fd3 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:18.072799 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252f1f5-1137-47ec-b4a7-f14a06208fd3 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:18.075960 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:18.079276 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54d9ce-c683-443b-8de6-383807933f92 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:18.108747 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a13161-cba1-4371-b5b1-ed8ced127243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:18.109383 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a13161-cba1-4371-b5b1-ed8ced127243 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:18.109682 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a13161-cba1-4371-b5b1-ed8ced127243 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:18.109951 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a13161-cba1-4371-b5b1-ed8ced127243 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:18.118214 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fed254-029b-4893-a39a-aa8288828f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:18.118900 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fed254-029b-4893-a39a-aa8288828f2c None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:18.119310 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fed254-029b-4893-a39a-aa8288828f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:18.119584 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fed254-029b-4893-a39a-aa8288828f2c None admin] PATH_INFO: `/v3/projects/db70f99b67e1479f847c3ac324683445` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:18.120782 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fed254-029b-4893-a39a-aa8288828f2c None admin] RBAC: Authorizing `identity:get_project(project_id=db70f99b67e1479f847c3ac324683445)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:18.122253 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fed254-029b-4893-a39a-aa8288828f2c None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:18.123908 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 42/85] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:43:17 2022] GET /identity/v3/projects/db70f99b67e1479f847c3ac324683445 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:18.124707 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fed254-029b-4893-a39a-aa8288828f2c None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:18.160678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:18.184245 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a13161-cba1-4371-b5b1-ed8ced127243 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:18.185695 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a13161-cba1-4371-b5b1-ed8ced127243 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:18.228712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fed254-029b-4893-a39a-aa8288828f2c None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:18.265998 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e2a0d-c00e-4829-83db-885e8d81b757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:18.266639 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e2a0d-c00e-4829-83db-885e8d81b757 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:18.266918 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e2a0d-c00e-4829-83db-885e8d81b757 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:18.267191 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e2a0d-c00e-4829-83db-885e8d81b757 None admin] PATH_INFO: `/v3/users/da731fa9396f47948c6cb3efa385c081` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:18.268341 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e2a0d-c00e-4829-83db-885e8d81b757 None admin] RBAC: Authorizing `identity:get_user(user_id=da731fa9396f47948c6cb3efa385c081)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:18.269823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e2a0d-c00e-4829-83db-885e8d81b757 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:18.271423 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 43/86] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:18 2022] GET /identity/v3/users/da731fa9396f47948c6cb3efa385c081 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:18.272301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e2a0d-c00e-4829-83db-885e8d81b757 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:18.306743 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 44/87] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:43:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:18.307613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a13161-cba1-4371-b5b1-ed8ced127243 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:18.316123 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:18.385174 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e2a0d-c00e-4829-83db-885e8d81b757 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:18.389497 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:18.410952 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a13161-cba1-4371-b5b1-ed8ced127243 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:18.419882 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f436d-56ed-4506-b84a-70b6a56ca034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:18.420533 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f436d-56ed-4506-b84a-70b6a56ca034 None admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:18.420847 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f436d-56ed-4506-b84a-70b6a56ca034 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:18.421125 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f436d-56ed-4506-b84a-70b6a56ca034 None admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:18.421784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f436d-56ed-4506-b84a-70b6a56ca034 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:18.423238 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f436d-56ed-4506-b84a-70b6a56ca034 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:18.448655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a89b62-f4f2-46b4-8a24-f3b9354cc1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:18.449252 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a89b62-f4f2-46b4-8a24-f3b9354cc1e3 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:18.449514 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a89b62-f4f2-46b4-8a24-f3b9354cc1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:18.449785 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a89b62-f4f2-46b4-8a24-f3b9354cc1e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:18.517688 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 44/88] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 24 15:43:18 2022] POST /identity/v3/users => generated 289 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:43:18.518551 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f436d-56ed-4506-b84a-70b6a56ca034 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:18.521252 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a89b62-f4f2-46b4-8a24-f3b9354cc1e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:18.523181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a89b62-f4f2-46b4-8a24-f3b9354cc1e3 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:18.628246 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:18.634668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:18.646215 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f436d-56ed-4506-b84a-70b6a56ca034 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:18.663607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 45/89] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:43:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:18.663607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a89b62-f4f2-46b4-8a24-f3b9354cc1e3 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:18.695497 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa2a3f-95ff-4bec-8c36-011b627a3ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:18.696749 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa2a3f-95ff-4bec-8c36-011b627a3ddc None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:18.697589 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa2a3f-95ff-4bec-8c36-011b627a3ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:18.697589 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa2a3f-95ff-4bec-8c36-011b627a3ddc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:18.697989 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa2a3f-95ff-4bec-8c36-011b627a3ddc None admin] RBAC: Adding query filter params (role.id=0ea43d9dfb184e27b48d251fd38463db, scope.project.id=db70f99b67e1479f847c3ac324683445, user.id=da731fa9396f47948c6cb3efa385c081) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:18.698834 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa2a3f-95ff-4bec-8c36-011b627a3ddc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:18.701528 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa2a3f-95ff-4bec-8c36-011b627a3ddc None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:18.709768 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 45/90] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:43:18 2022] GET /identity/v3/role_assignments?user.id=da731fa9396f47948c6cb3efa385c081&scope.project.id=db70f99b67e1479f847c3ac324683445&role.id=0ea43d9dfb184e27b48d251fd38463db => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:18.711126 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa2a3f-95ff-4bec-8c36-011b627a3ddc None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:18.828594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a89b62-f4f2-46b4-8a24-f3b9354cc1e3 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:18.866457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa2a3f-95ff-4bec-8c36-011b627a3ddc None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:18.879823 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96705fb0-86ad-4579-9cfb-582c492990cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:18.880954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96705fb0-86ad-4579-9cfb-582c492990cb None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:18.881606 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96705fb0-86ad-4579-9cfb-582c492990cb None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:18.882036 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96705fb0-86ad-4579-9cfb-582c492990cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:18.918508 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7581bf9-7093-4540-8e27-a2c5c8630fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:18.919206 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7581bf9-7093-4540-8e27-a2c5c8630fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:18.919569 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7581bf9-7093-4540-8e27-a2c5c8630fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:18.919898 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7581bf9-7093-4540-8e27-a2c5c8630fa7 None admin] PATH_INFO: `/v3/projects/db70f99b67e1479f847c3ac324683445` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:18.921157 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7581bf9-7093-4540-8e27-a2c5c8630fa7 None admin] RBAC: Authorizing `identity:get_project(project_id=db70f99b67e1479f847c3ac324683445)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:18.922652 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7581bf9-7093-4540-8e27-a2c5c8630fa7 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:18.925727 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 46/91] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:43:18 2022] GET /identity/v3/projects/db70f99b67e1479f847c3ac324683445 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:18.927210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7581bf9-7093-4540-8e27-a2c5c8630fa7 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:18.960000 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:18.962381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:19.000112 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96705fb0-86ad-4579-9cfb-582c492990cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:19.002080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96705fb0-86ad-4579-9cfb-582c492990cb None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:19.066861 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7581bf9-7093-4540-8e27-a2c5c8630fa7 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:19.117248 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e17d5-1f45-42e1-ad47-e2cd1fd0dbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:19.118248 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e17d5-1f45-42e1-ad47-e2cd1fd0dbc1 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:19.118679 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e17d5-1f45-42e1-ad47-e2cd1fd0dbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:19.119314 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e17d5-1f45-42e1-ad47-e2cd1fd0dbc1 None admin] PATH_INFO: `/v3/projects/db70f99b67e1479f847c3ac324683445` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:19.121812 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e17d5-1f45-42e1-ad47-e2cd1fd0dbc1 None admin] RBAC: Authorizing `identity:get_project(project_id=db70f99b67e1479f847c3ac324683445)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:19.125151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e17d5-1f45-42e1-ad47-e2cd1fd0dbc1 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:19.128753 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 47/92] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:43:18 2022] GET /identity/v3/projects/db70f99b67e1479f847c3ac324683445 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:19.130050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e17d5-1f45-42e1-ad47-e2cd1fd0dbc1 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:19.131256 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 46/93] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:43:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:19.142654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96705fb0-86ad-4579-9cfb-582c492990cb None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:19.249414 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:19.265617 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e17d5-1f45-42e1-ad47-e2cd1fd0dbc1 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:19.345964 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:19.348150 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ae784-80ba-4db8-afc4-ef61dabae334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:19.348815 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ae784-80ba-4db8-afc4-ef61dabae334 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:19.349095 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ae784-80ba-4db8-afc4-ef61dabae334 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:19.349369 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ae784-80ba-4db8-afc4-ef61dabae334 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:19.350121 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ae784-80ba-4db8-afc4-ef61dabae334 None admin] RBAC: Adding query filter params (role.id=38df38770b21458d87720d3c4c6f1ff1, scope.project.id=db70f99b67e1479f847c3ac324683445, user.id=da731fa9396f47948c6cb3efa385c081) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:19.350430 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ae784-80ba-4db8-afc4-ef61dabae334 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:19.352649 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ae784-80ba-4db8-afc4-ef61dabae334 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:19.371497 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 48/94] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:43:19 2022] GET /identity/v3/role_assignments?user.id=da731fa9396f47948c6cb3efa385c081&scope.project.id=db70f99b67e1479f847c3ac324683445&role.id=38df38770b21458d87720d3c4c6f1ff1 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:19.372454 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ae784-80ba-4db8-afc4-ef61dabae334 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:19.392497 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96705fb0-86ad-4579-9cfb-582c492990cb None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:19.541553 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ab7c2-77f0-4d0c-84b0-ddcdfd94a716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:19.542108 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ab7c2-77f0-4d0c-84b0-ddcdfd94a716 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:19.542390 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ab7c2-77f0-4d0c-84b0-ddcdfd94a716 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:19.542660 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ab7c2-77f0-4d0c-84b0-ddcdfd94a716 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:19.543408 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ab7c2-77f0-4d0c-84b0-ddcdfd94a716 None admin] RBAC: Adding query filter params (role.id=c6745e08f9da4a2bae8510c9983635c3, scope.project.id=db70f99b67e1479f847c3ac324683445, user.id=f3bef6df7d3341a9829325d03a53cc71) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:19.543715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ab7c2-77f0-4d0c-84b0-ddcdfd94a716 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:19.545229 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ab7c2-77f0-4d0c-84b0-ddcdfd94a716 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:19.566524 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 47/95] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:43:19 2022] GET /identity/v3/role_assignments?user.id=f3bef6df7d3341a9829325d03a53cc71&scope.project.id=db70f99b67e1479f847c3ac324683445&role.id=c6745e08f9da4a2bae8510c9983635c3 => generated 259 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:19.584726 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ae784-80ba-4db8-afc4-ef61dabae334 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:19.644081 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7e2f1-e40d-4a93-9303-44d25b26814d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:19.644780 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7e2f1-e40d-4a93-9303-44d25b26814d None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:19.645068 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7e2f1-e40d-4a93-9303-44d25b26814d None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:19.645348 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7e2f1-e40d-4a93-9303-44d25b26814d None admin] PATH_INFO: `/v3/projects/259c6598f8f0439d82deb036e6f053db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:19.646635 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7e2f1-e40d-4a93-9303-44d25b26814d None admin] RBAC: Authorizing `identity:get_project(project_id=259c6598f8f0439d82deb036e6f053db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:19.648173 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7e2f1-e40d-4a93-9303-44d25b26814d None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:19.650611 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 49/96] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:43:19 2022] GET /identity/v3/projects/259c6598f8f0439d82deb036e6f053db => generated 312 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:19.656794 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ab7c2-77f0-4d0c-84b0-ddcdfd94a716 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:19.839179 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ab7c2-77f0-4d0c-84b0-ddcdfd94a716 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:19.888605 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9d6d4-370e-4252-ad5b-3ed3e6e4b9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:19.889250 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9d6d4-370e-4252-ad5b-3ed3e6e4b9e8 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:19.889573 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9d6d4-370e-4252-ad5b-3ed3e6e4b9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:19.889848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9d6d4-370e-4252-ad5b-3ed3e6e4b9e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:19.890585 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9d6d4-370e-4252-ad5b-3ed3e6e4b9e8 None admin] RBAC: Adding query filter params (role.id=0ea43d9dfb184e27b48d251fd38463db, scope.project.id=259c6598f8f0439d82deb036e6f053db, user.id=da731fa9396f47948c6cb3efa385c081) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:19.890931 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9d6d4-370e-4252-ad5b-3ed3e6e4b9e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:19.892596 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9d6d4-370e-4252-ad5b-3ed3e6e4b9e8 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:19.905514 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 48/97] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:43:19 2022] GET /identity/v3/role_assignments?user.id=da731fa9396f47948c6cb3efa385c081&scope.project.id=259c6598f8f0439d82deb036e6f053db&role.id=0ea43d9dfb184e27b48d251fd38463db => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:21.052728 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e748e59-7b28-4028-b80d-dd9806e58bb7 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:21.053242 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e748e59-7b28-4028-b80d-dd9806e58bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:21.053316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e748e59-7b28-4028-b80d-dd9806e58bb7 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:21.054990 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 50/98] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:21.060479 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7dd49f-dc2a-48aa-b733-60e6cc47d0d7 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:21.060950 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7dd49f-dc2a-48aa-b733-60e6cc47d0d7 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:21.061122 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7dd49f-dc2a-48aa-b733-60e6cc47d0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:21.079642 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:21.085479 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-be7dd49f-dc2a-48aa-b733-60e6cc47d0d7 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:21.087482 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-be7dd49f-dc2a-48aa-b733-60e6cc47d0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:21.162475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 49/99] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:21.479656 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7c960-b2cc-4acc-976f-d02763e4f92c None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:21.480148 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7c960-b2cc-4acc-976f-d02763e4f92c None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:21.480680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7c960-b2cc-4acc-976f-d02763e4f92c None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:21.482241 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 51/100] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:21.487713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7c960-b2cc-4acc-976f-d02763e4f92c None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:21.499819 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a7514-04b3-45a3-9c7d-bf0e1d0f641b None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:21.500429 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a7514-04b3-45a3-9c7d-bf0e1d0f641b None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:21.500938 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a7514-04b3-45a3-9c7d-bf0e1d0f641b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:21.539030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-632a7514-04b3-45a3-9c7d-bf0e1d0f641b None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:21.540415 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:21.542580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-632a7514-04b3-45a3-9c7d-bf0e1d0f641b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:21.657734 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7c960-b2cc-4acc-976f-d02763e4f92c None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:21.701951 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070214a-a725-48b7-a62d-7ea4cbc09160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:21.703088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070214a-a725-48b7-a62d-7ea4cbc09160 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:21.703549 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070214a-a725-48b7-a62d-7ea4cbc09160 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:21.703970 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070214a-a725-48b7-a62d-7ea4cbc09160 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:21.718515 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070214a-a725-48b7-a62d-7ea4cbc09160 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:21.728131 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-e070214a-a725-48b7-a62d-7ea4cbc09160 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:43:21.728131 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:21.728131 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:21.728131 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:21.728131 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:21.728131 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:21.728131 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:21.728131 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:21.728131 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:21.728131 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:21.728131 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:21.728131 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:21.728131 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:21.728131 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:21.728131 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:21.728131 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:21.729542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:21.729542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:21.729542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:21.729542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:21.729542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:21.729542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:21.729542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:21.729542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:21.729542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:21.729542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:21.729542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:21.729542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:21.729542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:21.729542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:21.729542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:21.729542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:21.731053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:21.731053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:21.731053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:21.731053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:21.731053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:21.731053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:21.731053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:21.731053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:21.731053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:21.731053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:21.731053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:43:21.731053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:43:21.734854 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 52/101] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:43:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:43:21.736509 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a09133-bca6-4595-95d9-6c9e9e4d22f8 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:21.737056 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a09133-bca6-4595-95d9-6c9e9e4d22f8 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:21.737552 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a09133-bca6-4595-95d9-6c9e9e4d22f8 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:21.740305 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 53/102] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:21.746464 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a09133-bca6-4595-95d9-6c9e9e4d22f8 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:21.753845 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 50/103] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:21.757371 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21885404-0288-45d8-aad8-9dd41d14f3b7 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:21.757658 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21885404-0288-45d8-aad8-9dd41d14f3b7 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:21.758391 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21885404-0288-45d8-aad8-9dd41d14f3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:21.786979 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-21885404-0288-45d8-aad8-9dd41d14f3b7 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:21.788176 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-21885404-0288-45d8-aad8-9dd41d14f3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:21.912051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:21.922251 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 51/104] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:21.933070 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:21.950389 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a09133-bca6-4595-95d9-6c9e9e4d22f8 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:21.991640 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bafa2d-842a-42d6-b1e2-b72fbf189f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:21.992772 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bafa2d-842a-42d6-b1e2-b72fbf189f15 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:21.993071 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bafa2d-842a-42d6-b1e2-b72fbf189f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:21.993387 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bafa2d-842a-42d6-b1e2-b72fbf189f15 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:21.994078 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bafa2d-842a-42d6-b1e2-b72fbf189f15 None admin] RBAC: Adding query filter params (name=member) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:21.994395 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bafa2d-842a-42d6-b1e2-b72fbf189f15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:21.995804 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bafa2d-842a-42d6-b1e2-b72fbf189f15 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:22.004946 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 54/105] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 24 15:43:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:22.010744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21885404-0288-45d8-aad8-9dd41d14f3b7 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:22.127734 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21885404-0288-45d8-aad8-9dd41d14f3b7 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:22.163281 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b944a-8cdf-4edc-b8f9-b38cc9abca8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:22.164030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b944a-8cdf-4edc-b8f9-b38cc9abca8d None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:22.164992 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b944a-8cdf-4edc-b8f9-b38cc9abca8d None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:22.165369 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b944a-8cdf-4edc-b8f9-b38cc9abca8d None admin] PATH_INFO: `/v3/users/da731fa9396f47948c6cb3efa385c081` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:22.166721 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b944a-8cdf-4edc-b8f9-b38cc9abca8d None admin] RBAC: Authorizing `identity:get_user(user_id=da731fa9396f47948c6cb3efa385c081)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:22.168277 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b944a-8cdf-4edc-b8f9-b38cc9abca8d None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:22.169941 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 52/106] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:22 2022] GET /identity/v3/users/da731fa9396f47948c6cb3efa385c081 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:22.175569 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bafa2d-842a-42d6-b1e2-b72fbf189f15 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:22.284949 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bafa2d-842a-42d6-b1e2-b72fbf189f15 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:22.321347 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2bb83-2f3e-4ae2-8bbe-bc88ffdca9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:22.321988 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2bb83-2f3e-4ae2-8bbe-bc88ffdca9af None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:22.322272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2bb83-2f3e-4ae2-8bbe-bc88ffdca9af None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:22.322548 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2bb83-2f3e-4ae2-8bbe-bc88ffdca9af None admin] PATH_INFO: `/v3/projects/db70f99b67e1479f847c3ac324683445` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:22.323834 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d2bb83-2f3e-4ae2-8bbe-bc88ffdca9af None admin] RBAC: Authorizing `identity:get_project(project_id=db70f99b67e1479f847c3ac324683445)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:22.325407 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d2bb83-2f3e-4ae2-8bbe-bc88ffdca9af None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:22.327384 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 55/107] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:43:22 2022] GET /identity/v3/projects/db70f99b67e1479f847c3ac324683445 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:22.333089 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b944a-8cdf-4edc-b8f9-b38cc9abca8d None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:22.383049 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2bb83-2f3e-4ae2-8bbe-bc88ffdca9af None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:22.410750 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:22.435817 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:22.487921 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b944a-8cdf-4edc-b8f9-b38cc9abca8d None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:22.504228 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2bb83-2f3e-4ae2-8bbe-bc88ffdca9af None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:22.533598 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f206c4-607c-46cc-a9a1-8768bb288aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:22.534857 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f206c4-607c-46cc-a9a1-8768bb288aca None admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:22.535599 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f206c4-607c-46cc-a9a1-8768bb288aca None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:22.536354 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f206c4-607c-46cc-a9a1-8768bb288aca None admin] PATH_INFO: `/v3/projects/db70f99b67e1479f847c3ac324683445/users/da731fa9396f47948c6cb3efa385c081/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:22.539833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f206c4-607c-46cc-a9a1-8768bb288aca None admin] RBAC: Authorizing `identity:create_grant(project_id=db70f99b67e1479f847c3ac324683445, user_id=da731fa9396f47948c6cb3efa385c081, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:22.541521 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f206c4-607c-46cc-a9a1-8768bb288aca None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:22.543403 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294665af-0b73-4f6a-b736-fbae2eaecf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:22.544176 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294665af-0b73-4f6a-b736-fbae2eaecf1d None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:22.544534 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294665af-0b73-4f6a-b736-fbae2eaecf1d None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:22.544914 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294665af-0b73-4f6a-b736-fbae2eaecf1d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:22.546172 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294665af-0b73-4f6a-b736-fbae2eaecf1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:22.547867 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294665af-0b73-4f6a-b736-fbae2eaecf1d None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:22.556151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 56/108] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:43:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:43:22.556151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294665af-0b73-4f6a-b736-fbae2eaecf1d None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:22.620745 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 53/109] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 24 15:43:22 2022] PUT /identity/v3/projects/db70f99b67e1479f847c3ac324683445/users/da731fa9396f47948c6cb3efa385c081/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:43:22.622049 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f206c4-607c-46cc-a9a1-8768bb288aca None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:22.659703 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:22.701140 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294665af-0b73-4f6a-b736-fbae2eaecf1d None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:22.766655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f206c4-607c-46cc-a9a1-8768bb288aca None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:22.798618 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:22.808265 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364dfa89-1baa-40a3-bc2a-4dc37fb7b58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:22.809310 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dfa89-1baa-40a3-bc2a-4dc37fb7b58c None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:22.809600 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dfa89-1baa-40a3-bc2a-4dc37fb7b58c None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:22.809878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dfa89-1baa-40a3-bc2a-4dc37fb7b58c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:22.817518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a47a7ec-ee38-414e-8883-6edd8f62d928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:22.818110 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47a7ec-ee38-414e-8883-6edd8f62d928 None admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:22.818421 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47a7ec-ee38-414e-8883-6edd8f62d928 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:22.818680 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47a7ec-ee38-414e-8883-6edd8f62d928 None admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:22.819402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a47a7ec-ee38-414e-8883-6edd8f62d928 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:22.821472 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a47a7ec-ee38-414e-8883-6edd8f62d928 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:22.832674 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364dfa89-1baa-40a3-bc2a-4dc37fb7b58c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:22.837927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-364dfa89-1baa-40a3-bc2a-4dc37fb7b58c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:43:22.837927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:22.837927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:22.837927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:22.837927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:22.837927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:22.837927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:22.837927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:22.837927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:22.837927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:22.837927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:22.837927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:22.837927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:22.837927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:22.837927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:22.837927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:22.839417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:22.839417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:22.839417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:22.839417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:22.839417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:22.839417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:22.839417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:22.839417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:22.839417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:22.839417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:22.839417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:22.839417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:22.839417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:22.839417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:22.839417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:22.839417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:22.840498 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:22.840498 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:22.840498 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:22.840498 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:22.840498 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:22.840498 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:22.840498 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:22.840498 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:22.840498 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:22.840498 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:22.840498 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:43:22.840498 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:43:22.842110 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 57/110] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:43:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:43:22.843381 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c30a14-e8bf-49eb-b649-508d69c27299 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:22.843729 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c30a14-e8bf-49eb-b649-508d69c27299 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:22.844069 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c30a14-e8bf-49eb-b649-508d69c27299 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:22.845616 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 58/111] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:22.849703 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658feaf4-167a-43fc-8258-48f450da4db8 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:22.849703 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658feaf4-167a-43fc-8258-48f450da4db8 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:22.849703 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658feaf4-167a-43fc-8258-48f450da4db8 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:22.849703 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 59/112] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:22.851188 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ec36a-f14c-4497-8c2a-a7e5b09fdb1d None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:22.852058 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ec36a-f14c-4497-8c2a-a7e5b09fdb1d None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:22.852443 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ec36a-f14c-4497-8c2a-a7e5b09fdb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:22.871897 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-771ec36a-f14c-4497-8c2a-a7e5b09fdb1d None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:22.873287 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-771ec36a-f14c-4497-8c2a-a7e5b09fdb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:22.948870 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 54/113] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 24 15:43:22 2022] POST /identity/v3/projects => generated 302 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:43:22.955889 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 60/114] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:22.955889 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438d282-656a-44c3-b7df-94c02e20ff22 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:22.955889 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438d282-656a-44c3-b7df-94c02e20ff22 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:22.955889 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438d282-656a-44c3-b7df-94c02e20ff22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:22.957476 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a47a7ec-ee38-414e-8883-6edd8f62d928 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:22.972277 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-8438d282-656a-44c3-b7df-94c02e20ff22 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:22.976670 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-8438d282-656a-44c3-b7df-94c02e20ff22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:23.052812 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 61/115] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:23.108997 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c64dba-ddd9-476c-8598-af9555dcabc0 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:23.108997 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c64dba-ddd9-476c-8598-af9555dcabc0 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:23.109274 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c64dba-ddd9-476c-8598-af9555dcabc0 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:23.111003 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 62/116] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:23.116233 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85a2c3-d313-47d5-8895-0c20f593dd02 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:23.116517 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85a2c3-d313-47d5-8895-0c20f593dd02 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:23.116825 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85a2c3-d313-47d5-8895-0c20f593dd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:23.128654 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:23.136130 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a47a7ec-ee38-414e-8883-6edd8f62d928 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:23.151810 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-5f85a2c3-d313-47d5-8895-0c20f593dd02 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:23.157365 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-5f85a2c3-d313-47d5-8895-0c20f593dd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:23.183682 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ddafee-a052-4d2f-81a6-61ef418f9207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:23.184725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddafee-a052-4d2f-81a6-61ef418f9207 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:23.185234 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddafee-a052-4d2f-81a6-61ef418f9207 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:23.185701 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddafee-a052-4d2f-81a6-61ef418f9207 None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:23.186640 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ddafee-a052-4d2f-81a6-61ef418f9207 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:23.187243 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ddafee-a052-4d2f-81a6-61ef418f9207 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:23.188948 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ddafee-a052-4d2f-81a6-61ef418f9207 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:23.200686 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 55/117] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 24 15:43:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:23.207073 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ddafee-a052-4d2f-81a6-61ef418f9207 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:23.256418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:23.283428 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 63/118] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:23.340154 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ddafee-a052-4d2f-81a6-61ef418f9207 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:23.392044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892d326-0f81-4cf8-ae9d-ae9c4f59a9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:23.392955 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892d326-0f81-4cf8-ae9d-ae9c4f59a9e7 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:23.393398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892d326-0f81-4cf8-ae9d-ae9c4f59a9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:23.393877 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892d326-0f81-4cf8-ae9d-ae9c4f59a9e7 None admin] PATH_INFO: `/v3/users/4b0708e460424cab8ec1e9c9cb16c5c8` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:23.399994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85a2c3-d313-47d5-8895-0c20f593dd02 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:23.414388 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892d326-0f81-4cf8-ae9d-ae9c4f59a9e7 None admin] RBAC: Authorizing `identity:get_user(user_id=4b0708e460424cab8ec1e9c9cb16c5c8)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:23.416711 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892d326-0f81-4cf8-ae9d-ae9c4f59a9e7 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:23.418659 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 56/119] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:23 2022] GET /identity/v3/users/4b0708e460424cab8ec1e9c9cb16c5c8 => generated 289 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:43:23.424485 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892d326-0f81-4cf8-ae9d-ae9c4f59a9e7 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:23.606786 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85a2c3-d313-47d5-8895-0c20f593dd02 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:23.634036 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:23.648788 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892d326-0f81-4cf8-ae9d-ae9c4f59a9e7 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:23.670238 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:23.677464 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4d81d-97f8-4732-aaef-1a98a55417ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:23.678465 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4d81d-97f8-4732-aaef-1a98a55417ea None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:23.678836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4d81d-97f8-4732-aaef-1a98a55417ea None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:23.679171 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4d81d-97f8-4732-aaef-1a98a55417ea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:23.693194 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d4d81d-97f8-4732-aaef-1a98a55417ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:23.699106 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-69d4d81d-97f8-4732-aaef-1a98a55417ea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:43:23.699106 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:23.699106 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:23.699106 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:23.699106 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:23.699106 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:23.699106 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:23.699106 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:23.699106 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:23.699106 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:23.699106 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:23.699106 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:23.699106 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:23.699106 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:23.699106 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:23.699106 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:23.700121 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:23.700121 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:23.700121 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:23.700121 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:23.700121 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:23.700121 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:23.700121 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:23.700121 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:23.700121 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:23.700121 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:23.700121 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:23.700121 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:23.700121 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:23.700121 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:23.700121 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:23.700121 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:23.700887 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:23.700887 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:23.700887 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:23.700887 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:23.700887 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:23.700887 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:23.700887 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:23.700887 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:23.700887 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:23.700887 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:23.700887 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:43:23.700887 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:43:23.701753 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0775f-3dd8-4033-8e58-b76b6a496348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:23.701848 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 64/120] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 24 15:43:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:43:23.702106 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0775f-3dd8-4033-8e58-b76b6a496348 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:23.702605 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0775f-3dd8-4033-8e58-b76b6a496348 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:23.703096 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0775f-3dd8-4033-8e58-b76b6a496348 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:23.706968 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4d81d-97f8-4732-aaef-1a98a55417ea None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:23.793969 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0775f-3dd8-4033-8e58-b76b6a496348 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:23.795836 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0775f-3dd8-4033-8e58-b76b6a496348 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:23.832252 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4d81d-97f8-4732-aaef-1a98a55417ea None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:23.879593 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a00636-5aa6-4499-88a7-03cce68506db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:23.880155 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a00636-5aa6-4499-88a7-03cce68506db None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:23.880444 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a00636-5aa6-4499-88a7-03cce68506db None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:23.881799 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a00636-5aa6-4499-88a7-03cce68506db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:23.896097 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a00636-5aa6-4499-88a7-03cce68506db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:23.905021 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:23.909470 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-c8a00636-5aa6-4499-88a7-03cce68506db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:43:23.909470 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:23.909470 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:23.909470 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:23.909470 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:23.909470 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:23.909470 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:23.909470 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:23.909470 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:23.909470 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:23.909470 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:23.909470 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:23.909470 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:23.909470 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:23.909470 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:23.909470 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:23.910368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:23.910368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:23.910368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:23.910368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:23.910368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:23.910368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:23.910368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:23.910368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:23.910368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:23.910368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:23.910368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:23.910368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:23.910368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:23.910368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:23.910368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:23.910368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:23.911111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:23.911111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:23.911111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:23.911111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:23.911111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:23.911111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:23.911111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:23.911111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:23.911111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:23.911111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:23.911111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:43:23.911111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:43:23.917088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 65/122] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:43:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:43:23.917235 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 57/122] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:43:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 15:43:23.918090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0775f-3dd8-4033-8e58-b76b6a496348 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:23.919957 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a00636-5aa6-4499-88a7-03cce68506db None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:23.984009 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:24.034304 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0775f-3dd8-4033-8e58-b76b6a496348 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:24.036261 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a00636-5aa6-4499-88a7-03cce68506db None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:24.072132 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e60b3-3d98-4bd5-8e12-f20f0193bdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:24.072995 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e60b3-3d98-4bd5-8e12-f20f0193bdfb None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:24.073277 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e60b3-3d98-4bd5-8e12-f20f0193bdfb None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:24.073521 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5f2bc-3c59-4041-aad6-3c934dbeb3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:24.073696 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e60b3-3d98-4bd5-8e12-f20f0193bdfb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:24.074152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5f2bc-3c59-4041-aad6-3c934dbeb3d6 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:24.074438 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5f2bc-3c59-4041-aad6-3c934dbeb3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:24.074752 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5f2bc-3c59-4041-aad6-3c934dbeb3d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:24.075484 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5f2bc-3c59-4041-aad6-3c934dbeb3d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:24.075963 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5f2bc-3c59-4041-aad6-3c934dbeb3d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:24.077618 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5f2bc-3c59-4041-aad6-3c934dbeb3d6 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:24.084587 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e60b3-3d98-4bd5-8e12-f20f0193bdfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:24.087027 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 66/123] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:43:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:24.090450 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-3f8e60b3-3d98-4bd5-8e12-f20f0193bdfb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:43:24.090450 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:24.090450 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:24.090450 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:24.090450 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:24.090450 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:24.090450 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:24.090450 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:24.090450 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:24.090450 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:24.090450 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:24.090450 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:24.090450 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:24.090450 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:24.090450 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:24.090450 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:24.092886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:24.092886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:24.092886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:24.092886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:24.092886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:24.092886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:24.092886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:24.092886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:24.092886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:24.092886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:24.092886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:24.092886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:24.092886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:24.092886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:24.092886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:24.092886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:24.094391 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:24.094391 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:24.094391 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:24.094391 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:24.094391 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:24.094391 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:24.094391 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:24.094391 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:24.094391 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:24.094391 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:24.094391 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:43:24.094391 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:43:24.094391 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 58/124] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:43:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:43:24.095339 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5f2bc-3c59-4041-aad6-3c934dbeb3d6 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:24.095418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e60b3-3d98-4bd5-8e12-f20f0193bdfb None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:24.182554 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:24.231782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e60b3-3d98-4bd5-8e12-f20f0193bdfb None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:24.236409 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5f2bc-3c59-4041-aad6-3c934dbeb3d6 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:24.269006 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:24.276248 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f6b4a-baa2-444c-a0b2-56b9f88fe65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:24.277451 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f6b4a-baa2-444c-a0b2-56b9f88fe65e None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:24.277570 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71af7a2-b083-402a-9b7e-43e601b9e96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:24.278125 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f6b4a-baa2-444c-a0b2-56b9f88fe65e None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:24.278360 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71af7a2-b083-402a-9b7e-43e601b9e96a None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:24.278591 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f6b4a-baa2-444c-a0b2-56b9f88fe65e None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:24.278775 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71af7a2-b083-402a-9b7e-43e601b9e96a None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:24.279143 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71af7a2-b083-402a-9b7e-43e601b9e96a None admin] PATH_INFO: `/v3/projects/db70f99b67e1479f847c3ac324683445` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:24.282014 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f6b4a-baa2-444c-a0b2-56b9f88fe65e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:24.282014 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f6b4a-baa2-444c-a0b2-56b9f88fe65e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:24.282214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71af7a2-b083-402a-9b7e-43e601b9e96a None admin] RBAC: Authorizing `identity:get_project(project_id=db70f99b67e1479f847c3ac324683445)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:24.282295 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f6b4a-baa2-444c-a0b2-56b9f88fe65e None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:24.282372 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71af7a2-b083-402a-9b7e-43e601b9e96a None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:24.300782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 59/125] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:43:24 2022] GET /identity/v3/projects/db70f99b67e1479f847c3ac324683445 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:24.300782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71af7a2-b083-402a-9b7e-43e601b9e96a None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:24.300992 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 67/126] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:43:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:24.300992 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f6b4a-baa2-444c-a0b2-56b9f88fe65e None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:24.428854 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71af7a2-b083-402a-9b7e-43e601b9e96a None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:24.438671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f6b4a-baa2-444c-a0b2-56b9f88fe65e None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:24.459945 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:24.483792 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588c66d-5f78-4218-9fc4-1fbc2487ea01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:24.484692 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588c66d-5f78-4218-9fc4-1fbc2487ea01 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:24.485137 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588c66d-5f78-4218-9fc4-1fbc2487ea01 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:24.485544 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588c66d-5f78-4218-9fc4-1fbc2487ea01 None admin] PATH_INFO: `/v3/users/da731fa9396f47948c6cb3efa385c081` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:24.486610 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b792028-997e-4550-9de5-d8baa2a90436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:24.487006 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588c66d-5f78-4218-9fc4-1fbc2487ea01 None admin] RBAC: Authorizing `identity:get_user(user_id=da731fa9396f47948c6cb3efa385c081)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:24.487549 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b792028-997e-4550-9de5-d8baa2a90436 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:24.487987 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b792028-997e-4550-9de5-d8baa2a90436 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:24.488404 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b792028-997e-4550-9de5-d8baa2a90436 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:24.488886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588c66d-5f78-4218-9fc4-1fbc2487ea01 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:24.489422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b792028-997e-4550-9de5-d8baa2a90436 None admin] RBAC: Adding query filter params (name=member) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:24.489868 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b792028-997e-4550-9de5-d8baa2a90436 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:24.490718 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 60/127] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:24 2022] GET /identity/v3/users/da731fa9396f47948c6cb3efa385c081 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:24.491576 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588c66d-5f78-4218-9fc4-1fbc2487ea01 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:24.491688 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b792028-997e-4550-9de5-d8baa2a90436 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:24.503368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 68/128] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 24 15:43:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:24.504503 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b792028-997e-4550-9de5-d8baa2a90436 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:24.567060 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:24.635020 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b792028-997e-4550-9de5-d8baa2a90436 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:24.639718 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588c66d-5f78-4218-9fc4-1fbc2487ea01 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:24.679454 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a77a2-ce05-45ac-9ac0-ac6c17eec1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:24.680102 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a77a2-ce05-45ac-9ac0-ac6c17eec1f7 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:24.680405 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a77a2-ce05-45ac-9ac0-ac6c17eec1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:24.680823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a77a2-ce05-45ac-9ac0-ac6c17eec1f7 None admin] PATH_INFO: `/v3/users/f3bef6df7d3341a9829325d03a53cc71` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:24.681997 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a77a2-ce05-45ac-9ac0-ac6c17eec1f7 None admin] RBAC: Authorizing `identity:get_user(user_id=f3bef6df7d3341a9829325d03a53cc71)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:24.683456 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a77a2-ce05-45ac-9ac0-ac6c17eec1f7 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:24.685271 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 69/129] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:24 2022] GET /identity/v3/users/f3bef6df7d3341a9829325d03a53cc71 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:24.685885 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a77a2-ce05-45ac-9ac0-ac6c17eec1f7 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:24.691841 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a770f3-f25b-4c17-a28e-289a2a58e426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:24.692831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a770f3-f25b-4c17-a28e-289a2a58e426 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:24.693329 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a770f3-f25b-4c17-a28e-289a2a58e426 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:24.693802 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a770f3-f25b-4c17-a28e-289a2a58e426 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:24.694899 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a770f3-f25b-4c17-a28e-289a2a58e426 None admin] RBAC: Adding query filter params (role.id=961096b573de42c18dfca520e82b2030, scope.project.id=db70f99b67e1479f847c3ac324683445, user.id=4b0708e460424cab8ec1e9c9cb16c5c8) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:24.695979 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a770f3-f25b-4c17-a28e-289a2a58e426 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:24.698339 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a770f3-f25b-4c17-a28e-289a2a58e426 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:24.706152 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 61/130] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:43:24 2022] GET /identity/v3/role_assignments?user.id=4b0708e460424cab8ec1e9c9cb16c5c8&scope.project.id=db70f99b67e1479f847c3ac324683445&role.id=961096b573de42c18dfca520e82b2030 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:24.707336 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a770f3-f25b-4c17-a28e-289a2a58e426 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:24.778655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:24.836872 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a770f3-f25b-4c17-a28e-289a2a58e426 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:24.880756 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d281e3-96d8-40a1-b8a5-77af619f92ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:24.881797 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d281e3-96d8-40a1-b8a5-77af619f92ca None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:24.882283 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d281e3-96d8-40a1-b8a5-77af619f92ca None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:24.883533 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d281e3-96d8-40a1-b8a5-77af619f92ca None admin] PATH_INFO: `/v3/users/da731fa9396f47948c6cb3efa385c081` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:24.885668 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d281e3-96d8-40a1-b8a5-77af619f92ca None admin] RBAC: Authorizing `identity:get_user(user_id=da731fa9396f47948c6cb3efa385c081)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:24.887422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d281e3-96d8-40a1-b8a5-77af619f92ca None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:24.889891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 62/131] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:24 2022] GET /identity/v3/users/da731fa9396f47948c6cb3efa385c081 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:24.891062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d281e3-96d8-40a1-b8a5-77af619f92ca None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:24.942867 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a77a2-ce05-45ac-9ac0-ac6c17eec1f7 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:24.954212 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:24.997845 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329057d1-bfee-4f93-9304-166597d61c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:24.999545 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329057d1-bfee-4f93-9304-166597d61c6b None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:25.000114 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329057d1-bfee-4f93-9304-166597d61c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:25.000570 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329057d1-bfee-4f93-9304-166597d61c6b None admin] PATH_INFO: `/v3/projects/db70f99b67e1479f847c3ac324683445` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:25.002715 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329057d1-bfee-4f93-9304-166597d61c6b None admin] RBAC: Authorizing `identity:get_project(project_id=db70f99b67e1479f847c3ac324683445)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:25.004876 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329057d1-bfee-4f93-9304-166597d61c6b None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:25.008025 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 70/132] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:43:24 2022] GET /identity/v3/projects/db70f99b67e1479f847c3ac324683445 => generated 298 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:25.009149 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329057d1-bfee-4f93-9304-166597d61c6b None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:25.028291 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d281e3-96d8-40a1-b8a5-77af619f92ca None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:25.054941 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:25.069740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7dc64-7749-49b5-9b9c-75a51d57660a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:25.071053 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7dc64-7749-49b5-9b9c-75a51d57660a None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:25.071370 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7dc64-7749-49b5-9b9c-75a51d57660a None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:25.071645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7dc64-7749-49b5-9b9c-75a51d57660a None admin] PATH_INFO: `/v3/projects/db70f99b67e1479f847c3ac324683445` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:25.073093 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7dc64-7749-49b5-9b9c-75a51d57660a None admin] RBAC: Authorizing `identity:get_project(project_id=db70f99b67e1479f847c3ac324683445)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:25.074573 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7dc64-7749-49b5-9b9c-75a51d57660a None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:25.076296 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 63/133] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:43:24 2022] GET /identity/v3/projects/db70f99b67e1479f847c3ac324683445 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:25.082864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12426434-9016-40f8-af80-c245374d73f9 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:25.083154 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12426434-9016-40f8-af80-c245374d73f9 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:25.083435 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12426434-9016-40f8-af80-c245374d73f9 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:25.085325 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 64/134] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:25.090462 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12426434-9016-40f8-af80-c245374d73f9 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:25.154574 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329057d1-bfee-4f93-9304-166597d61c6b None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:25.197701 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585ac95-778f-4876-af11-e4d921cee130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:25.198375 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585ac95-778f-4876-af11-e4d921cee130 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:25.198586 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585ac95-778f-4876-af11-e4d921cee130 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:25.198950 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585ac95-778f-4876-af11-e4d921cee130 None admin] PATH_INFO: `/v3/projects/259c6598f8f0439d82deb036e6f053db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:25.200155 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585ac95-778f-4876-af11-e4d921cee130 None admin] RBAC: Authorizing `identity:get_project(project_id=259c6598f8f0439d82deb036e6f053db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:25.201719 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585ac95-778f-4876-af11-e4d921cee130 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:25.203446 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 71/135] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:43:25 2022] GET /identity/v3/projects/259c6598f8f0439d82deb036e6f053db => generated 312 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:25.204440 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585ac95-778f-4876-af11-e4d921cee130 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:25.219829 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12426434-9016-40f8-af80-c245374d73f9 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:25.259476 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f548c40-1167-4715-8b68-3ecef66d81a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:25.260517 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f548c40-1167-4715-8b68-3ecef66d81a1 None admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:25.261062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f548c40-1167-4715-8b68-3ecef66d81a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:25.262163 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f548c40-1167-4715-8b68-3ecef66d81a1 None admin] PATH_INFO: `/v3/projects/db70f99b67e1479f847c3ac324683445/users/da731fa9396f47948c6cb3efa385c081/roles/38df38770b21458d87720d3c4c6f1ff1` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:25.265115 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f548c40-1167-4715-8b68-3ecef66d81a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=db70f99b67e1479f847c3ac324683445, user_id=da731fa9396f47948c6cb3efa385c081, role_id=38df38770b21458d87720d3c4c6f1ff1)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:25.265936 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:25.268597 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f548c40-1167-4715-8b68-3ecef66d81a1 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:25.334567 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585ac95-778f-4876-af11-e4d921cee130 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:25.361831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 65/136] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 24 15:43:25 2022] PUT /identity/v3/projects/db70f99b67e1479f847c3ac324683445/users/da731fa9396f47948c6cb3efa385c081/roles/38df38770b21458d87720d3c4c6f1ff1 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:43:25.363452 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a78ca0-4e78-46eb-8888-0066cca15633 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:25.363913 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a78ca0-4e78-46eb-8888-0066cca15633 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:25.364424 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a78ca0-4e78-46eb-8888-0066cca15633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:25.387831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-21a78ca0-4e78-46eb-8888-0066cca15633 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:25.389738 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-21a78ca0-4e78-46eb-8888-0066cca15633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:25.404012 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976305fe-d8ff-45a7-896b-8ba15c79722b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:25.404824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976305fe-d8ff-45a7-896b-8ba15c79722b None admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:25.405111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976305fe-d8ff-45a7-896b-8ba15c79722b None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:25.405404 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976305fe-d8ff-45a7-896b-8ba15c79722b None admin] PATH_INFO: `/v3/projects/db70f99b67e1479f847c3ac324683445/users/f3bef6df7d3341a9829325d03a53cc71/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:25.411871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976305fe-d8ff-45a7-896b-8ba15c79722b None admin] RBAC: Authorizing `identity:create_grant(project_id=db70f99b67e1479f847c3ac324683445, user_id=f3bef6df7d3341a9829325d03a53cc71, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:25.413463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976305fe-d8ff-45a7-896b-8ba15c79722b None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:25.454128 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:25.480712 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 66/137] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:25.484941 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a78ca0-4e78-46eb-8888-0066cca15633 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:25.508278 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 72/138] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 24 15:43:25 2022] PUT /identity/v3/projects/db70f99b67e1479f847c3ac324683445/users/f3bef6df7d3341a9829325d03a53cc71/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:43:25.510089 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21458ff6-eac7-4845-bb73-9f57cf3ccf0a None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:25.510430 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21458ff6-eac7-4845-bb73-9f57cf3ccf0a None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:25.510727 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21458ff6-eac7-4845-bb73-9f57cf3ccf0a None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:25.512341 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 73/139] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:25.522784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc2268-a61d-48a3-9c36-bb7a8a6c50c2 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:25.523148 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc2268-a61d-48a3-9c36-bb7a8a6c50c2 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:25.524550 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc2268-a61d-48a3-9c36-bb7a8a6c50c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:25.572073 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-1edc2268-a61d-48a3-9c36-bb7a8a6c50c2 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:25.573777 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-1edc2268-a61d-48a3-9c36-bb7a8a6c50c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:25.617727 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a78ca0-4e78-46eb-8888-0066cca15633 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:25.668181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7dea00-d400-487f-a3db-03eeb4099376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:25.669204 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dea00-d400-487f-a3db-03eeb4099376 None admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:25.669768 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dea00-d400-487f-a3db-03eeb4099376 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:25.670212 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dea00-d400-487f-a3db-03eeb4099376 None admin] PATH_INFO: `/v3/projects/259c6598f8f0439d82deb036e6f053db/users/da731fa9396f47948c6cb3efa385c081/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:25.672512 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7dea00-d400-487f-a3db-03eeb4099376 None admin] RBAC: Authorizing `identity:create_grant(project_id=259c6598f8f0439d82deb036e6f053db, user_id=da731fa9396f47948c6cb3efa385c081, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:25.675677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7dea00-d400-487f-a3db-03eeb4099376 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:25.759871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 74/140] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:25.784540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 67/141] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 24 15:43:25 2022] PUT /identity/v3/projects/259c6598f8f0439d82deb036e6f053db/users/da731fa9396f47948c6cb3efa385c081/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:43:25.834998 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc2268-a61d-48a3-9c36-bb7a8a6c50c2 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:25.885519 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:25.981928 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc2268-a61d-48a3-9c36-bb7a8a6c50c2 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:26.029512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7516d-1bf5-42a7-a7fe-0dba5f6703fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:26.030091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7516d-1bf5-42a7-a7fe-0dba5f6703fa None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:26.030370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7516d-1bf5-42a7-a7fe-0dba5f6703fa None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:26.030642 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7516d-1bf5-42a7-a7fe-0dba5f6703fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:26.045903 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7516d-1bf5-42a7-a7fe-0dba5f6703fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:26.050737 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-45d7516d-1bf5-42a7-a7fe-0dba5f6703fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:43:26.050737 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:26.050737 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:26.050737 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:26.050737 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:26.050737 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:26.050737 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:26.050737 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:26.050737 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:26.050737 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:26.050737 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:26.050737 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:26.050737 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:26.050737 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:26.050737 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:26.050737 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:26.051580 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:26.051580 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:26.051580 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:26.051580 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:26.051580 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:26.051580 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:26.051580 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:26.051580 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:26.051580 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:26.051580 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:26.051580 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:26.051580 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:26.051580 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:26.051580 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:26.051580 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:26.051580 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:26.052331 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:26.052331 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:26.052331 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:26.052331 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:26.052331 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:26.052331 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:26.052331 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:26.052331 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:26.052331 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:26.052331 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:26.052331 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:43:26.052331 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:43:26.052331 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 75/142] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:43:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:43:26.060012 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7dea00-d400-487f-a3db-03eeb4099376 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:26.130094 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:26.145890 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7516d-1bf5-42a7-a7fe-0dba5f6703fa None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:26.249195 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7dea00-d400-487f-a3db-03eeb4099376 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:26.260028 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:26.277138 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7516d-1bf5-42a7-a7fe-0dba5f6703fa None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:26.349489 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b861d4-d4b0-47fd-82e5-89d061302173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:26.350137 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf11347-9911-4054-a7a1-9488fe25ad56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:26.350137 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf11347-9911-4054-a7a1-9488fe25ad56 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:26.350311 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b861d4-d4b0-47fd-82e5-89d061302173 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:26.350384 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf11347-9911-4054-a7a1-9488fe25ad56 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:26.350454 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b861d4-d4b0-47fd-82e5-89d061302173 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:26.350739 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf11347-9911-4054-a7a1-9488fe25ad56 None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:26.350839 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b861d4-d4b0-47fd-82e5-89d061302173 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:26.352088 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf11347-9911-4054-a7a1-9488fe25ad56 None admin] RBAC: Adding query filter params (name=member) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:26.352504 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf11347-9911-4054-a7a1-9488fe25ad56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:26.353096 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b861d4-d4b0-47fd-82e5-89d061302173 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:26.354001 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf11347-9911-4054-a7a1-9488fe25ad56 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:26.354566 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b861d4-d4b0-47fd-82e5-89d061302173 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:26.356186 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 76/143] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:43:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:43:26.365538 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b861d4-d4b0-47fd-82e5-89d061302173 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:26.370324 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 68/144] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 24 15:43:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:26.375922 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf11347-9911-4054-a7a1-9488fe25ad56 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:26.517112 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b861d4-d4b0-47fd-82e5-89d061302173 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:26.570297 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e554ba-83b8-407a-8e62-42a02ebc2de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:26.570740 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e554ba-83b8-407a-8e62-42a02ebc2de9 None admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:26.571005 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e554ba-83b8-407a-8e62-42a02ebc2de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:26.571258 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e554ba-83b8-407a-8e62-42a02ebc2de9 None admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:26.571937 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e554ba-83b8-407a-8e62-42a02ebc2de9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:26.573475 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e554ba-83b8-407a-8e62-42a02ebc2de9 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:26.593826 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf11347-9911-4054-a7a1-9488fe25ad56 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:26.600541 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:26.647743 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3236eac-7732-473c-887b-fe9c733f0d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:26.649001 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3236eac-7732-473c-887b-fe9c733f0d51 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:26.649282 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3236eac-7732-473c-887b-fe9c733f0d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:26.649589 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3236eac-7732-473c-887b-fe9c733f0d51 None admin] PATH_INFO: `/v3/users/da731fa9396f47948c6cb3efa385c081` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:26.650760 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3236eac-7732-473c-887b-fe9c733f0d51 None admin] RBAC: Authorizing `identity:get_user(user_id=da731fa9396f47948c6cb3efa385c081)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:26.652267 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3236eac-7732-473c-887b-fe9c733f0d51 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:26.653895 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 69/145] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:26 2022] GET /identity/v3/users/da731fa9396f47948c6cb3efa385c081 => generated 275 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:43:26.661605 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3236eac-7732-473c-887b-fe9c733f0d51 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:26.723497 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 77/146] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 24 15:43:26 2022] POST /identity/v3/users => generated 283 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:43:26.801922 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3236eac-7732-473c-887b-fe9c733f0d51 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:26.839307 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6e388-181e-494c-9be1-813a569172fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:26.839914 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6e388-181e-494c-9be1-813a569172fb None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:26.840204 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6e388-181e-494c-9be1-813a569172fb None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:26.840482 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6e388-181e-494c-9be1-813a569172fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:26.901061 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:26.916463 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde6e388-181e-494c-9be1-813a569172fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:26.918006 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde6e388-181e-494c-9be1-813a569172fb None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:27.035809 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 70/147] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:43:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:27.045775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e554ba-83b8-407a-8e62-42a02ebc2de9 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:27.074093 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:27.197754 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e554ba-83b8-407a-8e62-42a02ebc2de9 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:27.244036 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac04c7-ace7-411a-8a7e-c37b8b7df8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:27.244724 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac04c7-ace7-411a-8a7e-c37b8b7df8d8 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:27.245013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac04c7-ace7-411a-8a7e-c37b8b7df8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:27.245295 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac04c7-ace7-411a-8a7e-c37b8b7df8d8 None admin] PATH_INFO: `/v3/projects/db70f99b67e1479f847c3ac324683445` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:27.246514 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac04c7-ace7-411a-8a7e-c37b8b7df8d8 None admin] RBAC: Authorizing `identity:get_project(project_id=db70f99b67e1479f847c3ac324683445)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:27.248012 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac04c7-ace7-411a-8a7e-c37b8b7df8d8 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:27.249754 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 78/148] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:43:27 2022] GET /identity/v3/projects/db70f99b67e1479f847c3ac324683445 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:27.255865 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6e388-181e-494c-9be1-813a569172fb None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:27.395607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:27.405826 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e6190-14b6-4fdf-88ea-54aebc3040a6 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:27.417362 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e6190-14b6-4fdf-88ea-54aebc3040a6 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:27.417362 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e6190-14b6-4fdf-88ea-54aebc3040a6 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:27.417362 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 79/149] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:27.417362 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb4e2b-e700-4163-bea6-4197123192af None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:27.417362 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb4e2b-e700-4163-bea6-4197123192af None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:27.417362 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb4e2b-e700-4163-bea6-4197123192af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:27.426154 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6e388-181e-494c-9be1-813a569172fb None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:27.449590 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-f5bb4e2b-e700-4163-bea6-4197123192af None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:27.451193 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-f5bb4e2b-e700-4163-bea6-4197123192af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:27.470813 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9310d8-e8b1-4e21-94a2-85d918b41e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:27.473209 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9310d8-e8b1-4e21-94a2-85d918b41e26 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:27.473702 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9310d8-e8b1-4e21-94a2-85d918b41e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:27.474224 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9310d8-e8b1-4e21-94a2-85d918b41e26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:27.475853 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9310d8-e8b1-4e21-94a2-85d918b41e26 None admin] RBAC: Adding query filter params (role.id=0ea43d9dfb184e27b48d251fd38463db, scope.project.id=db70f99b67e1479f847c3ac324683445, user.id=da731fa9396f47948c6cb3efa385c081) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:27.476819 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9310d8-e8b1-4e21-94a2-85d918b41e26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:27.480071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9310d8-e8b1-4e21-94a2-85d918b41e26 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:27.494660 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 71/150] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:43:27 2022] GET /identity/v3/role_assignments?user.id=da731fa9396f47948c6cb3efa385c081&scope.project.id=db70f99b67e1479f847c3ac324683445&role.id=0ea43d9dfb184e27b48d251fd38463db => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:27.562549 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 80/151] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:43:27.966217 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9310d8-e8b1-4e21-94a2-85d918b41e26 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:28.086215 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9310d8-e8b1-4e21-94a2-85d918b41e26 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:28.137422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16500a70-f689-47d8-9615-5174de209bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:28.138089 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16500a70-f689-47d8-9615-5174de209bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:28.138370 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16500a70-f689-47d8-9615-5174de209bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:28.138756 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16500a70-f689-47d8-9615-5174de209bd4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:28.141982 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:28.152242 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16500a70-f689-47d8-9615-5174de209bd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:28.157238 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-16500a70-f689-47d8-9615-5174de209bd4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:43:28.157238 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:28.157238 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:28.157238 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:28.157238 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:28.157238 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:28.157238 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:28.157238 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:28.157238 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:28.157238 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:28.157238 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:28.157238 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:28.157238 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:28.157238 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:28.157238 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:28.157238 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:28.158401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:28.158401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:28.158401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:28.158401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:28.158401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:28.158401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:28.158401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:28.158401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:28.158401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:28.158401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:28.158401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:28.158401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:28.158401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:28.158401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:28.158401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:28.158401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:28.159159 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:28.159159 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:28.159159 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:28.159159 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:28.159159 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:28.159159 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:28.159159 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:28.159159 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:28.159159 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:28.159159 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:28.159159 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:43:28.159159 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:43:28.159159 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 72/152] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:43:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:43:28.168113 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb4e2b-e700-4163-bea6-4197123192af None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:28.198180 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:28.317289 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb4e2b-e700-4163-bea6-4197123192af None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:28.381345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9dd7f9-d489-4edf-9e40-71e18f6c317e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:28.381975 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dd7f9-d489-4edf-9e40-71e18f6c317e None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:28.382326 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dd7f9-d489-4edf-9e40-71e18f6c317e None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:28.382763 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dd7f9-d489-4edf-9e40-71e18f6c317e None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:28.383713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9dd7f9-d489-4edf-9e40-71e18f6c317e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:28.384025 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9dd7f9-d489-4edf-9e40-71e18f6c317e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:28.385578 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9dd7f9-d489-4edf-9e40-71e18f6c317e None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:28.394947 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 81/153] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 24 15:43:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:28.401854 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16500a70-f689-47d8-9615-5174de209bd4 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:28.550966 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16500a70-f689-47d8-9615-5174de209bd4 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:28.598230 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44780a-16bf-4c98-8b74-c99ef3ccd717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:28.598809 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44780a-16bf-4c98-8b74-c99ef3ccd717 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:28.599086 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44780a-16bf-4c98-8b74-c99ef3ccd717 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:28.599401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44780a-16bf-4c98-8b74-c99ef3ccd717 None admin] PATH_INFO: `/v3/users/4b0708e460424cab8ec1e9c9cb16c5c8` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:28.600578 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44780a-16bf-4c98-8b74-c99ef3ccd717 None admin] RBAC: Authorizing `identity:get_user(user_id=4b0708e460424cab8ec1e9c9cb16c5c8)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:28.602161 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44780a-16bf-4c98-8b74-c99ef3ccd717 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:28.604125 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 73/154] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:28 2022] GET /identity/v3/users/4b0708e460424cab8ec1e9c9cb16c5c8 => generated 289 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:28.609385 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9dd7f9-d489-4edf-9e40-71e18f6c317e None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:28.609875 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d1fa9-9824-406d-9cea-1a3ef59231fd None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:28.610086 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d1fa9-9824-406d-9cea-1a3ef59231fd None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:28.610359 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d1fa9-9824-406d-9cea-1a3ef59231fd None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:28.611817 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 74/155] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:43:28.617805 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63ca2b-fa2b-48d4-b2cc-85d0d5e9cb6e None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:28.618105 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63ca2b-fa2b-48d4-b2cc-85d0d5e9cb6e None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:28.618376 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63ca2b-fa2b-48d4-b2cc-85d0d5e9cb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:28.638091 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-cc63ca2b-fa2b-48d4-b2cc-85d0d5e9cb6e None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:28.639403 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-cc63ca2b-fa2b-48d4-b2cc-85d0d5e9cb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:28.724671 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:28.743587 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 75/156] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:28.745461 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e84ba-25e1-45f3-8023-33caa07c695d None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:28.745742 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e84ba-25e1-45f3-8023-33caa07c695d None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:28.746016 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e84ba-25e1-45f3-8023-33caa07c695d None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:28.747384 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 76/157] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:28.753113 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ac239-b35b-4495-bb73-55229a0fccc8 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:28.753389 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ac239-b35b-4495-bb73-55229a0fccc8 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:28.753658 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ac239-b35b-4495-bb73-55229a0fccc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:28.780083 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:28.792465 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-c10ac239-b35b-4495-bb73-55229a0fccc8 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:28.796596 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-c10ac239-b35b-4495-bb73-55229a0fccc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:28.826195 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9dd7f9-d489-4edf-9e40-71e18f6c317e None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:28.911099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a1b4b-2727-478d-b3b2-e5d0fda4b69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:28.911658 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a1b4b-2727-478d-b3b2-e5d0fda4b69e None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:28.911934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a1b4b-2727-478d-b3b2-e5d0fda4b69e None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:28.912202 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a1b4b-2727-478d-b3b2-e5d0fda4b69e None admin] PATH_INFO: `/v3/projects/db70f99b67e1479f847c3ac324683445` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:28.913396 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a1b4b-2727-478d-b3b2-e5d0fda4b69e None admin] RBAC: Authorizing `identity:get_project(project_id=db70f99b67e1479f847c3ac324683445)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:28.916526 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a1b4b-2727-478d-b3b2-e5d0fda4b69e None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:28.920794 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 82/158] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:43:28 2022] GET /identity/v3/projects/db70f99b67e1479f847c3ac324683445 => generated 298 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:28.925878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcc257-40fd-4613-a654-32e7871a65f4 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:28.926190 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcc257-40fd-4613-a654-32e7871a65f4 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:28.926461 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcc257-40fd-4613-a654-32e7871a65f4 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:28.928003 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 83/159] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:28.928565 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcc257-40fd-4613-a654-32e7871a65f4 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:28.951994 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 77/160] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:28.953319 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b59f8-4160-4916-ac19-7456fa58b9a6 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:28.953765 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b59f8-4160-4916-ac19-7456fa58b9a6 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:28.954045 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b59f8-4160-4916-ac19-7456fa58b9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:28.989198 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-3c5b59f8-4160-4916-ac19-7456fa58b9a6 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:28.990387 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-3c5b59f8-4160-4916-ac19-7456fa58b9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:29.134046 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 78/161] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:29.136421 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcc257-40fd-4613-a654-32e7871a65f4 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:29.202545 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b1be8-134f-42ce-a25a-041b9e53bfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:29.203211 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b1be8-134f-42ce-a25a-041b9e53bfc8 None admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:29.203491 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b1be8-134f-42ce-a25a-041b9e53bfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:29.203763 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b1be8-134f-42ce-a25a-041b9e53bfc8 None admin] PATH_INFO: `/v3/projects/db70f99b67e1479f847c3ac324683445/users/4b0708e460424cab8ec1e9c9cb16c5c8/roles/961096b573de42c18dfca520e82b2030` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:29.205726 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b1be8-134f-42ce-a25a-041b9e53bfc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=db70f99b67e1479f847c3ac324683445, user_id=4b0708e460424cab8ec1e9c9cb16c5c8, role_id=961096b573de42c18dfca520e82b2030)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:29.207228 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b1be8-134f-42ce-a25a-041b9e53bfc8 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:29.294822 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b59f8-4160-4916-ac19-7456fa58b9a6 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:29.306125 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 84/162] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 24 15:43:28 2022] PUT /identity/v3/projects/db70f99b67e1479f847c3ac324683445/users/4b0708e460424cab8ec1e9c9cb16c5c8/roles/961096b573de42c18dfca520e82b2030 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:43:29.375472 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:29.436376 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b59f8-4160-4916-ac19-7456fa58b9a6 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:29.486952 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e70ea-01f5-4579-b6b3-ed375ca850e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:29.487620 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e70ea-01f5-4579-b6b3-ed375ca850e6 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:29.487902 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e70ea-01f5-4579-b6b3-ed375ca850e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:29.488174 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e70ea-01f5-4579-b6b3-ed375ca850e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:29.509933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e70ea-01f5-4579-b6b3-ed375ca850e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:29.514898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-941e70ea-01f5-4579-b6b3-ed375ca850e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:43:29.514898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:29.514898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:29.514898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:29.514898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:29.514898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:29.514898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:29.514898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:29.514898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:29.514898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:29.514898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:29.514898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:29.514898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:29.514898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:29.514898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:29.514898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:29.515848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:29.515848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:29.515848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:29.515848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:29.515848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:29.515848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:29.515848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:29.515848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:29.515848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:29.515848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:29.515848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:29.515848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:29.515848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:29.515848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:29.515848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:29.515848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:29.516607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:29.516607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:29.516607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:29.516607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:29.516607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:29.516607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:29.516607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:29.516607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:29.516607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:29.516607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:29.516607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:43:29.516607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:43:29.516607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 79/163] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:43:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:43:29.524667 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b1be8-134f-42ce-a25a-041b9e53bfc8 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:29.535450 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:29.549717 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e70ea-01f5-4579-b6b3-ed375ca850e6 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:29.712159 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e70ea-01f5-4579-b6b3-ed375ca850e6 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:29.732648 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:29.743463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b1be8-134f-42ce-a25a-041b9e53bfc8 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:29.760175 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7488d-da79-44a7-9b52-fc96e34c21b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:29.760917 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7488d-da79-44a7-9b52-fc96e34c21b6 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:29.761798 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7488d-da79-44a7-9b52-fc96e34c21b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:29.762077 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7488d-da79-44a7-9b52-fc96e34c21b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:29.778624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7488d-da79-44a7-9b52-fc96e34c21b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:29.786193 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-8ea7488d-da79-44a7-9b52-fc96e34c21b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:43:29.786193 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:29.786193 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:29.786193 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:29.786193 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:29.786193 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:29.786193 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:29.786193 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:29.786193 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:29.786193 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:29.786193 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:29.786193 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:29.786193 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:29.786193 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:29.786193 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:29.786193 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:29.787135 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:29.787135 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:29.787135 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:29.787135 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:29.787135 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:29.787135 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:29.787135 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:29.787135 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:29.787135 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:29.787135 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:29.787135 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:29.787135 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:29.787135 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:29.787135 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:29.787135 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:29.787135 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:29.787890 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:29.787890 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:29.787890 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:29.787890 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:29.787890 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:29.787890 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:29.787890 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:29.787890 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:29.787890 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:29.787890 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:29.787890 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:43:29.787890 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:43:29.787890 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 80/164] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 24 15:43:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:43:29.789540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7488d-da79-44a7-9b52-fc96e34c21b6 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:29.796652 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5107fd-4fa4-43d9-bb5f-2988270c8404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:29.796652 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5107fd-4fa4-43d9-bb5f-2988270c8404 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:29.796652 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5107fd-4fa4-43d9-bb5f-2988270c8404 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:29.796652 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5107fd-4fa4-43d9-bb5f-2988270c8404 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:29.797449 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5107fd-4fa4-43d9-bb5f-2988270c8404 None admin] RBAC: Adding query filter params (name=member) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:29.797449 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5107fd-4fa4-43d9-bb5f-2988270c8404 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:29.797449 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5107fd-4fa4-43d9-bb5f-2988270c8404 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:29.816646 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 85/165] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 24 15:43:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:29.818788 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5107fd-4fa4-43d9-bb5f-2988270c8404 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:29.961451 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:30.016598 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7488d-da79-44a7-9b52-fc96e34c21b6 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:30.034730 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5107fd-4fa4-43d9-bb5f-2988270c8404 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:30.096602 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bc19d-6087-4202-8aec-4ec7ec8b0d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:30.097506 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bc19d-6087-4202-8aec-4ec7ec8b0d0b None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:30.097910 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bc19d-6087-4202-8aec-4ec7ec8b0d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:30.098304 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bc19d-6087-4202-8aec-4ec7ec8b0d0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:30.107160 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b7a25-a8fa-47a7-915f-77e3c2408be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:30.108221 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b7a25-a8fa-47a7-915f-77e3c2408be8 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:30.108745 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b7a25-a8fa-47a7-915f-77e3c2408be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:30.109577 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b7a25-a8fa-47a7-915f-77e3c2408be8 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:30.110504 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b7a25-a8fa-47a7-915f-77e3c2408be8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:30.111039 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b7a25-a8fa-47a7-915f-77e3c2408be8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:30.115704 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b7a25-a8fa-47a7-915f-77e3c2408be8 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:30.125478 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451bc19d-6087-4202-8aec-4ec7ec8b0d0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:30.130756 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-451bc19d-6087-4202-8aec-4ec7ec8b0d0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:43:30.130756 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:30.130756 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:30.130756 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:30.130756 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:30.130756 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:30.130756 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:30.130756 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:30.130756 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:30.130756 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:30.130756 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:30.130756 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:30.130756 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:30.130756 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:30.130756 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:30.130756 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:30.131690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:30.131690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:30.131690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:30.131690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:30.131690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:30.131690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:30.131690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:30.131690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:30.131690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:30.131690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:30.131690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:30.131690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:30.131690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:30.131690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:30.131690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:30.131690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:30.132526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:30.132526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:30.132526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:30.132526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:30.132526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:30.132526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:30.132526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:30.132526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:30.132526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:30.132526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:30.132526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:43:30.132526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:43:30.137464 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 81/166] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:43:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:43:30.138659 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bc19d-6087-4202-8aec-4ec7ec8b0d0b None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:30.148671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 86/167] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:43:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:30.150291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b7a25-a8fa-47a7-915f-77e3c2408be8 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:30.245753 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:30.350666 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b7a25-a8fa-47a7-915f-77e3c2408be8 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:30.405216 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:30.420771 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813905e-0332-4e34-8bd0-e7343184c45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:30.424163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813905e-0332-4e34-8bd0-e7343184c45c None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:30.424707 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813905e-0332-4e34-8bd0-e7343184c45c None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:30.425205 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813905e-0332-4e34-8bd0-e7343184c45c None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:30.426115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813905e-0332-4e34-8bd0-e7343184c45c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:30.426629 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813905e-0332-4e34-8bd0-e7343184c45c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:30.429226 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813905e-0332-4e34-8bd0-e7343184c45c None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:30.437999 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bc19d-6087-4202-8aec-4ec7ec8b0d0b None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:30.452994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 87/168] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:43:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:30.456114 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813905e-0332-4e34-8bd0-e7343184c45c None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:30.508372 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9068f1-7f46-4bdf-814d-c436eaff258e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:30.511162 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9068f1-7f46-4bdf-814d-c436eaff258e None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:30.511664 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9068f1-7f46-4bdf-814d-c436eaff258e None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:30.513356 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9068f1-7f46-4bdf-814d-c436eaff258e None admin] PATH_INFO: `/v3/users/da731fa9396f47948c6cb3efa385c081` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:30.515773 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9068f1-7f46-4bdf-814d-c436eaff258e None admin] RBAC: Authorizing `identity:get_user(user_id=da731fa9396f47948c6cb3efa385c081)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:30.519094 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9068f1-7f46-4bdf-814d-c436eaff258e None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:30.522020 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 82/169] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:30 2022] GET /identity/v3/users/da731fa9396f47948c6cb3efa385c081 => generated 275 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:30.526058 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9068f1-7f46-4bdf-814d-c436eaff258e None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:30.620982 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813905e-0332-4e34-8bd0-e7343184c45c None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:30.657901 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9592b31-d2fe-4d4f-bee0-c9d52d95e31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:30.659019 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9592b31-d2fe-4d4f-bee0-c9d52d95e31b None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:30.659517 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9592b31-d2fe-4d4f-bee0-c9d52d95e31b None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:30.659988 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9592b31-d2fe-4d4f-bee0-c9d52d95e31b None admin] PATH_INFO: `/v3/users/da731fa9396f47948c6cb3efa385c081` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:30.661393 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9592b31-d2fe-4d4f-bee0-c9d52d95e31b None admin] RBAC: Authorizing `identity:get_user(user_id=da731fa9396f47948c6cb3efa385c081)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:30.663186 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9592b31-d2fe-4d4f-bee0-c9d52d95e31b None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:30.665814 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 88/170] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:30 2022] GET /identity/v3/users/da731fa9396f47948c6cb3efa385c081 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:30.666988 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9592b31-d2fe-4d4f-bee0-c9d52d95e31b None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:30.734939 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:30.764090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9068f1-7f46-4bdf-814d-c436eaff258e None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:30.773527 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:30.824662 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9592b31-d2fe-4d4f-bee0-c9d52d95e31b None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:30.834667 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658f24a-c383-4035-86b2-6a4c97c9e847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:30.835869 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658f24a-c383-4035-86b2-6a4c97c9e847 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:30.836154 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658f24a-c383-4035-86b2-6a4c97c9e847 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:30.836427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658f24a-c383-4035-86b2-6a4c97c9e847 None admin] PATH_INFO: `/v3/users/f3bef6df7d3341a9829325d03a53cc71` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:30.837632 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658f24a-c383-4035-86b2-6a4c97c9e847 None admin] RBAC: Authorizing `identity:get_user(user_id=f3bef6df7d3341a9829325d03a53cc71)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:30.839103 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658f24a-c383-4035-86b2-6a4c97c9e847 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:30.840740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 83/171] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:30 2022] GET /identity/v3/users/f3bef6df7d3341a9829325d03a53cc71 => generated 247 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:30.845520 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56476dd9-0009-4c1e-b56d-a26d7681aae7 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:30.845805 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56476dd9-0009-4c1e-b56d-a26d7681aae7 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:30.846862 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56476dd9-0009-4c1e-b56d-a26d7681aae7 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:30.848243 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 84/172] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:30.849110 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56476dd9-0009-4c1e-b56d-a26d7681aae7 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:30.898905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3247b2-ea9e-4142-bb9e-33f8736b0867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:30.899963 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3247b2-ea9e-4142-bb9e-33f8736b0867 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:30.900456 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3247b2-ea9e-4142-bb9e-33f8736b0867 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:30.900947 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3247b2-ea9e-4142-bb9e-33f8736b0867 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:30.983405 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56476dd9-0009-4c1e-b56d-a26d7681aae7 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:31.040495 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3247b2-ea9e-4142-bb9e-33f8736b0867 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:31.042581 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3247b2-ea9e-4142-bb9e-33f8736b0867 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:31.066596 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216537f3-3278-4c17-b8ad-a7a7f96a0f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:31.067678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216537f3-3278-4c17-b8ad-a7a7f96a0f9f None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:31.068153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216537f3-3278-4c17-b8ad-a7a7f96a0f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:31.068660 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216537f3-3278-4c17-b8ad-a7a7f96a0f9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:31.158839 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:31.177602 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:31.202502 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216537f3-3278-4c17-b8ad-a7a7f96a0f9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:31.204595 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216537f3-3278-4c17-b8ad-a7a7f96a0f9f None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:31.272464 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 89/173] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:43:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:31.273955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3247b2-ea9e-4142-bb9e-33f8736b0867 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:31.338323 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 85/174] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:43:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:31.339800 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2919ca-05f3-48ed-9f61-62f7ca479e6a None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:31.340468 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2919ca-05f3-48ed-9f61-62f7ca479e6a None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:31.341281 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2919ca-05f3-48ed-9f61-62f7ca479e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:31.368455 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-aa2919ca-05f3-48ed-9f61-62f7ca479e6a None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:31.370260 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-aa2919ca-05f3-48ed-9f61-62f7ca479e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:31.472641 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:31.478750 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 86/175] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:31.485940 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2919ca-05f3-48ed-9f61-62f7ca479e6a None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:31.516614 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3247b2-ea9e-4142-bb9e-33f8736b0867 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:31.606245 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b8df7-08ef-491b-a7de-31e954b9b3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:31.606959 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b8df7-08ef-491b-a7de-31e954b9b3e3 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:31.607238 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b8df7-08ef-491b-a7de-31e954b9b3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:31.608155 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b8df7-08ef-491b-a7de-31e954b9b3e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:31.635163 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2919ca-05f3-48ed-9f61-62f7ca479e6a None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:31.653422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:31.672961 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47277d-9a18-4454-83e2-3d3df6598220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:31.673623 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47277d-9a18-4454-83e2-3d3df6598220 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:31.673908 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47277d-9a18-4454-83e2-3d3df6598220 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:31.674182 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47277d-9a18-4454-83e2-3d3df6598220 None admin] PATH_INFO: `/v3/projects/259c6598f8f0439d82deb036e6f053db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:31.675360 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47277d-9a18-4454-83e2-3d3df6598220 None admin] RBAC: Authorizing `identity:get_project(project_id=259c6598f8f0439d82deb036e6f053db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:31.676852 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47277d-9a18-4454-83e2-3d3df6598220 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:31.678846 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 87/176] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:43:31 2022] GET /identity/v3/projects/259c6598f8f0439d82deb036e6f053db => generated 312 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:31.680149 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47277d-9a18-4454-83e2-3d3df6598220 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:31.715063 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b8df7-08ef-491b-a7de-31e954b9b3e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:31.716717 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b8df7-08ef-491b-a7de-31e954b9b3e3 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:31.767858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:31.844074 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47277d-9a18-4454-83e2-3d3df6598220 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:31.865314 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 90/177] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:43:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:31.866725 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a2b19-2abc-47ac-956f-cbdca58129ec None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:31.867013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a2b19-2abc-47ac-956f-cbdca58129ec None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:31.867286 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a2b19-2abc-47ac-956f-cbdca58129ec None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:31.872859 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 91/178] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:31.872859 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d2cd4-c9f1-4049-83d5-50be7764330f None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:31.872859 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d2cd4-c9f1-4049-83d5-50be7764330f None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:31.872859 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d2cd4-c9f1-4049-83d5-50be7764330f None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:31.872859 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 92/179] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:31.872859 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d2cd4-c9f1-4049-83d5-50be7764330f None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:31.896222 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276074af-4796-47a8-b929-3693eaa00f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:31.896893 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276074af-4796-47a8-b929-3693eaa00f09 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:31.897212 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276074af-4796-47a8-b929-3693eaa00f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:31.897491 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276074af-4796-47a8-b929-3693eaa00f09 None admin] PATH_INFO: `/v3/projects/db70f99b67e1479f847c3ac324683445` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:31.899376 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276074af-4796-47a8-b929-3693eaa00f09 None admin] RBAC: Authorizing `identity:get_project(project_id=db70f99b67e1479f847c3ac324683445)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:31.900882 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276074af-4796-47a8-b929-3693eaa00f09 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:31.907357 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 88/180] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:43:31 2022] GET /identity/v3/projects/db70f99b67e1479f847c3ac324683445 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:31.907357 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276074af-4796-47a8-b929-3693eaa00f09 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:31.962909 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:32.015156 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d2cd4-c9f1-4049-83d5-50be7764330f None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:32.028790 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276074af-4796-47a8-b929-3693eaa00f09 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:32.063606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5e038-d15d-46ec-954e-1fea222d2e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:32.064496 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5e038-d15d-46ec-954e-1fea222d2e67 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:32.064957 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5e038-d15d-46ec-954e-1fea222d2e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:32.065367 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5e038-d15d-46ec-954e-1fea222d2e67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:32.066503 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5e038-d15d-46ec-954e-1fea222d2e67 None admin] RBAC: Adding query filter params (role.id=0ea43d9dfb184e27b48d251fd38463db, scope.project.id=259c6598f8f0439d82deb036e6f053db, user.id=da731fa9396f47948c6cb3efa385c081) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:32.066961 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5e038-d15d-46ec-954e-1fea222d2e67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:32.069260 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5e038-d15d-46ec-954e-1fea222d2e67 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:32.069364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b40b8a-9766-435e-8709-0c9aabf97918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:32.069958 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b40b8a-9766-435e-8709-0c9aabf97918 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:32.070229 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b40b8a-9766-435e-8709-0c9aabf97918 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:32.070686 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b40b8a-9766-435e-8709-0c9aabf97918 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:32.073936 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:32.088659 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 93/181] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:43:31 2022] GET /identity/v3/role_assignments?user.id=da731fa9396f47948c6cb3efa385c081&scope.project.id=259c6598f8f0439d82deb036e6f053db&role.id=0ea43d9dfb184e27b48d251fd38463db => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:32.088659 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5e038-d15d-46ec-954e-1fea222d2e67 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:32.095950 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b40b8a-9766-435e-8709-0c9aabf97918 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:32.102265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-37b40b8a-9766-435e-8709-0c9aabf97918 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:43:32.102265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:32.102265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:32.102265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:32.102265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:32.102265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:32.102265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:32.102265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:32.102265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:32.102265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:32.102265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:32.102265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:32.102265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:32.102265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:32.102265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:32.102265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:32.104848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:32.104848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:32.104848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:32.104848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:32.104848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:32.104848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:32.104848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:32.104848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:32.104848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:32.104848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:32.104848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:32.104848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:32.104848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:32.104848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:32.104848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:32.104848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:32.107255 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:32.107255 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:32.107255 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:32.107255 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:32.107255 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:32.107255 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:32.107255 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:32.107255 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:32.107255 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:32.107255 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:32.107255 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:43:32.107255 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:43:32.107255 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 89/182] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:43:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:43:32.107255 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6025342-bc3d-4ff2-b245-837bb9a4c37b None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:32.108037 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6025342-bc3d-4ff2-b245-837bb9a4c37b None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:32.108037 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6025342-bc3d-4ff2-b245-837bb9a4c37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:32.125295 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-e6025342-bc3d-4ff2-b245-837bb9a4c37b None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:32.126533 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e6025342-bc3d-4ff2-b245-837bb9a4c37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:32.224663 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 90/183] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:32.224663 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1ad6c-617b-42d4-8866-37f0d65d5047 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:32.224663 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1ad6c-617b-42d4-8866-37f0d65d5047 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:32.224663 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1ad6c-617b-42d4-8866-37f0d65d5047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:32.241702 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5e038-d15d-46ec-954e-1fea222d2e67 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:32.247076 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-f7f1ad6c-617b-42d4-8866-37f0d65d5047 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:32.248974 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-f7f1ad6c-617b-42d4-8866-37f0d65d5047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:32.272328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:32.297807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb202ee-a93f-46c0-bbbe-70d5ec78c55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:32.298967 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb202ee-a93f-46c0-bbbe-70d5ec78c55a None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:32.299453 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb202ee-a93f-46c0-bbbe-70d5ec78c55a None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:32.299924 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb202ee-a93f-46c0-bbbe-70d5ec78c55a None admin] PATH_INFO: `/v3/projects/db70f99b67e1479f847c3ac324683445` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:32.301406 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb202ee-a93f-46c0-bbbe-70d5ec78c55a None admin] RBAC: Authorizing `identity:get_project(project_id=db70f99b67e1479f847c3ac324683445)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:32.303199 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb202ee-a93f-46c0-bbbe-70d5ec78c55a None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:32.313059 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 94/184] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:43:32 2022] GET /identity/v3/projects/db70f99b67e1479f847c3ac324683445 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:32.313059 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb202ee-a93f-46c0-bbbe-70d5ec78c55a None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:32.358011 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 91/185] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:32.359662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39d424-d0e1-4045-84c0-420ea9342568 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:32.359947 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39d424-d0e1-4045-84c0-420ea9342568 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:32.360218 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39d424-d0e1-4045-84c0-420ea9342568 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:32.361720 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 92/186] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:32.362656 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39d424-d0e1-4045-84c0-420ea9342568 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:32.455590 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:32.471582 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb202ee-a93f-46c0-bbbe-70d5ec78c55a None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:32.513279 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5859f-108a-4d65-b6a3-24487c6d03fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:32.513903 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5859f-108a-4d65-b6a3-24487c6d03fe None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:32.514186 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5859f-108a-4d65-b6a3-24487c6d03fe None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:32.514458 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5859f-108a-4d65-b6a3-24487c6d03fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:32.515206 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5859f-108a-4d65-b6a3-24487c6d03fe None admin] RBAC: Adding query filter params (role.id=38df38770b21458d87720d3c4c6f1ff1, scope.project.id=db70f99b67e1479f847c3ac324683445, user.id=da731fa9396f47948c6cb3efa385c081) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:32.515520 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5859f-108a-4d65-b6a3-24487c6d03fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:32.517115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5859f-108a-4d65-b6a3-24487c6d03fe None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:32.528675 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 95/187] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:43:32 2022] GET /identity/v3/role_assignments?user.id=da731fa9396f47948c6cb3efa385c081&scope.project.id=db70f99b67e1479f847c3ac324683445&role.id=38df38770b21458d87720d3c4c6f1ff1 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:32.528675 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5859f-108a-4d65-b6a3-24487c6d03fe None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:32.534641 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39d424-d0e1-4045-84c0-420ea9342568 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:32.584319 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc8cab-fcdb-4dcd-b6c2-16572ac9290b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:32.584932 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc8cab-fcdb-4dcd-b6c2-16572ac9290b None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:32.585272 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc8cab-fcdb-4dcd-b6c2-16572ac9290b None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:32.585654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc8cab-fcdb-4dcd-b6c2-16572ac9290b None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:32.587427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc8cab-fcdb-4dcd-b6c2-16572ac9290b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:32.587427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc8cab-fcdb-4dcd-b6c2-16572ac9290b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:32.588400 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc8cab-fcdb-4dcd-b6c2-16572ac9290b None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:32.598572 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 93/188] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:43:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:32.599865 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657b6cf-a71f-4180-a09c-0618202708a5 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:32.600159 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657b6cf-a71f-4180-a09c-0618202708a5 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:32.600438 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657b6cf-a71f-4180-a09c-0618202708a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:32.617832 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:32.621676 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-7657b6cf-a71f-4180-a09c-0618202708a5 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:32.623034 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-7657b6cf-a71f-4180-a09c-0618202708a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:32.680459 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5859f-108a-4d65-b6a3-24487c6d03fe None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:32.717057 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 94/189] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:32.718498 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657b6cf-a71f-4180-a09c-0618202708a5 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:32.742453 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33408545-14f9-46fe-b7a4-b4d1acc76066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:32.743373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33408545-14f9-46fe-b7a4-b4d1acc76066 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:32.743820 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33408545-14f9-46fe-b7a4-b4d1acc76066 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:32.744248 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33408545-14f9-46fe-b7a4-b4d1acc76066 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:32.745847 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33408545-14f9-46fe-b7a4-b4d1acc76066 None admin] RBAC: Adding query filter params (role.id=c6745e08f9da4a2bae8510c9983635c3, scope.project.id=db70f99b67e1479f847c3ac324683445, user.id=f3bef6df7d3341a9829325d03a53cc71) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:32.746014 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33408545-14f9-46fe-b7a4-b4d1acc76066 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:32.748232 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33408545-14f9-46fe-b7a4-b4d1acc76066 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:32.759050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 96/190] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:43:32 2022] GET /identity/v3/role_assignments?user.id=f3bef6df7d3341a9829325d03a53cc71&scope.project.id=db70f99b67e1479f847c3ac324683445&role.id=c6745e08f9da4a2bae8510c9983635c3 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:32.760671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33408545-14f9-46fe-b7a4-b4d1acc76066 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:32.796013 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:32.874138 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657b6cf-a71f-4180-a09c-0618202708a5 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:32.896157 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33408545-14f9-46fe-b7a4-b4d1acc76066 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:32.920042 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beaf7d7-ee2b-4d1e-a05e-9df32bc1cfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:32.921244 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beaf7d7-ee2b-4d1e-a05e-9df32bc1cfd6 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:32.921727 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beaf7d7-ee2b-4d1e-a05e-9df32bc1cfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:32.922213 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beaf7d7-ee2b-4d1e-a05e-9df32bc1cfd6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:32.924439 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beaf7d7-ee2b-4d1e-a05e-9df32bc1cfd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:32.926887 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beaf7d7-ee2b-4d1e-a05e-9df32bc1cfd6 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:32.931046 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 95/191] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:43:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:32.931994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:32.932897 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beaf7d7-ee2b-4d1e-a05e-9df32bc1cfd6 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:32.946548 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317df32-e899-428c-8f98-3bcd34e6a14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:32.947211 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317df32-e899-428c-8f98-3bcd34e6a14a None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:32.947493 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317df32-e899-428c-8f98-3bcd34e6a14a None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:32.953183 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317df32-e899-428c-8f98-3bcd34e6a14a None admin] PATH_INFO: `/v3/users/6d0af1279acd4fe6bfca23f4ea06d5f8` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:32.967703 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317df32-e899-428c-8f98-3bcd34e6a14a None admin] RBAC: Authorizing `identity:get_user(user_id=6d0af1279acd4fe6bfca23f4ea06d5f8)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:32.969226 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317df32-e899-428c-8f98-3bcd34e6a14a None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:32.971117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 97/192] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:32 2022] GET /identity/v3/users/6d0af1279acd4fe6bfca23f4ea06d5f8 => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:32.973364 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317df32-e899-428c-8f98-3bcd34e6a14a None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:33.095305 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beaf7d7-ee2b-4d1e-a05e-9df32bc1cfd6 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:33.114124 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:33.115943 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317df32-e899-428c-8f98-3bcd34e6a14a None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:33.132823 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499d093-cf56-4aa7-8e7e-d48d528085f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:33.133355 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499d093-cf56-4aa7-8e7e-d48d528085f7 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:33.133633 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499d093-cf56-4aa7-8e7e-d48d528085f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:33.133901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499d093-cf56-4aa7-8e7e-d48d528085f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:33.144886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499d093-cf56-4aa7-8e7e-d48d528085f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:33.149811 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-2499d093-cf56-4aa7-8e7e-d48d528085f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:43:33.149811 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:33.149811 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:33.149811 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:33.149811 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:33.149811 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:33.149811 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:33.149811 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:33.149811 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:33.149811 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:33.149811 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:33.149811 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:33.149811 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:33.149811 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:33.149811 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:33.149811 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:33.150740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:33.150740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:33.150740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:33.150740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:33.150740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:33.150740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:33.150740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:33.150740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:33.150740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:33.150740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:33.150740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:33.150740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:33.150740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:33.150740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:33.150740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:33.150740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:33.151518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:33.151518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:33.151518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:33.151518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:33.151518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:33.151518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:33.151518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:33.151518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:33.151518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:33.151518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:33.151518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:43:33.151518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:43:33.152106 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 96/193] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 24 15:43:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:43:33.153119 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499d093-cf56-4aa7-8e7e-d48d528085f7 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:33.157359 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffefb43-2456-45b5-82fd-29232fbfa263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:33.158524 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffefb43-2456-45b5-82fd-29232fbfa263 None admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:33.158930 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffefb43-2456-45b5-82fd-29232fbfa263 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:33.159335 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffefb43-2456-45b5-82fd-29232fbfa263 None admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:33.160310 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffefb43-2456-45b5-82fd-29232fbfa263 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:33.162540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffefb43-2456-45b5-82fd-29232fbfa263 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:33.260008 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 98/194] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 24 15:43:32 2022] POST /identity/v3/users => generated 297 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:43:33.260870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffefb43-2456-45b5-82fd-29232fbfa263 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:33.298217 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499d093-cf56-4aa7-8e7e-d48d528085f7 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:33.326792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:33.345590 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede1230-b03a-4f7d-8d2f-08e7a1053e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:33.346577 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede1230-b03a-4f7d-8d2f-08e7a1053e30 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:33.347032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede1230-b03a-4f7d-8d2f-08e7a1053e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:33.347430 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede1230-b03a-4f7d-8d2f-08e7a1053e30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:33.412456 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffefb43-2456-45b5-82fd-29232fbfa263 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:33.414743 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:33.447046 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede1230-b03a-4f7d-8d2f-08e7a1053e30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:33.449281 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede1230-b03a-4f7d-8d2f-08e7a1053e30 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:33.457554 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf19e66-8817-4dee-a68c-cebe188d7c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:33.458215 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf19e66-8817-4dee-a68c-cebe188d7c74 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:33.458499 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf19e66-8817-4dee-a68c-cebe188d7c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:33.458775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf19e66-8817-4dee-a68c-cebe188d7c74 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:33.472877 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf19e66-8817-4dee-a68c-cebe188d7c74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:33.480188 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-3bf19e66-8817-4dee-a68c-cebe188d7c74 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:43:33.480188 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:33.480188 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:33.480188 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:33.480188 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:33.480188 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:33.480188 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:33.480188 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:33.480188 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:33.480188 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:33.480188 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:33.480188 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:33.480188 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:33.480188 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:33.480188 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:33.480188 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:33.481146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:33.481146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:33.481146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:33.481146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:33.481146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:33.481146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:33.481146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:33.481146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:33.481146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:33.481146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:33.481146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:33.481146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:33.481146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:33.481146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:33.481146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:33.481146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:33.481994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:33.481994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:33.481994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:33.481994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:33.481994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:33.481994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:33.481994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:33.481994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:33.481994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:33.481994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:33.481994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:43:33.481994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:43:33.481994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 99/195] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:43:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:43:33.482635 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf19e66-8817-4dee-a68c-cebe188d7c74 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:33.590651 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 97/196] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:43:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:33.591536 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede1230-b03a-4f7d-8d2f-08e7a1053e30 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:33.612159 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:33.620596 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf19e66-8817-4dee-a68c-cebe188d7c74 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:33.670409 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60c810-1d27-4498-9294-01e1cb46652d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:33.670409 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60c810-1d27-4498-9294-01e1cb46652d None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:33.670670 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60c810-1d27-4498-9294-01e1cb46652d None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:33.670964 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60c810-1d27-4498-9294-01e1cb46652d None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:33.671722 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60c810-1d27-4498-9294-01e1cb46652d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:33.672890 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60c810-1d27-4498-9294-01e1cb46652d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:33.675538 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60c810-1d27-4498-9294-01e1cb46652d None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:33.691536 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 100/197] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:43:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:33.691536 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60c810-1d27-4498-9294-01e1cb46652d None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:33.699953 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:33.723030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede1230-b03a-4f7d-8d2f-08e7a1053e30 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:33.764032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9d26d-4506-4b5c-8d9a-b5020a820530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:33.764671 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9d26d-4506-4b5c-8d9a-b5020a820530 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:33.764954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9d26d-4506-4b5c-8d9a-b5020a820530 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:33.765229 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9d26d-4506-4b5c-8d9a-b5020a820530 None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:33.765904 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9d26d-4506-4b5c-8d9a-b5020a820530 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:33.766232 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9d26d-4506-4b5c-8d9a-b5020a820530 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:33.767619 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9d26d-4506-4b5c-8d9a-b5020a820530 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:33.783647 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 98/198] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 24 15:43:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:33.783647 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9d26d-4506-4b5c-8d9a-b5020a820530 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:33.855520 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60c810-1d27-4498-9294-01e1cb46652d None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:33.906789 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120d837-e479-450b-a6ce-6d399fbf1c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:33.907422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120d837-e479-450b-a6ce-6d399fbf1c4d None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:33.912702 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120d837-e479-450b-a6ce-6d399fbf1c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:33.912702 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120d837-e479-450b-a6ce-6d399fbf1c4d None admin] PATH_INFO: `/v3/projects/b533b81163ef4776a421230d7bc3e77c` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:33.912928 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9d26d-4506-4b5c-8d9a-b5020a820530 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:33.913025 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120d837-e479-450b-a6ce-6d399fbf1c4d None admin] RBAC: Authorizing `identity:get_project(project_id=b533b81163ef4776a421230d7bc3e77c)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:33.913025 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120d837-e479-450b-a6ce-6d399fbf1c4d None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:33.914182 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 101/199] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:43:33 2022] GET /identity/v3/projects/b533b81163ef4776a421230d7bc3e77c => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:33.915075 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120d837-e479-450b-a6ce-6d399fbf1c4d None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:33.942500 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:33.959845 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349852aa-f3e9-4f4b-a206-5f245b916646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:33.961160 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349852aa-f3e9-4f4b-a206-5f245b916646 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:33.961445 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349852aa-f3e9-4f4b-a206-5f245b916646 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:33.962629 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349852aa-f3e9-4f4b-a206-5f245b916646 None admin] PATH_INFO: `/v3/users/6d0af1279acd4fe6bfca23f4ea06d5f8` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:33.963332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349852aa-f3e9-4f4b-a206-5f245b916646 None admin] RBAC: Authorizing `identity:get_user(user_id=6d0af1279acd4fe6bfca23f4ea06d5f8)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:33.965040 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349852aa-f3e9-4f4b-a206-5f245b916646 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:33.966774 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 99/200] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:33 2022] GET /identity/v3/users/6d0af1279acd4fe6bfca23f4ea06d5f8 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:33.973116 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349852aa-f3e9-4f4b-a206-5f245b916646 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:33.985336 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:34.044734 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120d837-e479-450b-a6ce-6d399fbf1c4d None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:34.083888 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65cdf7-76c7-43f6-a137-05299f889e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:34.085377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65cdf7-76c7-43f6-a137-05299f889e96 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:34.086013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65cdf7-76c7-43f6-a137-05299f889e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:34.086472 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65cdf7-76c7-43f6-a137-05299f889e96 None admin] PATH_INFO: `/v3/users/4b0708e460424cab8ec1e9c9cb16c5c8` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:34.087893 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65cdf7-76c7-43f6-a137-05299f889e96 None admin] RBAC: Authorizing `identity:get_user(user_id=4b0708e460424cab8ec1e9c9cb16c5c8)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:34.089780 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65cdf7-76c7-43f6-a137-05299f889e96 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:34.091932 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 102/201] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:33 2022] GET /identity/v3/users/4b0708e460424cab8ec1e9c9cb16c5c8 => generated 289 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:34.093104 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65cdf7-76c7-43f6-a137-05299f889e96 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:34.111446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349852aa-f3e9-4f4b-a206-5f245b916646 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:34.156974 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8906cd2-59cd-48f3-942e-ad2ba9c531e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:34.157849 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8906cd2-59cd-48f3-942e-ad2ba9c531e5 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:34.158123 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8906cd2-59cd-48f3-942e-ad2ba9c531e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:34.158410 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8906cd2-59cd-48f3-942e-ad2ba9c531e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:34.159429 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8906cd2-59cd-48f3-942e-ad2ba9c531e5 None admin] RBAC: Adding query filter params (role.id=c6745e08f9da4a2bae8510c9983635c3, scope.project.id=b533b81163ef4776a421230d7bc3e77c, user.id=6d0af1279acd4fe6bfca23f4ea06d5f8) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:34.159743 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8906cd2-59cd-48f3-942e-ad2ba9c531e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:34.161800 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8906cd2-59cd-48f3-942e-ad2ba9c531e5 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:34.170037 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 100/202] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:43:33 2022] GET /identity/v3/role_assignments?user.id=6d0af1279acd4fe6bfca23f4ea06d5f8&scope.project.id=b533b81163ef4776a421230d7bc3e77c&role.id=c6745e08f9da4a2bae8510c9983635c3 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:34.171032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8906cd2-59cd-48f3-942e-ad2ba9c531e5 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:34.282300 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:34.299904 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:34.318714 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65cdf7-76c7-43f6-a137-05299f889e96 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:34.344077 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8906cd2-59cd-48f3-942e-ad2ba9c531e5 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:34.379121 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45124b67-df4d-42be-9068-13f37308130a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:34.380077 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45124b67-df4d-42be-9068-13f37308130a None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:34.380363 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45124b67-df4d-42be-9068-13f37308130a None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:34.380662 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45124b67-df4d-42be-9068-13f37308130a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:34.437425 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf2260-8fa5-49c1-9280-d4078f100ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:34.438063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf2260-8fa5-49c1-9280-d4078f100ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:34.438350 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf2260-8fa5-49c1-9280-d4078f100ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:34.438630 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf2260-8fa5-49c1-9280-d4078f100ff1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:34.469577 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45124b67-df4d-42be-9068-13f37308130a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:34.471159 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45124b67-df4d-42be-9068-13f37308130a None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:34.595142 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:34.613926 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 103/203] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:43:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:34.621368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45124b67-df4d-42be-9068-13f37308130a None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:34.702453 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf2260-8fa5-49c1-9280-d4078f100ff1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:34.705155 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf2260-8fa5-49c1-9280-d4078f100ff1 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:34.739967 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45124b67-df4d-42be-9068-13f37308130a None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:34.780948 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d2ab6-d540-4d55-9ba5-70f014f4edb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:34.781847 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d2ab6-d540-4d55-9ba5-70f014f4edb9 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:34.782278 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d2ab6-d540-4d55-9ba5-70f014f4edb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:34.782944 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d2ab6-d540-4d55-9ba5-70f014f4edb9 None admin] PATH_INFO: `/v3/projects/b533b81163ef4776a421230d7bc3e77c` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:34.784306 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d2ab6-d540-4d55-9ba5-70f014f4edb9 None admin] RBAC: Authorizing `identity:get_project(project_id=b533b81163ef4776a421230d7bc3e77c)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:34.786020 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d2ab6-d540-4d55-9ba5-70f014f4edb9 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:34.789327 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 104/204] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:43:34 2022] GET /identity/v3/projects/b533b81163ef4776a421230d7bc3e77c => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:34.795688 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d2ab6-d540-4d55-9ba5-70f014f4edb9 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:34.870237 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:34.910002 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d2ab6-d540-4d55-9ba5-70f014f4edb9 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:34.952860 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ff5d4-9fd5-4d29-8691-d73d6244fac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:34.954424 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ff5d4-9fd5-4d29-8691-d73d6244fac6 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:34.954929 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ff5d4-9fd5-4d29-8691-d73d6244fac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:34.955402 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ff5d4-9fd5-4d29-8691-d73d6244fac6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:34.956346 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ff5d4-9fd5-4d29-8691-d73d6244fac6 None admin] RBAC: Adding query filter params (role.id=38df38770b21458d87720d3c4c6f1ff1, scope.project.id=b533b81163ef4776a421230d7bc3e77c, user.id=6d0af1279acd4fe6bfca23f4ea06d5f8) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:34.956911 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ff5d4-9fd5-4d29-8691-d73d6244fac6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:34.959033 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ff5d4-9fd5-4d29-8691-d73d6244fac6 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:34.971743 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 105/205] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:43:34 2022] GET /identity/v3/role_assignments?user.id=6d0af1279acd4fe6bfca23f4ea06d5f8&scope.project.id=b533b81163ef4776a421230d7bc3e77c&role.id=38df38770b21458d87720d3c4c6f1ff1 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:34.986934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:35.068085 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 101/206] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:43:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 897 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:35.074757 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ff5d4-9fd5-4d29-8691-d73d6244fac6 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:35.246882 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ff5d4-9fd5-4d29-8691-d73d6244fac6 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:35.275625 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:35.293682 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5f2c2-6112-4221-8cc7-a266eadddba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:35.294663 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5f2c2-6112-4221-8cc7-a266eadddba4 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:35.304947 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5f2c2-6112-4221-8cc7-a266eadddba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:35.304947 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5f2c2-6112-4221-8cc7-a266eadddba4 None admin] PATH_INFO: `/v3/projects/db70f99b67e1479f847c3ac324683445` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:35.304947 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5f2c2-6112-4221-8cc7-a266eadddba4 None admin] RBAC: Authorizing `identity:get_project(project_id=db70f99b67e1479f847c3ac324683445)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:35.304947 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5f2c2-6112-4221-8cc7-a266eadddba4 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:35.304947 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 106/207] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:43:35 2022] GET /identity/v3/projects/db70f99b67e1479f847c3ac324683445 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:35.309841 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf2260-8fa5-49c1-9280-d4078f100ff1 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:35.458921 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf2260-8fa5-49c1-9280-d4078f100ff1 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:35.519034 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80f345-b492-4427-89fb-ca025220009d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:35.519574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80f345-b492-4427-89fb-ca025220009d None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:35.519857 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80f345-b492-4427-89fb-ca025220009d None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:35.520134 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80f345-b492-4427-89fb-ca025220009d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:35.520901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80f345-b492-4427-89fb-ca025220009d None admin] RBAC: Adding query filter params (role.id=961096b573de42c18dfca520e82b2030, scope.project.id=db70f99b67e1479f847c3ac324683445, user.id=4b0708e460424cab8ec1e9c9cb16c5c8) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:35.521215 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80f345-b492-4427-89fb-ca025220009d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:35.523211 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80f345-b492-4427-89fb-ca025220009d None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:35.533522 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 102/208] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:43:35 2022] GET /identity/v3/role_assignments?user.id=4b0708e460424cab8ec1e9c9cb16c5c8&scope.project.id=db70f99b67e1479f847c3ac324683445&role.id=961096b573de42c18dfca520e82b2030 => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:35.735274 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a25f3-cd80-4f51-b18c-1164a5b428ad None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:35.735274 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a25f3-cd80-4f51-b18c-1164a5b428ad None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:35.735274 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a25f3-cd80-4f51-b18c-1164a5b428ad None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:35.735274 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 107/209] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:35.742291 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65942cb-a77d-42f5-9d2c-375732cbe8bd None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:35.743251 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65942cb-a77d-42f5-9d2c-375732cbe8bd None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:35.743730 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65942cb-a77d-42f5-9d2c-375732cbe8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:35.748487 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290af593-9bb3-488e-acf2-44aa28c7b7f5 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:35.748819 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290af593-9bb3-488e-acf2-44aa28c7b7f5 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:35.749096 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290af593-9bb3-488e-acf2-44aa28c7b7f5 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:35.750761 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 108/210] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:35.757786 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9b179-9c3a-44bf-a578-5ced98d2991f None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:35.758078 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9b179-9c3a-44bf-a578-5ced98d2991f None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:35.758331 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9b179-9c3a-44bf-a578-5ced98d2991f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:35.800597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-38a9b179-9c3a-44bf-a578-5ced98d2991f None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:35.801021 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-e65942cb-a77d-42f5-9d2c-375732cbe8bd None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:35.801814 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-38a9b179-9c3a-44bf-a578-5ced98d2991f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:35.804272 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e65942cb-a77d-42f5-9d2c-375732cbe8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:35.857198 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:35.893502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 109/211] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:43:35.952369 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 103/212] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:43:36.255660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9b179-9c3a-44bf-a578-5ced98d2991f None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:36.348961 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65942cb-a77d-42f5-9d2c-375732cbe8bd None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:36.369004 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9b179-9c3a-44bf-a578-5ced98d2991f None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:36.392135 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:36.411194 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e7394-b530-4d33-a09d-73445ea926ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:36.411959 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e7394-b530-4d33-a09d-73445ea926ae None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:36.412241 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e7394-b530-4d33-a09d-73445ea926ae None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:36.412515 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e7394-b530-4d33-a09d-73445ea926ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:36.413815 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e7394-b530-4d33-a09d-73445ea926ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:36.415546 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e7394-b530-4d33-a09d-73445ea926ae None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:36.417701 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 110/213] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:43:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:43:36.423775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e7394-b530-4d33-a09d-73445ea926ae None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:36.526228 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65942cb-a77d-42f5-9d2c-375732cbe8bd None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:36.547943 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e7394-b530-4d33-a09d-73445ea926ae None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:36.567798 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56b115-1cbd-450f-afdb-3c749ece7345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:36.568445 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56b115-1cbd-450f-afdb-3c749ece7345 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:36.568783 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56b115-1cbd-450f-afdb-3c749ece7345 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:36.569059 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56b115-1cbd-450f-afdb-3c749ece7345 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:36.582443 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56b115-1cbd-450f-afdb-3c749ece7345 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:36.588066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-1d56b115-1cbd-450f-afdb-3c749ece7345 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:43:36.588066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:36.588066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:36.588066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:36.588066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:36.588066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:36.588066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:36.588066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:36.588066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:36.588066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:36.588066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:36.588066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:36.588066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:36.588066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:36.588066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:36.588066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:36.589026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:36.589026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:36.589026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:36.589026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:36.589026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:36.589026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:36.589026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:36.589026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:36.589026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:36.589026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:36.589026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:36.589026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:36.589026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:36.589026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:36.589026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:36.589026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:36.589807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:36.589807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:36.589807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:36.589807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:36.589807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:36.589807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:36.589807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:36.589807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:36.589807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:36.589807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:36.589807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:43:36.589807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:43:36.589807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 104/214] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:43:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:43:36.596156 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56b115-1cbd-450f-afdb-3c749ece7345 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:36.602425 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5837153-09b7-414b-921a-2816b6c59ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:36.603824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5837153-09b7-414b-921a-2816b6c59ba2 None admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:36.603824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5837153-09b7-414b-921a-2816b6c59ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:36.603824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5837153-09b7-414b-921a-2816b6c59ba2 None admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:36.604251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5837153-09b7-414b-921a-2816b6c59ba2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:36.605769 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5837153-09b7-414b-921a-2816b6c59ba2 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:36.629631 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:36.719988 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 111/215] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 24 15:43:36 2022] POST /identity/v3/users => generated 297 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:43:36.736227 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56b115-1cbd-450f-afdb-3c749ece7345 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:36.786728 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc7202-781b-4cff-9254-7221d8283062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:36.787718 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc7202-781b-4cff-9254-7221d8283062 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:36.787718 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc7202-781b-4cff-9254-7221d8283062 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:36.788499 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc7202-781b-4cff-9254-7221d8283062 None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:36.789622 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc7202-781b-4cff-9254-7221d8283062 None admin] RBAC: Adding query filter params (name=member) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:36.789998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc7202-781b-4cff-9254-7221d8283062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:36.792529 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc7202-781b-4cff-9254-7221d8283062 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:36.806526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 105/216] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 24 15:43:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:36.813025 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5837153-09b7-414b-921a-2816b6c59ba2 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:36.877146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:36.940916 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5837153-09b7-414b-921a-2816b6c59ba2 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:36.982558 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381eaa00-1ab9-4fb2-b049-0b0b12d3396f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:36.983260 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381eaa00-1ab9-4fb2-b049-0b0b12d3396f None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:36.983542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381eaa00-1ab9-4fb2-b049-0b0b12d3396f None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:36.983807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381eaa00-1ab9-4fb2-b049-0b0b12d3396f None admin] PATH_INFO: `/v3/users/3206c05639024e9ab22c2bf18e72aaf3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:37.000263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381eaa00-1ab9-4fb2-b049-0b0b12d3396f None admin] RBAC: Authorizing `identity:get_user(user_id=3206c05639024e9ab22c2bf18e72aaf3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:37.001781 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381eaa00-1ab9-4fb2-b049-0b0b12d3396f None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:37.003854 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 112/217] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:36 2022] GET /identity/v3/users/3206c05639024e9ab22c2bf18e72aaf3 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:37.010618 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc7202-781b-4cff-9254-7221d8283062 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:37.104355 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb5f1f-99e2-46b9-9d6c-8635428b4b13 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:37.104984 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb5f1f-99e2-46b9-9d6c-8635428b4b13 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:37.105460 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb5f1f-99e2-46b9-9d6c-8635428b4b13 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:37.107163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 113/218] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:43:37.114008 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58085f-c68d-4c6f-9401-f399aea5e23a None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:37.114599 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58085f-c68d-4c6f-9401-f399aea5e23a None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:37.115111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58085f-c68d-4c6f-9401-f399aea5e23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:37.117582 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:37.136472 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-be58085f-c68d-4c6f-9401-f399aea5e23a None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:37.138247 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-be58085f-c68d-4c6f-9401-f399aea5e23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:37.142536 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc7202-781b-4cff-9254-7221d8283062 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:37.191598 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125963f-7ae0-4095-b2dd-85954943f00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:37.192510 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125963f-7ae0-4095-b2dd-85954943f00c None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:37.193012 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125963f-7ae0-4095-b2dd-85954943f00c None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:37.193516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125963f-7ae0-4095-b2dd-85954943f00c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:37.235782 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 114/219] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:37.287297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125963f-7ae0-4095-b2dd-85954943f00c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:37.288835 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125963f-7ae0-4095-b2dd-85954943f00c None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:37.389154 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:37.406982 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 106/220] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:43:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 15:43:37.413160 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58085f-c68d-4c6f-9401-f399aea5e23a None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:37.453574 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:37.533975 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125963f-7ae0-4095-b2dd-85954943f00c None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:37.555234 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58085f-c68d-4c6f-9401-f399aea5e23a None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:37.628436 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d426f-1a81-43d1-b770-f498e19e3548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:37.629437 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d426f-1a81-43d1-b770-f498e19e3548 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:37.630087 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d426f-1a81-43d1-b770-f498e19e3548 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:37.630526 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d426f-1a81-43d1-b770-f498e19e3548 None admin] PATH_INFO: `/v3/projects/b533b81163ef4776a421230d7bc3e77c` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:37.633258 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d426f-1a81-43d1-b770-f498e19e3548 None admin] RBAC: Authorizing `identity:get_project(project_id=b533b81163ef4776a421230d7bc3e77c)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:37.639271 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d426f-1a81-43d1-b770-f498e19e3548 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:37.642157 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 115/221] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:43:37 2022] GET /identity/v3/projects/b533b81163ef4776a421230d7bc3e77c => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:43:37.656644 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d426f-1a81-43d1-b770-f498e19e3548 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:37.711447 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125963f-7ae0-4095-b2dd-85954943f00c None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:37.755610 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17406b5b-8fa0-4ad4-8c73-7f67be20387c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:37.756255 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17406b5b-8fa0-4ad4-8c73-7f67be20387c None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:37.756535 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17406b5b-8fa0-4ad4-8c73-7f67be20387c None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:37.756926 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17406b5b-8fa0-4ad4-8c73-7f67be20387c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:37.773261 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17406b5b-8fa0-4ad4-8c73-7f67be20387c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:37.782608 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-17406b5b-8fa0-4ad4-8c73-7f67be20387c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:43:37.782608 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:37.782608 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:37.782608 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:37.782608 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:37.782608 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:37.782608 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:37.782608 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:37.782608 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:37.782608 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:37.782608 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:37.782608 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:37.782608 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:37.782608 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:37.782608 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:37.782608 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:37.783548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:37.783548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:37.783548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:37.783548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:37.783548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:37.783548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:37.783548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:37.783548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:37.783548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:37.783548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:37.783548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:37.783548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:37.783548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:37.783548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:37.783548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:37.783548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:37.784315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:37.784315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:37.784315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:37.784315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:37.784315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:37.784315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:37.784315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:37.784315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:37.784315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:37.784315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:37.784315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:43:37.784315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:43:37.784315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 107/222] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:43:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:43:37.786458 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2edf9-5d15-4ddd-9ddd-c4891e639070 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:37.786960 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2edf9-5d15-4ddd-9ddd-c4891e639070 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:37.787480 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2edf9-5d15-4ddd-9ddd-c4891e639070 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:37.795868 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 108/223] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:37.797408 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2edf9-5d15-4ddd-9ddd-c4891e639070 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:37.808985 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:37.812432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d426f-1a81-43d1-b770-f498e19e3548 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:37.860434 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34479232-82ce-4e64-8ebf-36f3d3cc32ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:37.861180 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34479232-82ce-4e64-8ebf-36f3d3cc32ac None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:37.861553 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34479232-82ce-4e64-8ebf-36f3d3cc32ac None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:37.861886 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34479232-82ce-4e64-8ebf-36f3d3cc32ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:37.862781 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34479232-82ce-4e64-8ebf-36f3d3cc32ac None admin] RBAC: Adding query filter params (role.id=0ea43d9dfb184e27b48d251fd38463db, scope.project.id=b533b81163ef4776a421230d7bc3e77c, user.id=3206c05639024e9ab22c2bf18e72aaf3) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:37.863206 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34479232-82ce-4e64-8ebf-36f3d3cc32ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:37.866380 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34479232-82ce-4e64-8ebf-36f3d3cc32ac None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:37.874961 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:37.876390 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 116/224] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:43:37 2022] GET /identity/v3/role_assignments?user.id=3206c05639024e9ab22c2bf18e72aaf3&scope.project.id=b533b81163ef4776a421230d7bc3e77c&role.id=0ea43d9dfb184e27b48d251fd38463db => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:37.882437 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52a8e1-0477-47dc-98f0-48862332dffe None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:37.882437 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52a8e1-0477-47dc-98f0-48862332dffe None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:37.887849 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52a8e1-0477-47dc-98f0-48862332dffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:37.922878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-5f52a8e1-0477-47dc-98f0-48862332dffe None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:37.924012 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-5f52a8e1-0477-47dc-98f0-48862332dffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:37.993402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2edf9-5d15-4ddd-9ddd-c4891e639070 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:38.066585 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf52a1-c6ab-47b7-a5d3-bcaff4e5faa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:38.067893 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf52a1-c6ab-47b7-a5d3-bcaff4e5faa6 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:38.068384 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf52a1-c6ab-47b7-a5d3-bcaff4e5faa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:38.068687 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf52a1-c6ab-47b7-a5d3-bcaff4e5faa6 None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:38.070825 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf52a1-c6ab-47b7-a5d3-bcaff4e5faa6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:38.071134 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf52a1-c6ab-47b7-a5d3-bcaff4e5faa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:38.073014 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf52a1-c6ab-47b7-a5d3-bcaff4e5faa6 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:38.076482 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 117/225] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:38.085584 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 109/226] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:43:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:38.095659 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52a8e1-0477-47dc-98f0-48862332dffe None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:38.253993 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52a8e1-0477-47dc-98f0-48862332dffe None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:38.261302 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:38.315261 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511d67a-b511-4caa-b626-81bf2501c136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:38.315910 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511d67a-b511-4caa-b626-81bf2501c136 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:38.316185 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511d67a-b511-4caa-b626-81bf2501c136 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:38.316460 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511d67a-b511-4caa-b626-81bf2501c136 None admin] PATH_INFO: `/v3/users/6d0af1279acd4fe6bfca23f4ea06d5f8` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:38.317651 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6511d67a-b511-4caa-b626-81bf2501c136 None admin] RBAC: Authorizing `identity:get_user(user_id=6d0af1279acd4fe6bfca23f4ea06d5f8)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:38.319709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6511d67a-b511-4caa-b626-81bf2501c136 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:38.322349 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 118/227] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:38 2022] GET /identity/v3/users/6d0af1279acd4fe6bfca23f4ea06d5f8 => generated 283 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:38.328971 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf52a1-c6ab-47b7-a5d3-bcaff4e5faa6 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:38.490197 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511d67a-b511-4caa-b626-81bf2501c136 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:38.494917 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf52a1-c6ab-47b7-a5d3-bcaff4e5faa6 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:38.505339 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:38.532882 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8e321-6699-4a94-bac1-10eeb584f98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:38.533890 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8e321-6699-4a94-bac1-10eeb584f98d None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:38.534363 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8e321-6699-4a94-bac1-10eeb584f98d None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:38.534846 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8e321-6699-4a94-bac1-10eeb584f98d None admin] PATH_INFO: `/v3/projects/b533b81163ef4776a421230d7bc3e77c` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:38.536201 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8e321-6699-4a94-bac1-10eeb584f98d None admin] RBAC: Authorizing `identity:get_project(project_id=b533b81163ef4776a421230d7bc3e77c)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:38.538059 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8e321-6699-4a94-bac1-10eeb584f98d None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:38.539955 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 110/228] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:43:38 2022] GET /identity/v3/projects/b533b81163ef4776a421230d7bc3e77c => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:43:38.552050 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8e321-6699-4a94-bac1-10eeb584f98d None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:38.665588 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8e321-6699-4a94-bac1-10eeb584f98d None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:38.710708 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499de14c-7047-4ccf-a52c-a2818d80bc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:38.713628 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499de14c-7047-4ccf-a52c-a2818d80bc1e None admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:38.713628 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499de14c-7047-4ccf-a52c-a2818d80bc1e None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:38.713628 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499de14c-7047-4ccf-a52c-a2818d80bc1e None admin] PATH_INFO: `/v3/projects/b533b81163ef4776a421230d7bc3e77c/users/6d0af1279acd4fe6bfca23f4ea06d5f8/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:38.716371 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499de14c-7047-4ccf-a52c-a2818d80bc1e None admin] RBAC: Authorizing `identity:create_grant(project_id=b533b81163ef4776a421230d7bc3e77c, user_id=6d0af1279acd4fe6bfca23f4ea06d5f8, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:38.718076 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499de14c-7047-4ccf-a52c-a2818d80bc1e None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:38.742670 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511d67a-b511-4caa-b626-81bf2501c136 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:38.780890 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02331b-57e0-4d6c-ba1d-7087a8fed3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:38.781841 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02331b-57e0-4d6c-ba1d-7087a8fed3b9 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:38.782564 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02331b-57e0-4d6c-ba1d-7087a8fed3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:38.783107 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02331b-57e0-4d6c-ba1d-7087a8fed3b9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:38.795608 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02331b-57e0-4d6c-ba1d-7087a8fed3b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:38.802117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-ad02331b-57e0-4d6c-ba1d-7087a8fed3b9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:43:38.802117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:38.802117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:38.802117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:38.802117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:38.802117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:38.802117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:38.802117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:38.802117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:38.802117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:38.802117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:38.802117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:38.802117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:38.802117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:38.802117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:38.802117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:38.807175 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:38.807175 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:38.807175 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:38.807175 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:38.807175 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:38.807175 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:38.807175 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:38.807175 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:38.807175 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:38.807175 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:38.807175 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:38.807175 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:38.807175 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:38.807175 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:38.807175 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:38.807175 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:38.807953 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:38.807953 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:38.807953 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:38.807953 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:38.807953 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:38.807953 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:38.807953 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:38.807953 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:38.807953 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:38.807953 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:38.807953 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:43:38.807953 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:43:38.811764 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 111/229] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 24 15:43:38 2022] PUT /identity/v3/projects/b533b81163ef4776a421230d7bc3e77c/users/6d0af1279acd4fe6bfca23f4ea06d5f8/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:43:38.813698 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 119/230] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 24 15:43:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:43:38.821185 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499de14c-7047-4ccf-a52c-a2818d80bc1e None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:38.867356 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:38.956722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499de14c-7047-4ccf-a52c-a2818d80bc1e None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:38.998379 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1cce4-b632-4917-bd12-ecd562e5287e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:38.999041 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1cce4-b632-4917-bd12-ecd562e5287e None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:38.999323 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1cce4-b632-4917-bd12-ecd562e5287e None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:38.999590 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1cce4-b632-4917-bd12-ecd562e5287e None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:39.000266 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1cce4-b632-4917-bd12-ecd562e5287e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:39.000567 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1cce4-b632-4917-bd12-ecd562e5287e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:39.002063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1cce4-b632-4917-bd12-ecd562e5287e None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:39.011491 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 112/231] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:43:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:39.017323 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02331b-57e0-4d6c-ba1d-7087a8fed3b9 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:39.045834 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:39.129693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02331b-57e0-4d6c-ba1d-7087a8fed3b9 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:39.177587 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef528fe-920a-4619-83c7-6e34d5164b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:39.178233 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef528fe-920a-4619-83c7-6e34d5164b19 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:39.179252 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef528fe-920a-4619-83c7-6e34d5164b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:39.179460 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef528fe-920a-4619-83c7-6e34d5164b19 None admin] PATH_INFO: `/v3/users/6d0af1279acd4fe6bfca23f4ea06d5f8` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:39.181303 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef528fe-920a-4619-83c7-6e34d5164b19 None admin] RBAC: Authorizing `identity:get_user(user_id=6d0af1279acd4fe6bfca23f4ea06d5f8)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:39.182840 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef528fe-920a-4619-83c7-6e34d5164b19 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:39.184765 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 120/232] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:39 2022] GET /identity/v3/users/6d0af1279acd4fe6bfca23f4ea06d5f8 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:39.190497 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1cce4-b632-4917-bd12-ecd562e5287e None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:39.369126 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:39.372796 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1cce4-b632-4917-bd12-ecd562e5287e None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:39.423285 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899e671-0d55-4f76-b8b9-476277e7c561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:39.423945 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899e671-0d55-4f76-b8b9-476277e7c561 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:39.424222 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899e671-0d55-4f76-b8b9-476277e7c561 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:39.424497 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899e671-0d55-4f76-b8b9-476277e7c561 None admin] PATH_INFO: `/v3/projects/b533b81163ef4776a421230d7bc3e77c` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:39.425703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899e671-0d55-4f76-b8b9-476277e7c561 None admin] RBAC: Authorizing `identity:get_project(project_id=b533b81163ef4776a421230d7bc3e77c)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:39.427178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899e671-0d55-4f76-b8b9-476277e7c561 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:39.429145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 113/233] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:43:39 2022] GET /identity/v3/projects/b533b81163ef4776a421230d7bc3e77c => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:39.435119 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef528fe-920a-4619-83c7-6e34d5164b19 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:39.470668 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f605d-2d66-4584-9ca7-c35fdf2b5dde None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:39.470976 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f605d-2d66-4584-9ca7-c35fdf2b5dde None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:39.471224 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f605d-2d66-4584-9ca7-c35fdf2b5dde None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:39.472952 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 114/234] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:43:39.479121 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321d9fa-7141-4cb3-9b5c-44c1c402b4b4 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:39.479423 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321d9fa-7141-4cb3-9b5c-44c1c402b4b4 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:39.479689 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321d9fa-7141-4cb3-9b5c-44c1c402b4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:39.499047 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-1321d9fa-7141-4cb3-9b5c-44c1c402b4b4 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:39.500268 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-1321d9fa-7141-4cb3-9b5c-44c1c402b4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:39.609948 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 115/235] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:43:39.639895 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:39.658327 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef528fe-920a-4619-83c7-6e34d5164b19 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:39.714210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaefc8a-765b-48ab-96b0-784e2e702fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:39.715296 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaefc8a-765b-48ab-96b0-784e2e702fa9 None admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:39.715781 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaefc8a-765b-48ab-96b0-784e2e702fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:39.716256 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaefc8a-765b-48ab-96b0-784e2e702fa9 None admin] PATH_INFO: `/v3/projects/b533b81163ef4776a421230d7bc3e77c/users/6d0af1279acd4fe6bfca23f4ea06d5f8/roles/38df38770b21458d87720d3c4c6f1ff1` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:39.718828 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaefc8a-765b-48ab-96b0-784e2e702fa9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b533b81163ef4776a421230d7bc3e77c, user_id=6d0af1279acd4fe6bfca23f4ea06d5f8, role_id=38df38770b21458d87720d3c4c6f1ff1)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:39.720504 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaefc8a-765b-48ab-96b0-784e2e702fa9 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:39.752298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3088020-e941-4b34-af24-7ce4058aa964 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:39.752604 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3088020-e941-4b34-af24-7ce4058aa964 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:39.752887 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3088020-e941-4b34-af24-7ce4058aa964 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:39.754246 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 116/236] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:43:39.760427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c0b42-701a-485a-97d2-e73563974b60 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:39.760740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c0b42-701a-485a-97d2-e73563974b60 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:39.761009 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c0b42-701a-485a-97d2-e73563974b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:39.780746 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-705c0b42-701a-485a-97d2-e73563974b60 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:39.782000 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-705c0b42-701a-485a-97d2-e73563974b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:39.824994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 121/237] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 24 15:43:39 2022] PUT /identity/v3/projects/b533b81163ef4776a421230d7bc3e77c/users/6d0af1279acd4fe6bfca23f4ea06d5f8/roles/38df38770b21458d87720d3c4c6f1ff1 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:43:39.879620 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 117/238] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:43:39.929341 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaefc8a-765b-48ab-96b0-784e2e702fa9 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:40.061398 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaefc8a-765b-48ab-96b0-784e2e702fa9 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:40.100337 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5985f-15f7-4fb5-9d6e-3d0dd88f3132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:40.101014 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5985f-15f7-4fb5-9d6e-3d0dd88f3132 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:40.101295 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5985f-15f7-4fb5-9d6e-3d0dd88f3132 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:40.101571 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5985f-15f7-4fb5-9d6e-3d0dd88f3132 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:40.113224 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5985f-15f7-4fb5-9d6e-3d0dd88f3132 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:40.118540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-97e5985f-15f7-4fb5-9d6e-3d0dd88f3132 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:43:40.118540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:40.118540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:40.118540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:40.118540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:40.118540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:40.118540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:40.118540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:40.118540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:40.118540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:40.118540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:40.118540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:40.118540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:40.118540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:40.118540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:40.118540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:40.119418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:40.119418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:40.119418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:40.119418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:40.119418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:40.119418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:40.119418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:40.119418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:40.119418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:40.119418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:40.119418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:40.119418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:40.119418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:40.119418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:40.119418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:40.119418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:40.120176 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:40.120176 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:40.120176 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:40.120176 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:40.120176 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:40.120176 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:40.120176 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:40.120176 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:40.120176 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:40.120176 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:40.120176 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:43:40.120176 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:43:40.120176 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 122/239] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:43:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:43:40.125500 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c0b42-701a-485a-97d2-e73563974b60 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:40.164097 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:40.233523 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5985f-15f7-4fb5-9d6e-3d0dd88f3132 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:40.257875 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:40.304227 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c0b42-701a-485a-97d2-e73563974b60 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:40.345140 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc4804-a23c-4e39-8667-28a0a1b12e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:40.346114 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc4804-a23c-4e39-8667-28a0a1b12e55 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:40.346643 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc4804-a23c-4e39-8667-28a0a1b12e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:40.347321 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc4804-a23c-4e39-8667-28a0a1b12e55 None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:40.348835 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc4804-a23c-4e39-8667-28a0a1b12e55 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:40.349657 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc4804-a23c-4e39-8667-28a0a1b12e55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:40.351864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc4804-a23c-4e39-8667-28a0a1b12e55 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:40.367916 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 118/240] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 24 15:43:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:40.373975 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc4804-a23c-4e39-8667-28a0a1b12e55 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:40.398151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5985f-15f7-4fb5-9d6e-3d0dd88f3132 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:40.471129 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d5888-9aa5-4706-a1bc-9ac9e7324239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:40.471770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d5888-9aa5-4706-a1bc-9ac9e7324239 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:40.472051 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d5888-9aa5-4706-a1bc-9ac9e7324239 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:40.472317 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d5888-9aa5-4706-a1bc-9ac9e7324239 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:40.473631 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d5888-9aa5-4706-a1bc-9ac9e7324239 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:40.475822 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d5888-9aa5-4706-a1bc-9ac9e7324239 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:40.477501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 123/241] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:43:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:40.484220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d5888-9aa5-4706-a1bc-9ac9e7324239 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:40.544976 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:40.573397 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc4804-a23c-4e39-8667-28a0a1b12e55 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:40.610342 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a631f9-f95e-4a0c-b705-1496a4c8a922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:40.610988 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a631f9-f95e-4a0c-b705-1496a4c8a922 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:40.611266 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a631f9-f95e-4a0c-b705-1496a4c8a922 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:40.611537 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a631f9-f95e-4a0c-b705-1496a4c8a922 None admin] PATH_INFO: `/v3/users/04b63821a37440d9a04beafbe6aad2e1` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:40.615098 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:40.629632 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a631f9-f95e-4a0c-b705-1496a4c8a922 None admin] RBAC: Authorizing `identity:get_user(user_id=04b63821a37440d9a04beafbe6aad2e1)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:40.631096 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a631f9-f95e-4a0c-b705-1496a4c8a922 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:40.633355 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 119/242] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:40 2022] GET /identity/v3/users/04b63821a37440d9a04beafbe6aad2e1 => generated 297 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:40.634552 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148019f-aaca-477f-aee1-59785084b4de None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:40.634836 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148019f-aaca-477f-aee1-59785084b4de None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:40.635112 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148019f-aaca-477f-aee1-59785084b4de None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:40.636669 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 120/243] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:40.639166 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148019f-aaca-477f-aee1-59785084b4de None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:40.651442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d5888-9aa5-4706-a1bc-9ac9e7324239 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:40.702195 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8719ee-a8d1-4958-a59c-562af7115d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:40.703096 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8719ee-a8d1-4958-a59c-562af7115d9a None admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:40.703515 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8719ee-a8d1-4958-a59c-562af7115d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:40.703924 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8719ee-a8d1-4958-a59c-562af7115d9a None admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:40.705077 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8719ee-a8d1-4958-a59c-562af7115d9a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:40.707292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8719ee-a8d1-4958-a59c-562af7115d9a None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:40.792069 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148019f-aaca-477f-aee1-59785084b4de None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:40.831523 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0907fd9-0c77-47ac-87b2-7488c73b629c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:40.832212 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0907fd9-0c77-47ac-87b2-7488c73b629c None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:40.832580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0907fd9-0c77-47ac-87b2-7488c73b629c None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:40.833118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 124/244] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 24 15:43:40 2022] POST /identity/v3/users => generated 293 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:43:40.836561 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd8fc3-f335-4ac3-a408-839d921e93a5 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:40.837132 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0907fd9-0c77-47ac-87b2-7488c73b629c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:40.837489 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd8fc3-f335-4ac3-a408-839d921e93a5 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:40.837953 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd8fc3-f335-4ac3-a408-839d921e93a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:40.870352 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-6bbd8fc3-f335-4ac3-a408-839d921e93a5 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:40.872375 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-6bbd8fc3-f335-4ac3-a408-839d921e93a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:40.874390 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:40.972315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 125/245] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:40.985624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0907fd9-0c77-47ac-87b2-7488c73b629c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:40.987851 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0907fd9-0c77-47ac-87b2-7488c73b629c None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:41.107776 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 121/246] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:43:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:41.113628 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd8fc3-f335-4ac3-a408-839d921e93a5 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:41.176133 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae182c-482f-4e35-aab1-e7bd8df19573 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:41.176771 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae182c-482f-4e35-aab1-e7bd8df19573 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:41.177261 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae182c-482f-4e35-aab1-e7bd8df19573 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:41.180307 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 122/247] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:41.186788 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa435d-f18c-415a-b4c1-9e6d7f854893 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:41.187398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa435d-f18c-415a-b4c1-9e6d7f854893 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:41.187872 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa435d-f18c-415a-b4c1-9e6d7f854893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:41.190131 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:41.220355 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-25aa435d-f18c-415a-b4c1-9e6d7f854893 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:41.221774 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-25aa435d-f18c-415a-b4c1-9e6d7f854893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:41.271257 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd8fc3-f335-4ac3-a408-839d921e93a5 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:41.303163 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:41.325832 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83df0b-4af1-4b00-827c-ca6a66c9bb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:41.326505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83df0b-4af1-4b00-827c-ca6a66c9bb61 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:41.326797 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83df0b-4af1-4b00-827c-ca6a66c9bb61 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:41.327122 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83df0b-4af1-4b00-827c-ca6a66c9bb61 None admin] PATH_INFO: `/v3/projects/b533b81163ef4776a421230d7bc3e77c` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:41.328353 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83df0b-4af1-4b00-827c-ca6a66c9bb61 None admin] RBAC: Authorizing `identity:get_project(project_id=b533b81163ef4776a421230d7bc3e77c)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:41.332748 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83df0b-4af1-4b00-827c-ca6a66c9bb61 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:41.335077 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 126/248] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:43:41 2022] GET /identity/v3/projects/b533b81163ef4776a421230d7bc3e77c => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:43:41.345909 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83df0b-4af1-4b00-827c-ca6a66c9bb61 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:41.349901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 123/249] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:41.367936 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa435d-f18c-415a-b4c1-9e6d7f854893 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:41.506840 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa435d-f18c-415a-b4c1-9e6d7f854893 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:41.511018 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83df0b-4af1-4b00-827c-ca6a66c9bb61 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:41.552329 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:41.556677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73fdc80-d07b-40d0-bb3d-daa0b3835ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:41.557436 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73fdc80-d07b-40d0-bb3d-daa0b3835ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:41.557805 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73fdc80-d07b-40d0-bb3d-daa0b3835ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:41.558092 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73fdc80-d07b-40d0-bb3d-daa0b3835ef4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:41.560661 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4544c13-bb59-4178-873d-5fee62ecd577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:41.561973 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4544c13-bb59-4178-873d-5fee62ecd577 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:41.562419 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4544c13-bb59-4178-873d-5fee62ecd577 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:41.562849 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4544c13-bb59-4178-873d-5fee62ecd577 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:41.564032 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4544c13-bb59-4178-873d-5fee62ecd577 None admin] RBAC: Adding query filter params (role.id=961096b573de42c18dfca520e82b2030, scope.project.id=b533b81163ef4776a421230d7bc3e77c, user.id=04b63821a37440d9a04beafbe6aad2e1) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:41.565870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4544c13-bb59-4178-873d-5fee62ecd577 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:41.566847 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4544c13-bb59-4178-873d-5fee62ecd577 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:41.570365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73fdc80-d07b-40d0-bb3d-daa0b3835ef4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:41.574428 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 127/250] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:43:41 2022] GET /identity/v3/role_assignments?user.id=04b63821a37440d9a04beafbe6aad2e1&scope.project.id=b533b81163ef4776a421230d7bc3e77c&role.id=961096b573de42c18dfca520e82b2030 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:41.576395 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-a73fdc80-d07b-40d0-bb3d-daa0b3835ef4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:43:41.576395 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:41.576395 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:41.576395 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:41.576395 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:41.576395 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:41.576395 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:41.576395 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:41.576395 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:41.576395 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:41.576395 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:41.576395 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:41.576395 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:41.576395 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:41.576395 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:41.576395 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:41.577333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:41.577333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:41.577333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:41.577333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:41.577333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:41.577333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:41.577333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:41.577333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:41.577333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:41.577333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:41.577333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:41.577333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:41.577333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:41.577333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:41.577333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:41.577333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:41.581452 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:41.581452 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:41.581452 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:41.581452 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:41.581452 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:41.581452 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:41.581452 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:41.581452 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:41.581452 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:41.581452 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:41.581452 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:43:41.581452 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:43:41.581452 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 124/251] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:43:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:43:41.585345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4544c13-bb59-4178-873d-5fee62ecd577 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:41.718017 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4544c13-bb59-4178-873d-5fee62ecd577 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:41.766349 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990079ce-e34d-41ba-8150-38c6637f6d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:41.767298 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990079ce-e34d-41ba-8150-38c6637f6d07 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:41.767822 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990079ce-e34d-41ba-8150-38c6637f6d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:41.769016 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73fdc80-d07b-40d0-bb3d-daa0b3835ef4 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:41.769133 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990079ce-e34d-41ba-8150-38c6637f6d07 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:41.769768 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990079ce-e34d-41ba-8150-38c6637f6d07 None admin] RBAC: Adding query filter params (name=member) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:41.770057 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990079ce-e34d-41ba-8150-38c6637f6d07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:41.771496 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990079ce-e34d-41ba-8150-38c6637f6d07 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:41.786247 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 128/252] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 24 15:43:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:41.791145 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990079ce-e34d-41ba-8150-38c6637f6d07 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:41.823648 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:41.893088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:41.900300 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73fdc80-d07b-40d0-bb3d-daa0b3835ef4 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:41.939006 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce027b1-826f-440d-8381-b77ea24442d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:41.940062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce027b1-826f-440d-8381-b77ea24442d3 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:41.940607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce027b1-826f-440d-8381-b77ea24442d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:41.941188 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce027b1-826f-440d-8381-b77ea24442d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:41.954594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce027b1-826f-440d-8381-b77ea24442d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:41.960546 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-3ce027b1-826f-440d-8381-b77ea24442d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:43:41.960546 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:41.960546 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:41.960546 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:41.960546 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:41.960546 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:41.960546 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:41.960546 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:41.960546 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:41.960546 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:41.960546 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:41.960546 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:41.960546 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:41.960546 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:41.960546 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:41.960546 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:41.961475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:41.961475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:41.961475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:41.961475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:41.961475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:41.961475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:41.961475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:41.961475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:41.961475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:41.961475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:41.961475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:41.961475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:41.961475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:41.961475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:41.961475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:41.961475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:41.962327 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:41.962327 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:41.962327 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:41.962327 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:41.962327 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:41.962327 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:41.962327 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:41.962327 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:41.962327 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:41.962327 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:41.962327 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:43:41.962327 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:43:41.964741 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 125/253] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:43:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:43:41.974357 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce027b1-826f-440d-8381-b77ea24442d3 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:42.002031 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990079ce-e34d-41ba-8150-38c6637f6d07 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:42.099653 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc24de1-9096-4126-891b-f204ff0a5e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:42.106671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc24de1-9096-4126-891b-f204ff0a5e68 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:42.107187 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc24de1-9096-4126-891b-f204ff0a5e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:42.107469 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc24de1-9096-4126-891b-f204ff0a5e68 None admin] PATH_INFO: `/v3/users/3206c05639024e9ab22c2bf18e72aaf3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:42.113656 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc24de1-9096-4126-891b-f204ff0a5e68 None admin] RBAC: Authorizing `identity:get_user(user_id=3206c05639024e9ab22c2bf18e72aaf3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:42.115228 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc24de1-9096-4126-891b-f204ff0a5e68 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:42.119737 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 129/254] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:41 2022] GET /identity/v3/users/3206c05639024e9ab22c2bf18e72aaf3 => generated 297 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:43:42.124635 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc24de1-9096-4126-891b-f204ff0a5e68 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:42.158746 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:42.168074 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce027b1-826f-440d-8381-b77ea24442d3 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:42.249262 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b0909-48db-40ea-815d-cbec5237982c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:42.249832 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b0909-48db-40ea-815d-cbec5237982c None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:42.250110 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b0909-48db-40ea-815d-cbec5237982c None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:42.250380 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b0909-48db-40ea-815d-cbec5237982c None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:42.251060 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b0909-48db-40ea-815d-cbec5237982c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:42.251362 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b0909-48db-40ea-815d-cbec5237982c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:42.252786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b0909-48db-40ea-815d-cbec5237982c None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:42.268890 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 126/255] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:43:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:43:42.279153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b0909-48db-40ea-815d-cbec5237982c None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:42.348213 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc24de1-9096-4126-891b-f204ff0a5e68 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:42.421489 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b0909-48db-40ea-815d-cbec5237982c None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:42.425038 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:42.450492 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98498db-5ea7-4498-b9f2-7791b1436c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:42.451141 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98498db-5ea7-4498-b9f2-7791b1436c74 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:42.451422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98498db-5ea7-4498-b9f2-7791b1436c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:42.451690 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98498db-5ea7-4498-b9f2-7791b1436c74 None admin] PATH_INFO: `/v3/projects/b533b81163ef4776a421230d7bc3e77c` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:42.452974 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98498db-5ea7-4498-b9f2-7791b1436c74 None admin] RBAC: Authorizing `identity:get_project(project_id=b533b81163ef4776a421230d7bc3e77c)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:42.454430 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98498db-5ea7-4498-b9f2-7791b1436c74 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:42.456056 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 130/256] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:43:42 2022] GET /identity/v3/projects/b533b81163ef4776a421230d7bc3e77c => generated 302 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:43:42.459029 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ee1b5-8d53-4dbb-8ef6-6d9dedc527d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:42.459867 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ee1b5-8d53-4dbb-8ef6-6d9dedc527d8 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:42.460307 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ee1b5-8d53-4dbb-8ef6-6d9dedc527d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:42.460765 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ee1b5-8d53-4dbb-8ef6-6d9dedc527d8 None admin] PATH_INFO: `/v3/users/6d0af1279acd4fe6bfca23f4ea06d5f8` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:42.462164 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ee1b5-8d53-4dbb-8ef6-6d9dedc527d8 None admin] RBAC: Authorizing `identity:get_user(user_id=6d0af1279acd4fe6bfca23f4ea06d5f8)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:42.463158 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98498db-5ea7-4498-b9f2-7791b1436c74 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:42.464032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ee1b5-8d53-4dbb-8ef6-6d9dedc527d8 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:42.466042 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 127/257] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:42 2022] GET /identity/v3/users/6d0af1279acd4fe6bfca23f4ea06d5f8 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:42.471582 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ee1b5-8d53-4dbb-8ef6-6d9dedc527d8 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:42.520242 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:42.624226 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ee1b5-8d53-4dbb-8ef6-6d9dedc527d8 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:42.650169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98498db-5ea7-4498-b9f2-7791b1436c74 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:42.715080 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea3974-9bd5-40aa-b0ef-4fce08498a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:42.715807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea3974-9bd5-40aa-b0ef-4fce08498a5c None admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:42.716096 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea3974-9bd5-40aa-b0ef-4fce08498a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:42.716370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea3974-9bd5-40aa-b0ef-4fce08498a5c None admin] PATH_INFO: `/v3/projects/b533b81163ef4776a421230d7bc3e77c/users/3206c05639024e9ab22c2bf18e72aaf3/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:42.722030 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea3974-9bd5-40aa-b0ef-4fce08498a5c None admin] RBAC: Authorizing `identity:create_grant(project_id=b533b81163ef4776a421230d7bc3e77c, user_id=3206c05639024e9ab22c2bf18e72aaf3, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:42.723756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea3974-9bd5-40aa-b0ef-4fce08498a5c None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:42.751246 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3b8cf-07f3-471e-a94a-b995d27a3b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:42.751873 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3b8cf-07f3-471e-a94a-b995d27a3b91 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:42.752149 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3b8cf-07f3-471e-a94a-b995d27a3b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:42.752414 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3b8cf-07f3-471e-a94a-b995d27a3b91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:42.807620 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 131/258] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 24 15:43:42 2022] PUT /identity/v3/projects/b533b81163ef4776a421230d7bc3e77c/users/3206c05639024e9ab22c2bf18e72aaf3/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:43:42.808826 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8eea15-96e8-4da2-90eb-96eafec97766 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:42.809169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8eea15-96e8-4da2-90eb-96eafec97766 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:42.809449 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8eea15-96e8-4da2-90eb-96eafec97766 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:42.810694 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 132/259] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:42.820715 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f8ea7-b7c9-4d8a-8e60-d1c860f7594b None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:42.821023 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f8ea7-b7c9-4d8a-8e60-d1c860f7594b None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:42.821328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f8ea7-b7c9-4d8a-8e60-d1c860f7594b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:42.850870 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3b8cf-07f3-471e-a94a-b995d27a3b91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:42.852537 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3b8cf-07f3-471e-a94a-b995d27a3b91 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:42.857775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-bc2f8ea7-b7c9-4d8a-8e60-d1c860f7594b None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:42.859087 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-bc2f8ea7-b7c9-4d8a-8e60-d1c860f7594b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:42.883580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:42.970160 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:43.004605 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 133/260] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:43.012886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 128/261] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:43:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:43.018339 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f8ea7-b7c9-4d8a-8e60-d1c860f7594b None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:43.169439 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f8ea7-b7c9-4d8a-8e60-d1c860f7594b None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:43.210083 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c8f03-7bf9-424b-9e8f-974e2aabc017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:43.210912 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c8f03-7bf9-424b-9e8f-974e2aabc017 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:43.211191 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c8f03-7bf9-424b-9e8f-974e2aabc017 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:43.211460 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c8f03-7bf9-424b-9e8f-974e2aabc017 None admin] PATH_INFO: `/v3/projects/b533b81163ef4776a421230d7bc3e77c` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:43.212713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c8f03-7bf9-424b-9e8f-974e2aabc017 None admin] RBAC: Authorizing `identity:get_project(project_id=b533b81163ef4776a421230d7bc3e77c)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:43.214186 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c8f03-7bf9-424b-9e8f-974e2aabc017 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:43.216170 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 134/262] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:43:43 2022] GET /identity/v3/projects/b533b81163ef4776a421230d7bc3e77c => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:43.226674 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3b8cf-07f3-471e-a94a-b995d27a3b91 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:43.391264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3b8cf-07f3-471e-a94a-b995d27a3b91 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:43.427559 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c8f03-7bf9-424b-9e8f-974e2aabc017 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:43.447289 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:43.467592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f214ad7-20ef-4f15-8406-4185ce430c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:43.468221 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f214ad7-20ef-4f15-8406-4185ce430c7e None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:43.468501 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f214ad7-20ef-4f15-8406-4185ce430c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:43.468796 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f214ad7-20ef-4f15-8406-4185ce430c7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:43.469605 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f214ad7-20ef-4f15-8406-4185ce430c7e None admin] RBAC: Adding query filter params (role.id=c6745e08f9da4a2bae8510c9983635c3, scope.project.id=b533b81163ef4776a421230d7bc3e77c, user.id=6d0af1279acd4fe6bfca23f4ea06d5f8) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:43.469913 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f214ad7-20ef-4f15-8406-4185ce430c7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:43.471375 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f214ad7-20ef-4f15-8406-4185ce430c7e None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:43.488810 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 129/263] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:43:43 2022] GET /identity/v3/role_assignments?user.id=6d0af1279acd4fe6bfca23f4ea06d5f8&scope.project.id=b533b81163ef4776a421230d7bc3e77c&role.id=c6745e08f9da4a2bae8510c9983635c3 => generated 608 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:43.549036 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:43.617930 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c8f03-7bf9-424b-9e8f-974e2aabc017 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:43.661426 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38b231-4687-4f1a-a998-c9d6a15ffaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:43.662183 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38b231-4687-4f1a-a998-c9d6a15ffaea None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:43.662497 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38b231-4687-4f1a-a998-c9d6a15ffaea None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:43.662785 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38b231-4687-4f1a-a998-c9d6a15ffaea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:43.674958 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38b231-4687-4f1a-a998-c9d6a15ffaea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:43.680870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-5a38b231-4687-4f1a-a998-c9d6a15ffaea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:43:43.680870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:43.680870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:43.680870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:43.680870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:43.680870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:43.680870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:43.680870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:43.680870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:43.680870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:43.680870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:43.680870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:43.680870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:43.680870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:43.680870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:43.680870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:43.681759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:43.681759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:43.681759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:43.681759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:43.681759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:43.681759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:43.681759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:43.681759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:43.681759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:43.681759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:43.681759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:43.681759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:43.681759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:43.681759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:43.681759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:43.681759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:43.682750 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:43.682750 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:43.682750 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:43.682750 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:43.682750 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:43.682750 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:43.682750 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:43.682750 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:43.682750 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:43.682750 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:43.682750 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:43:43.682750 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:43:43.682750 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 135/264] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 24 15:43:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:43:43.690051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f214ad7-20ef-4f15-8406-4185ce430c7e None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:43.828655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f214ad7-20ef-4f15-8406-4185ce430c7e None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:43.877601 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fa3c9-c924-486a-8a7e-4fe296f44af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:43.878233 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fa3c9-c924-486a-8a7e-4fe296f44af0 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:43.878512 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fa3c9-c924-486a-8a7e-4fe296f44af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:43.878781 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fa3c9-c924-486a-8a7e-4fe296f44af0 None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:43.879455 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702fa3c9-c924-486a-8a7e-4fe296f44af0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:43.879755 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702fa3c9-c924-486a-8a7e-4fe296f44af0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:43.881441 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702fa3c9-c924-486a-8a7e-4fe296f44af0 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:43.896677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 130/265] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:43:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:43.902906 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38b231-4687-4f1a-a998-c9d6a15ffaea None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:44.058984 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38b231-4687-4f1a-a998-c9d6a15ffaea None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:44.083210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:44.110394 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69ff86-2f32-45d5-8237-9c4249e3d573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:44.111041 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69ff86-2f32-45d5-8237-9c4249e3d573 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:44.111318 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69ff86-2f32-45d5-8237-9c4249e3d573 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:44.111589 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69ff86-2f32-45d5-8237-9c4249e3d573 None admin] PATH_INFO: `/v3/users/6d0af1279acd4fe6bfca23f4ea06d5f8` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:44.117677 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69ff86-2f32-45d5-8237-9c4249e3d573 None admin] RBAC: Authorizing `identity:get_user(user_id=6d0af1279acd4fe6bfca23f4ea06d5f8)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:44.119193 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69ff86-2f32-45d5-8237-9c4249e3d573 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:44.121306 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 136/266] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:43 2022] GET /identity/v3/users/6d0af1279acd4fe6bfca23f4ea06d5f8 => generated 283 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:44.126853 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fa3c9-c924-486a-8a7e-4fe296f44af0 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:44.196659 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:44.259886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fa3c9-c924-486a-8a7e-4fe296f44af0 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:44.312960 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70484d90-10e9-4984-95e9-4b964f883dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:44.313512 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70484d90-10e9-4984-95e9-4b964f883dbe None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:44.313795 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70484d90-10e9-4984-95e9-4b964f883dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:44.314066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70484d90-10e9-4984-95e9-4b964f883dbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:44.391376 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7656a66-ea10-4a65-89c7-2cfa43aed1e1 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:44.392035 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7656a66-ea10-4a65-89c7-2cfa43aed1e1 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:44.392373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7656a66-ea10-4a65-89c7-2cfa43aed1e1 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:44.393849 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 137/267] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:43:44.408707 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fdff0-1e6d-46c4-8631-c7dce08fdf7b None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:44.409266 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fdff0-1e6d-46c4-8631-c7dce08fdf7b None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:44.409711 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fdff0-1e6d-46c4-8631-c7dce08fdf7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:44.418510 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70484d90-10e9-4984-95e9-4b964f883dbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:44.420260 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70484d90-10e9-4984-95e9-4b964f883dbe None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:44.442851 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-4e9fdff0-1e6d-46c4-8631-c7dce08fdf7b None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:44.444117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-4e9fdff0-1e6d-46c4-8631-c7dce08fdf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:44.487320 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:44.525831 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 138/268] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:43:44.531006 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28159e-0e7d-441c-9f2d-b0db14cc4637 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:44.531676 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28159e-0e7d-441c-9f2d-b0db14cc4637 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:44.532616 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28159e-0e7d-441c-9f2d-b0db14cc4637 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:44.534962 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 139/269] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:44.536615 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26154ed0-2e21-4011-ba4a-8a4a0364d34e None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:44.537135 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26154ed0-2e21-4011-ba4a-8a4a0364d34e None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:44.538531 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26154ed0-2e21-4011-ba4a-8a4a0364d34e None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:44.540561 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 140/270] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:44.543264 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49313acb-d38f-447f-9e83-46ed3ee862d2 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:44.543753 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49313acb-d38f-447f-9e83-46ed3ee862d2 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:44.544234 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49313acb-d38f-447f-9e83-46ed3ee862d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:44.550837 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 131/271] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:43:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 15:43:44.552020 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8816c7-38c8-48e3-9278-6618eb8789e6 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:44.552302 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8816c7-38c8-48e3-9278-6618eb8789e6 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:44.552573 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8816c7-38c8-48e3-9278-6618eb8789e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:44.571039 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-49313acb-d38f-447f-9e83-46ed3ee862d2 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:44.572777 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-49313acb-d38f-447f-9e83-46ed3ee862d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:44.574191 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-dc8816c7-38c8-48e3-9278-6618eb8789e6 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:44.575779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-dc8816c7-38c8-48e3-9278-6618eb8789e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:44.652920 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 141/272] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:43:44.653367 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49313acb-d38f-447f-9e83-46ed3ee862d2 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:44.674998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 132/273] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:44.723313 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:44.803531 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49313acb-d38f-447f-9e83-46ed3ee862d2 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:44.856118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464b7ac-231f-4f6e-af15-7855ba0e9dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:44.856722 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464b7ac-231f-4f6e-af15-7855ba0e9dad None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:44.857002 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464b7ac-231f-4f6e-af15-7855ba0e9dad None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:44.857272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464b7ac-231f-4f6e-af15-7855ba0e9dad None admin] PATH_INFO: `/v3/projects/b533b81163ef4776a421230d7bc3e77c` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:44.858630 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464b7ac-231f-4f6e-af15-7855ba0e9dad None admin] RBAC: Authorizing `identity:get_project(project_id=b533b81163ef4776a421230d7bc3e77c)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:44.860150 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464b7ac-231f-4f6e-af15-7855ba0e9dad None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:44.862141 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 142/274] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:43:44 2022] GET /identity/v3/projects/b533b81163ef4776a421230d7bc3e77c => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:44.868566 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8816c7-38c8-48e3-9278-6618eb8789e6 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:44.876803 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464b7ac-231f-4f6e-af15-7855ba0e9dad None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:45.000566 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:45.024270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8816c7-38c8-48e3-9278-6618eb8789e6 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:45.050829 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464b7ac-231f-4f6e-af15-7855ba0e9dad None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:45.062654 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:45.066676 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722d6f9-c4db-4d10-9297-3c3918317094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:45.067572 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722d6f9-c4db-4d10-9297-3c3918317094 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:45.068018 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722d6f9-c4db-4d10-9297-3c3918317094 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:45.068522 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722d6f9-c4db-4d10-9297-3c3918317094 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:45.070390 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722d6f9-c4db-4d10-9297-3c3918317094 None admin] RBAC: Adding query filter params (role.id=38df38770b21458d87720d3c4c6f1ff1, scope.project.id=b533b81163ef4776a421230d7bc3e77c, user.id=6d0af1279acd4fe6bfca23f4ea06d5f8) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:45.070873 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722d6f9-c4db-4d10-9297-3c3918317094 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:45.072578 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722d6f9-c4db-4d10-9297-3c3918317094 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:45.079566 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 133/275] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:43:44 2022] GET /identity/v3/role_assignments?user.id=6d0af1279acd4fe6bfca23f4ea06d5f8&scope.project.id=b533b81163ef4776a421230d7bc3e77c&role.id=38df38770b21458d87720d3c4c6f1ff1 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:45.080718 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722d6f9-c4db-4d10-9297-3c3918317094 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:45.096110 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878329da-9100-4d76-90ca-f75c37b6e275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:45.097196 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878329da-9100-4d76-90ca-f75c37b6e275 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:45.097196 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878329da-9100-4d76-90ca-f75c37b6e275 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:45.097510 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878329da-9100-4d76-90ca-f75c37b6e275 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:45.098854 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878329da-9100-4d76-90ca-f75c37b6e275 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:45.100473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878329da-9100-4d76-90ca-f75c37b6e275 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:45.102894 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 143/276] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:43:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:43:45.103856 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878329da-9100-4d76-90ca-f75c37b6e275 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:45.208072 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722d6f9-c4db-4d10-9297-3c3918317094 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:45.228186 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878329da-9100-4d76-90ca-f75c37b6e275 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:45.249301 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa90b9-4c56-471f-9b16-73da699fd6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:45.250274 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa90b9-4c56-471f-9b16-73da699fd6ad None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:45.250542 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa90b9-4c56-471f-9b16-73da699fd6ad None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:45.250813 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa90b9-4c56-471f-9b16-73da699fd6ad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:45.262667 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaa90b9-4c56-471f-9b16-73da699fd6ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:45.267785 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-eeaa90b9-4c56-471f-9b16-73da699fd6ad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:43:45.267785 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:45.267785 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:45.267785 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:45.267785 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:45.267785 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:45.267785 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:45.267785 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:45.267785 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:45.267785 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:45.267785 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:45.267785 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:45.267785 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:45.267785 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:45.267785 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:45.267785 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:45.268759 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:45.268759 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:45.268759 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:45.268759 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:45.268759 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:45.268759 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:45.268759 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:45.268759 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:45.268759 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:45.268759 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:45.268759 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:45.268759 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:45.268759 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:45.268759 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:45.268759 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:45.268759 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:45.269568 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:45.269568 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:45.269568 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:45.269568 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:45.269568 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:45.269568 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:45.269568 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:45.269568 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:45.269568 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:45.269568 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:45.269568 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:43:45.269568 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:43:45.269568 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 134/277] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:43:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:43:45.270247 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa90b9-4c56-471f-9b16-73da699fd6ad None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:45.271246 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eafda5-dd55-4b28-90a4-bd13d61ec1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:45.272651 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eafda5-dd55-4b28-90a4-bd13d61ec1d4 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:45.273861 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eafda5-dd55-4b28-90a4-bd13d61ec1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:45.273861 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eafda5-dd55-4b28-90a4-bd13d61ec1d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:45.287372 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eafda5-dd55-4b28-90a4-bd13d61ec1d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:45.289161 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:45.293418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-20eafda5-dd55-4b28-90a4-bd13d61ec1d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:43:45.293418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:45.293418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:45.293418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:45.293418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:45.293418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:45.293418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:45.293418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:45.293418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:45.293418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:45.293418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:45.293418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:45.293418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:45.293418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:45.293418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:45.293418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:45.294348 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:45.294348 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:45.294348 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:45.294348 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:45.294348 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:45.294348 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:45.294348 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:45.294348 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:45.294348 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:45.294348 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:45.294348 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:45.294348 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:45.294348 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:45.294348 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:45.294348 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:45.294348 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:45.295152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:45.295152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:45.295152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:45.295152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:45.295152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:45.295152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:45.295152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:45.295152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:45.295152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:45.295152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:45.295152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:43:45.295152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:43:45.299474 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 144/278] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:43:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:43:45.303904 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eafda5-dd55-4b28-90a4-bd13d61ec1d4 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:45.361811 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:45.404052 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa90b9-4c56-471f-9b16-73da699fd6ad None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:45.425388 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eafda5-dd55-4b28-90a4-bd13d61ec1d4 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:45.441798 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1dd88a-3da3-4ea1-8480-0fa16f570097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:45.442853 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dd88a-3da3-4ea1-8480-0fa16f570097 None admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:45.443391 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dd88a-3da3-4ea1-8480-0fa16f570097 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:45.444407 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dd88a-3da3-4ea1-8480-0fa16f570097 None admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:45.445801 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1dd88a-3da3-4ea1-8480-0fa16f570097 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:45.448419 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1dd88a-3da3-4ea1-8480-0fa16f570097 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:45.463092 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95f615-fa06-4331-ac29-9fcc9e8c93fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:45.463637 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95f615-fa06-4331-ac29-9fcc9e8c93fc None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:45.463924 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95f615-fa06-4331-ac29-9fcc9e8c93fc None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:45.464199 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95f615-fa06-4331-ac29-9fcc9e8c93fc None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:45.464915 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95f615-fa06-4331-ac29-9fcc9e8c93fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:45.465222 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95f615-fa06-4331-ac29-9fcc9e8c93fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:45.466626 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95f615-fa06-4331-ac29-9fcc9e8c93fc None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:45.475972 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 145/279] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 24 15:43:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:45.479337 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95f615-fa06-4331-ac29-9fcc9e8c93fc None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:45.567326 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 135/280] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 24 15:43:45 2022] POST /identity/v3/users => generated 293 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:43:45.568373 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1dd88a-3da3-4ea1-8480-0fa16f570097 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:45.585282 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:45.590718 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95f615-fa06-4331-ac29-9fcc9e8c93fc None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:45.635745 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceae94c-76cc-432b-a458-e67e16e9b464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:45.636784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceae94c-76cc-432b-a458-e67e16e9b464 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:45.637301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceae94c-76cc-432b-a458-e67e16e9b464 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:45.637791 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceae94c-76cc-432b-a458-e67e16e9b464 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:45.638700 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceae94c-76cc-432b-a458-e67e16e9b464 None admin] RBAC: Adding query filter params (name=member) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:45.639239 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceae94c-76cc-432b-a458-e67e16e9b464 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:45.641096 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceae94c-76cc-432b-a458-e67e16e9b464 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:45.655301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 146/281] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 24 15:43:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:45.657569 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee0786-d1d5-45ea-b1f2-de9212817901 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:45.657860 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee0786-d1d5-45ea-b1f2-de9212817901 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:45.658138 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee0786-d1d5-45ea-b1f2-de9212817901 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:45.659836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 147/282] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:45.661392 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee0786-d1d5-45ea-b1f2-de9212817901 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:45.683209 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:45.737464 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1dd88a-3da3-4ea1-8480-0fa16f570097 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:45.783459 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee0786-d1d5-45ea-b1f2-de9212817901 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:45.784514 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4751b-8aea-4778-bde1-2f375a450968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:45.785319 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4751b-8aea-4778-bde1-2f375a450968 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:45.785601 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4751b-8aea-4778-bde1-2f375a450968 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:45.785988 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4751b-8aea-4778-bde1-2f375a450968 None admin] PATH_INFO: `/v3/users/04b63821a37440d9a04beafbe6aad2e1` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:45.787885 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4751b-8aea-4778-bde1-2f375a450968 None admin] RBAC: Authorizing `identity:get_user(user_id=04b63821a37440d9a04beafbe6aad2e1)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:45.789897 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4751b-8aea-4778-bde1-2f375a450968 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:45.792319 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 136/283] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:45 2022] GET /identity/v3/users/04b63821a37440d9a04beafbe6aad2e1 => generated 297 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:45.797026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c84c86-b671-4642-9378-c6ef7022d163 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:45.797026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c84c86-b671-4642-9378-c6ef7022d163 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:45.797026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c84c86-b671-4642-9378-c6ef7022d163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:45.814911 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-39c84c86-b671-4642-9378-c6ef7022d163 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:45.815668 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-39c84c86-b671-4642-9378-c6ef7022d163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:45.840500 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6abfe1-9bb7-4789-ae11-e018b97e85ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:45.841265 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6abfe1-9bb7-4789-ae11-e018b97e85ab None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:45.841478 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6abfe1-9bb7-4789-ae11-e018b97e85ab None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:45.841754 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6abfe1-9bb7-4789-ae11-e018b97e85ab None admin] PATH_INFO: `/v3/users/c5761b21be1843edb827a43b5e6e64e7` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:45.870729 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6abfe1-9bb7-4789-ae11-e018b97e85ab None admin] RBAC: Authorizing `identity:get_user(user_id=c5761b21be1843edb827a43b5e6e64e7)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:45.872231 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6abfe1-9bb7-4789-ae11-e018b97e85ab None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:45.874438 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 148/284] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:45 2022] GET /identity/v3/users/c5761b21be1843edb827a43b5e6e64e7 => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:43:45.880008 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6abfe1-9bb7-4789-ae11-e018b97e85ab None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:45.903823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:45.908823 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 137/285] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:45.909963 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c84c86-b671-4642-9378-c6ef7022d163 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:45.989461 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:46.029901 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6abfe1-9bb7-4789-ae11-e018b97e85ab None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:46.050355 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c84c86-b671-4642-9378-c6ef7022d163 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:46.080294 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e6161-14de-488c-bbbf-eb56f0f49bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:46.081402 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e6161-14de-488c-bbbf-eb56f0f49bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:46.082095 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e6161-14de-488c-bbbf-eb56f0f49bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:46.082643 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e6161-14de-488c-bbbf-eb56f0f49bf9 None admin] PATH_INFO: `/v3/projects/b533b81163ef4776a421230d7bc3e77c` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:46.085144 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e6161-14de-488c-bbbf-eb56f0f49bf9 None admin] RBAC: Authorizing `identity:get_project(project_id=b533b81163ef4776a421230d7bc3e77c)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:46.088056 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e6161-14de-488c-bbbf-eb56f0f49bf9 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:46.090956 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 149/286] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:43:45 2022] GET /identity/v3/projects/b533b81163ef4776a421230d7bc3e77c => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:46.101697 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e6161-14de-488c-bbbf-eb56f0f49bf9 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:46.120108 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae495b69-515e-49c3-90c8-9afdf1aee4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:46.121011 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae495b69-515e-49c3-90c8-9afdf1aee4db None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:46.121430 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae495b69-515e-49c3-90c8-9afdf1aee4db None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:46.121862 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae495b69-515e-49c3-90c8-9afdf1aee4db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:46.122741 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae495b69-515e-49c3-90c8-9afdf1aee4db None admin] RBAC: Adding query filter params (role.id=0ea43d9dfb184e27b48d251fd38463db, user.id=c5761b21be1843edb827a43b5e6e64e7, scope.system=all) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:46.123189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae495b69-515e-49c3-90c8-9afdf1aee4db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:46.124822 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae495b69-515e-49c3-90c8-9afdf1aee4db None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:46.135889 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 138/287] 10.222.0.64 () {56 vars in 1308 bytes} [Wed Aug 24 15:43:45 2022] GET /identity/v3/role_assignments?user.id=c5761b21be1843edb827a43b5e6e64e7&scope.system=all&role.id=0ea43d9dfb184e27b48d251fd38463db => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:46.216298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae495b69-515e-49c3-90c8-9afdf1aee4db None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:46.264660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:46.299953 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e6161-14de-488c-bbbf-eb56f0f49bf9 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:46.376649 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e2a53-8d35-44a4-b730-b9f2b8bb9c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:46.377866 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e2a53-8d35-44a4-b730-b9f2b8bb9c61 None admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:46.378352 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e2a53-8d35-44a4-b730-b9f2b8bb9c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:46.378853 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e2a53-8d35-44a4-b730-b9f2b8bb9c61 None admin] PATH_INFO: `/v3/projects/b533b81163ef4776a421230d7bc3e77c/users/04b63821a37440d9a04beafbe6aad2e1/roles/961096b573de42c18dfca520e82b2030` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:46.381434 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e2a53-8d35-44a4-b730-b9f2b8bb9c61 None admin] RBAC: Authorizing `identity:create_grant(project_id=b533b81163ef4776a421230d7bc3e77c, user_id=04b63821a37440d9a04beafbe6aad2e1, role_id=961096b573de42c18dfca520e82b2030)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:46.384177 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e2a53-8d35-44a4-b730-b9f2b8bb9c61 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:46.418266 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae495b69-515e-49c3-90c8-9afdf1aee4db None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:46.452994 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:46.471131 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 150/288] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 24 15:43:46 2022] PUT /identity/v3/projects/b533b81163ef4776a421230d7bc3e77c/users/04b63821a37440d9a04beafbe6aad2e1/roles/961096b573de42c18dfca520e82b2030 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:43:46.482994 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5d7f7-d085-43f8-b4ba-d4aafef34e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:46.484082 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5d7f7-d085-43f8-b4ba-d4aafef34e50 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:46.484581 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5d7f7-d085-43f8-b4ba-d4aafef34e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:46.485068 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5d7f7-d085-43f8-b4ba-d4aafef34e50 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:46.500929 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5d7f7-d085-43f8-b4ba-d4aafef34e50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:46.507084 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-56f5d7f7-d085-43f8-b4ba-d4aafef34e50 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:43:46.507084 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:46.507084 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:46.507084 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:46.507084 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:46.507084 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:46.507084 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:46.507084 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:46.507084 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:46.507084 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:46.507084 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:46.507084 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:46.507084 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:46.507084 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:46.507084 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:46.507084 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:46.508071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:46.508071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:46.508071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:46.508071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:46.508071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:46.508071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:46.508071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:46.508071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:46.508071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:46.508071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:46.508071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:46.508071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:46.508071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:46.508071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:46.508071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:46.508071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:46.508914 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:46.508914 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:46.508914 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:46.508914 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:46.508914 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:46.508914 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:46.508914 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:46.508914 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:46.508914 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:46.508914 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:46.508914 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:43:46.508914 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:43:46.519892 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 139/289] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:43:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:43:46.527509 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e2a53-8d35-44a4-b730-b9f2b8bb9c61 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:46.676834 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e2a53-8d35-44a4-b730-b9f2b8bb9c61 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:46.728249 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bfe0f-11be-4503-8728-d07e1db1b011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:46.728900 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bfe0f-11be-4503-8728-d07e1db1b011 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:46.729185 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bfe0f-11be-4503-8728-d07e1db1b011 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:46.729459 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bfe0f-11be-4503-8728-d07e1db1b011 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:46.730173 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bfe0f-11be-4503-8728-d07e1db1b011 None admin] RBAC: Adding query filter params (name=member) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:46.730480 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bfe0f-11be-4503-8728-d07e1db1b011 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:46.731889 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bfe0f-11be-4503-8728-d07e1db1b011 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:46.741736 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 151/290] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 24 15:43:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:46.747682 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5d7f7-d085-43f8-b4ba-d4aafef34e50 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:46.877574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5d7f7-d085-43f8-b4ba-d4aafef34e50 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:46.919535 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafb432-d257-447f-a384-ff06df72f26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:46.920541 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafb432-d257-447f-a384-ff06df72f26d None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:46.921205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafb432-d257-447f-a384-ff06df72f26d None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:46.921652 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafb432-d257-447f-a384-ff06df72f26d None admin] PATH_INFO: `/v3/users/3206c05639024e9ab22c2bf18e72aaf3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:46.923106 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dafb432-d257-447f-a384-ff06df72f26d None admin] RBAC: Authorizing `identity:get_user(user_id=3206c05639024e9ab22c2bf18e72aaf3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:46.924834 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dafb432-d257-447f-a384-ff06df72f26d None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:46.930271 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 140/291] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:46 2022] GET /identity/v3/users/3206c05639024e9ab22c2bf18e72aaf3 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:46.934131 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bfe0f-11be-4503-8728-d07e1db1b011 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:46.947249 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:47.069371 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bfe0f-11be-4503-8728-d07e1db1b011 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:47.124594 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93851cc-25e2-4425-996a-9b716e35a9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:47.125961 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93851cc-25e2-4425-996a-9b716e35a9e3 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:47.126447 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93851cc-25e2-4425-996a-9b716e35a9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:47.126892 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93851cc-25e2-4425-996a-9b716e35a9e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:47.224051 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93851cc-25e2-4425-996a-9b716e35a9e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:47.226474 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93851cc-25e2-4425-996a-9b716e35a9e3 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:47.244681 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:47.367997 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 152/292] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:43:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:47.371713 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafb432-d257-447f-a384-ff06df72f26d None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:47.447860 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:47.501937 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafb432-d257-447f-a384-ff06df72f26d None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:47.558434 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c43e05-5f32-4fb1-b55e-2d33fbcdc174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:47.559463 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c43e05-5f32-4fb1-b55e-2d33fbcdc174 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:47.559952 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c43e05-5f32-4fb1-b55e-2d33fbcdc174 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:47.560412 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c43e05-5f32-4fb1-b55e-2d33fbcdc174 None admin] PATH_INFO: `/v3/projects/b533b81163ef4776a421230d7bc3e77c` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:47.561798 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c43e05-5f32-4fb1-b55e-2d33fbcdc174 None admin] RBAC: Authorizing `identity:get_project(project_id=b533b81163ef4776a421230d7bc3e77c)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:47.563487 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c43e05-5f32-4fb1-b55e-2d33fbcdc174 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:47.565420 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 141/293] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:43:47 2022] GET /identity/v3/projects/b533b81163ef4776a421230d7bc3e77c => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:47.571973 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93851cc-25e2-4425-996a-9b716e35a9e3 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:47.734146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93851cc-25e2-4425-996a-9b716e35a9e3 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:47.747910 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:47.784714 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ec42c-4bb2-4c4a-a2a4-10bdaa9e443c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:47.785660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ec42c-4bb2-4c4a-a2a4-10bdaa9e443c None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:47.786151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ec42c-4bb2-4c4a-a2a4-10bdaa9e443c None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:47.786646 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ec42c-4bb2-4c4a-a2a4-10bdaa9e443c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:47.788923 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ec42c-4bb2-4c4a-a2a4-10bdaa9e443c None admin] RBAC: Adding query filter params (role.id=0ea43d9dfb184e27b48d251fd38463db, scope.project.id=b533b81163ef4776a421230d7bc3e77c, user.id=3206c05639024e9ab22c2bf18e72aaf3) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:47.792845 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ec42c-4bb2-4c4a-a2a4-10bdaa9e443c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:47.794362 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ec42c-4bb2-4c4a-a2a4-10bdaa9e443c None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:47.802322 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 153/294] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:43:47 2022] GET /identity/v3/role_assignments?user.id=3206c05639024e9ab22c2bf18e72aaf3&scope.project.id=b533b81163ef4776a421230d7bc3e77c&role.id=0ea43d9dfb184e27b48d251fd38463db => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:48.040214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9876b59-7c5d-46a7-8af8-7b29ed260377 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:48.040385 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9876b59-7c5d-46a7-8af8-7b29ed260377 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:48.040691 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9876b59-7c5d-46a7-8af8-7b29ed260377 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:48.042614 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 142/295] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:48.048827 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d69657-bddb-43b4-b81f-0768d6e4bca9 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:48.049282 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d69657-bddb-43b4-b81f-0768d6e4bca9 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:48.049726 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d69657-bddb-43b4-b81f-0768d6e4bca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:48.085463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-f6d69657-bddb-43b4-b81f-0768d6e4bca9 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:48.087290 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-f6d69657-bddb-43b4-b81f-0768d6e4bca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:48.165851 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f9311-1269-40ef-ade9-75c016ef766d None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:48.166201 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f9311-1269-40ef-ade9-75c016ef766d None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:48.166482 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f9311-1269-40ef-ade9-75c016ef766d None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:48.167905 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 143/296] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:43:48.174216 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398cf53-cae0-43a8-8fd5-3ecce1eac5f0 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:48.174510 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398cf53-cae0-43a8-8fd5-3ecce1eac5f0 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:48.174764 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398cf53-cae0-43a8-8fd5-3ecce1eac5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:48.180020 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 154/297] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:48.200892 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-7398cf53-cae0-43a8-8fd5-3ecce1eac5f0 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:48.202152 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-7398cf53-cae0-43a8-8fd5-3ecce1eac5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:48.305037 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 144/298] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:43:48.495707 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d69657-bddb-43b4-b81f-0768d6e4bca9 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:48.587656 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398cf53-cae0-43a8-8fd5-3ecce1eac5f0 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:48.608550 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d69657-bddb-43b4-b81f-0768d6e4bca9 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:48.610597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:48.651357 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac84bab-52be-4ca5-83e9-ff59f1183019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:48.652112 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac84bab-52be-4ca5-83e9-ff59f1183019 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:48.652651 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac84bab-52be-4ca5-83e9-ff59f1183019 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:48.653113 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac84bab-52be-4ca5-83e9-ff59f1183019 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:48.653247 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:48.665537 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac84bab-52be-4ca5-83e9-ff59f1183019 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:48.670582 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-0ac84bab-52be-4ca5-83e9-ff59f1183019 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:43:48.670582 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:48.670582 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:48.670582 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:48.670582 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:48.670582 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:48.670582 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:48.670582 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:48.670582 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:48.670582 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:48.670582 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:48.670582 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:48.670582 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:48.670582 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:48.670582 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:48.670582 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:48.671490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:48.671490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:48.671490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:48.671490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:48.671490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:48.671490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:48.671490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:48.671490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:48.671490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:48.671490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:48.671490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:48.671490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:48.671490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:48.671490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:48.671490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:48.671490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:48.672251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:48.672251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:48.672251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:48.672251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:48.672251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:48.672251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:48.672251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:48.672251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:48.672251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:48.672251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:48.672251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:43:48.672251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:43:48.672251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 155/299] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:43:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:43:48.677845 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac84bab-52be-4ca5-83e9-ff59f1183019 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:48.717258 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398cf53-cae0-43a8-8fd5-3ecce1eac5f0 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:48.759063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833a089-c107-4506-8ef3-65c26aeda2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:48.759698 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833a089-c107-4506-8ef3-65c26aeda2ba None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:48.760139 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833a089-c107-4506-8ef3-65c26aeda2ba None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:48.760702 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833a089-c107-4506-8ef3-65c26aeda2ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:48.762095 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833a089-c107-4506-8ef3-65c26aeda2ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:48.763695 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833a089-c107-4506-8ef3-65c26aeda2ba None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:48.765597 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 145/300] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:43:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:48.774975 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833a089-c107-4506-8ef3-65c26aeda2ba None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:48.789733 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac84bab-52be-4ca5-83e9-ff59f1183019 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:48.838641 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f62536-1305-4d2f-bee4-ce6bafdd443c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:48.839169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f62536-1305-4d2f-bee4-ce6bafdd443c None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:48.839870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f62536-1305-4d2f-bee4-ce6bafdd443c None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:48.840209 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f62536-1305-4d2f-bee4-ce6bafdd443c None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:48.841280 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f62536-1305-4d2f-bee4-ce6bafdd443c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:48.841592 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f62536-1305-4d2f-bee4-ce6bafdd443c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:48.843773 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f62536-1305-4d2f-bee4-ce6bafdd443c None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:48.856389 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 156/301] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 24 15:43:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:48.862982 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f62536-1305-4d2f-bee4-ce6bafdd443c None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:48.892392 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:48.913679 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833a089-c107-4506-8ef3-65c26aeda2ba None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:48.932916 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:48.953178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36d199-16d7-49b7-bd1b-114b2046c6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:48.953793 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36d199-16d7-49b7-bd1b-114b2046c6d3 None admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:48.954070 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36d199-16d7-49b7-bd1b-114b2046c6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:48.954340 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36d199-16d7-49b7-bd1b-114b2046c6d3 None admin] PATH_INFO: `/v3/groups` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:48.955037 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba36d199-16d7-49b7-bd1b-114b2046c6d3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:48.956498 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba36d199-16d7-49b7-bd1b-114b2046c6d3 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:48.985760 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f62536-1305-4d2f-bee4-ce6bafdd443c None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:49.020988 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5193eb-c5da-49d8-bb7d-5f315537525d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:49.022246 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5193eb-c5da-49d8-bb7d-5f315537525d None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:49.022531 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5193eb-c5da-49d8-bb7d-5f315537525d None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:49.022801 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5193eb-c5da-49d8-bb7d-5f315537525d None admin] PATH_INFO: `/v3/users/1e54b4ea554a4d90905d8d446654f5ba` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:49.036379 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 146/302] 10.222.0.64 () {60 vars in 1134 bytes} [Wed Aug 24 15:43:48 2022] POST /identity/v3/groups => generated 229 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:43:49.037983 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0c429-7c19-43ab-b340-0c9c71109daf None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:49.038318 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0c429-7c19-43ab-b340-0c9c71109daf None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:49.038956 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0c429-7c19-43ab-b340-0c9c71109daf None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:49.040257 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 147/303] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:49.043879 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5193eb-c5da-49d8-bb7d-5f315537525d None admin] RBAC: Authorizing `identity:get_user(user_id=1e54b4ea554a4d90905d8d446654f5ba)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:49.046173 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5613ef-d002-435f-b443-955b019e520b None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:49.046556 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5613ef-d002-435f-b443-955b019e520b None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:49.046723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5193eb-c5da-49d8-bb7d-5f315537525d None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:49.047047 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5613ef-d002-435f-b443-955b019e520b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:49.055352 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 157/304] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:48 2022] GET /identity/v3/users/1e54b4ea554a4d90905d8d446654f5ba => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:49.057396 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5193eb-c5da-49d8-bb7d-5f315537525d None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:49.076072 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-8b5613ef-d002-435f-b443-955b019e520b None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:49.077486 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-8b5613ef-d002-435f-b443-955b019e520b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:49.164777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 148/305] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:49.166098 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac023de-794f-42f3-a770-71524dd01753 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:49.166383 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac023de-794f-42f3-a770-71524dd01753 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:49.166653 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac023de-794f-42f3-a770-71524dd01753 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:49.172076 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 149/306] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:49.173685 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab97349-b257-42d9-a136-211679f9322d None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:49.174081 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab97349-b257-42d9-a136-211679f9322d None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:49.174472 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab97349-b257-42d9-a136-211679f9322d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:49.178282 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:49.195656 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-aab97349-b257-42d9-a136-211679f9322d None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:49.197139 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-aab97349-b257-42d9-a136-211679f9322d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:49.210901 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5193eb-c5da-49d8-bb7d-5f315537525d None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:49.268504 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d513339-f004-4c26-8a2c-fc0a2b6f2ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:49.272233 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d513339-f004-4c26-8a2c-fc0a2b6f2ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:49.272233 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d513339-f004-4c26-8a2c-fc0a2b6f2ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:49.272233 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d513339-f004-4c26-8a2c-fc0a2b6f2ae6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:49.272233 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d513339-f004-4c26-8a2c-fc0a2b6f2ae6 None admin] RBAC: Adding query filter params (role.id=961096b573de42c18dfca520e82b2030, user.id=1e54b4ea554a4d90905d8d446654f5ba, scope.system=all) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:49.272233 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d513339-f004-4c26-8a2c-fc0a2b6f2ae6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:49.273191 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d513339-f004-4c26-8a2c-fc0a2b6f2ae6 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:49.283933 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 158/307] 10.222.0.64 () {56 vars in 1308 bytes} [Wed Aug 24 15:43:49 2022] GET /identity/v3/role_assignments?user.id=1e54b4ea554a4d90905d8d446654f5ba&scope.system=all&role.id=961096b573de42c18dfca520e82b2030 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:49.291730 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 150/308] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:43:49.439106 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d513339-f004-4c26-8a2c-fc0a2b6f2ae6 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:49.547656 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d513339-f004-4c26-8a2c-fc0a2b6f2ae6 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:49.580897 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab97349-b257-42d9-a136-211679f9322d None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:49.585142 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5ef43-db90-4b16-ad23-050797df4e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:49.585972 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5ef43-db90-4b16-ad23-050797df4e04 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:49.586245 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5ef43-db90-4b16-ad23-050797df4e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:49.586507 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5ef43-db90-4b16-ad23-050797df4e04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:49.599507 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5ef43-db90-4b16-ad23-050797df4e04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:49.604307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-f9b5ef43-db90-4b16-ad23-050797df4e04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:43:49.604307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:49.604307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:49.604307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:49.604307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:49.604307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:49.604307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:49.604307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:49.604307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:49.604307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:49.604307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:49.604307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:49.604307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:49.604307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:49.604307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:49.604307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:49.606501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:49.606501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:49.606501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:49.606501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:49.606501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:49.606501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:49.606501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:49.606501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:49.606501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:49.606501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:49.606501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:49.606501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:49.606501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:49.606501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:49.606501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:49.606501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:49.608473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:49.608473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:49.608473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:49.608473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:49.608473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:49.608473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:49.608473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:49.608473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:49.608473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:49.608473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:49.608473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:43:49.608473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:43:49.608473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 159/309] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:43:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:43:49.611485 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5ef43-db90-4b16-ad23-050797df4e04 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:49.621016 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:49.633548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:49.702763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab97349-b257-42d9-a136-211679f9322d None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:49.748256 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd16f2-7559-42ec-a023-9b251e4f1ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:49.749141 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd16f2-7559-42ec-a023-9b251e4f1ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:49.749363 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd16f2-7559-42ec-a023-9b251e4f1ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:49.749704 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd16f2-7559-42ec-a023-9b251e4f1ec5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:49.757479 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5ef43-db90-4b16-ad23-050797df4e04 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:49.762255 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd16f2-7559-42ec-a023-9b251e4f1ec5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:49.767222 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-a3fd16f2-7559-42ec-a023-9b251e4f1ec5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:43:49.767222 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:49.767222 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:49.767222 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:49.767222 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:49.767222 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:49.767222 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:49.767222 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:49.767222 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:49.767222 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:49.767222 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:49.767222 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:49.767222 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:49.767222 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:49.767222 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:49.767222 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:49.768365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:49.768365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:49.768365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:49.768365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:49.768365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:49.768365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:49.768365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:49.768365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:49.768365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:49.768365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:49.768365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:49.768365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:49.768365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:49.768365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:49.768365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:49.768365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:49.769372 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:49.769372 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:49.769372 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:49.769372 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:49.769372 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:49.769372 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:49.769372 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:49.769372 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:49.769372 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:49.769372 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:49.769372 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:43:49.769372 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:43:49.770894 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 151/310] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:43:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:43:49.777706 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd16f2-7559-42ec-a023-9b251e4f1ec5 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:49.808695 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82150f-18de-4f45-b4e3-bca8c79d7ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:49.809983 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82150f-18de-4f45-b4e3-bca8c79d7ee1 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:49.810669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82150f-18de-4f45-b4e3-bca8c79d7ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:49.811110 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82150f-18de-4f45-b4e3-bca8c79d7ee1 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:49.812186 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82150f-18de-4f45-b4e3-bca8c79d7ee1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:49.813027 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82150f-18de-4f45-b4e3-bca8c79d7ee1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:49.814850 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82150f-18de-4f45-b4e3-bca8c79d7ee1 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:49.828372 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 160/311] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 24 15:43:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:43:49.834245 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82150f-18de-4f45-b4e3-bca8c79d7ee1 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:49.892569 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:49.897120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd16f2-7559-42ec-a023-9b251e4f1ec5 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:49.931689 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:49.935232 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf8448-0558-44ba-9ab1-2564c4bd8521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:49.936101 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf8448-0558-44ba-9ab1-2564c4bd8521 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:49.936824 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf8448-0558-44ba-9ab1-2564c4bd8521 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:49.938090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf8448-0558-44ba-9ab1-2564c4bd8521 None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:49.938936 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf8448-0558-44ba-9ab1-2564c4bd8521 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:49.939399 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf8448-0558-44ba-9ab1-2564c4bd8521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:49.941150 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf8448-0558-44ba-9ab1-2564c4bd8521 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:49.953461 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 152/312] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 24 15:43:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:49.961722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf8448-0558-44ba-9ab1-2564c4bd8521 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:49.978465 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82150f-18de-4f45-b4e3-bca8c79d7ee1 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:50.025401 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976a26f-c21c-4eeb-83d2-ceefbea22aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:50.026765 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976a26f-c21c-4eeb-83d2-ceefbea22aab None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:50.027519 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976a26f-c21c-4eeb-83d2-ceefbea22aab None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:50.027976 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976a26f-c21c-4eeb-83d2-ceefbea22aab None admin] PATH_INFO: `/v3/users/c5761b21be1843edb827a43b5e6e64e7` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:50.029890 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976a26f-c21c-4eeb-83d2-ceefbea22aab None admin] RBAC: Authorizing `identity:get_user(user_id=c5761b21be1843edb827a43b5e6e64e7)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:50.032305 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976a26f-c21c-4eeb-83d2-ceefbea22aab None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:50.040027 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 161/313] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:49 2022] GET /identity/v3/users/c5761b21be1843edb827a43b5e6e64e7 => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:43:50.041788 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976a26f-c21c-4eeb-83d2-ceefbea22aab None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:50.080968 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf8448-0558-44ba-9ab1-2564c4bd8521 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:50.136859 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3257d82-afb3-4adc-ab4b-f8513913a2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:50.138109 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3257d82-afb3-4adc-ab4b-f8513913a2b8 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:50.138584 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3257d82-afb3-4adc-ab4b-f8513913a2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:50.139038 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3257d82-afb3-4adc-ab4b-f8513913a2b8 None admin] PATH_INFO: `/v3/users/04b63821a37440d9a04beafbe6aad2e1` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:50.141344 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3257d82-afb3-4adc-ab4b-f8513913a2b8 None admin] RBAC: Authorizing `identity:get_user(user_id=04b63821a37440d9a04beafbe6aad2e1)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:50.142999 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3257d82-afb3-4adc-ab4b-f8513913a2b8 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:50.145159 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 153/314] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:49 2022] GET /identity/v3/users/04b63821a37440d9a04beafbe6aad2e1 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:50.153626 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3257d82-afb3-4adc-ab4b-f8513913a2b8 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:50.181473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976a26f-c21c-4eeb-83d2-ceefbea22aab None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:50.199069 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:50.228428 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb3c14-3dc4-4672-9ea9-0fcea5923fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:50.229353 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb3c14-3dc4-4672-9ea9-0fcea5923fe6 None admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:50.229711 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb3c14-3dc4-4672-9ea9-0fcea5923fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:50.230110 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb3c14-3dc4-4672-9ea9-0fcea5923fe6 None admin] PATH_INFO: `/v3/system/users/c5761b21be1843edb827a43b5e6e64e7/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:50.232074 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb3c14-3dc4-4672-9ea9-0fcea5923fe6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c5761b21be1843edb827a43b5e6e64e7, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:50.233867 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb3c14-3dc4-4672-9ea9-0fcea5923fe6 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:50.241627 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:50.301903 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3257d82-afb3-4adc-ab4b-f8513913a2b8 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:50.343085 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be5129-dac0-4275-9052-c322095b7812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:50.343739 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be5129-dac0-4275-9052-c322095b7812 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:50.344017 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be5129-dac0-4275-9052-c322095b7812 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:50.344290 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be5129-dac0-4275-9052-c322095b7812 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:50.356950 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 162/315] 10.222.0.64 () {58 vars in 1334 bytes} [Wed Aug 24 15:43:50 2022] PUT /identity/v3/system/users/c5761b21be1843edb827a43b5e6e64e7/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:43:50.435113 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be5129-dac0-4275-9052-c322095b7812 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:50.436672 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be5129-dac0-4275-9052-c322095b7812 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:50.481105 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:50.559278 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 154/316] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:43:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 15:43:50.565114 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb3c14-3dc4-4672-9ea9-0fcea5923fe6 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:50.679098 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb3c14-3dc4-4672-9ea9-0fcea5923fe6 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:50.717337 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c2aa6-55ad-4217-95c2-af32f473aaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:50.718534 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c2aa6-55ad-4217-95c2-af32f473aaf0 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:50.719082 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c2aa6-55ad-4217-95c2-af32f473aaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:50.719558 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c2aa6-55ad-4217-95c2-af32f473aaf0 None admin] PATH_INFO: `/v3/projects/b533b81163ef4776a421230d7bc3e77c` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:50.721003 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c2aa6-55ad-4217-95c2-af32f473aaf0 None admin] RBAC: Authorizing `identity:get_project(project_id=b533b81163ef4776a421230d7bc3e77c)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:50.722665 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c2aa6-55ad-4217-95c2-af32f473aaf0 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:50.725129 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 163/317] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:43:50 2022] GET /identity/v3/projects/b533b81163ef4776a421230d7bc3e77c => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:50.731306 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be5129-dac0-4275-9052-c322095b7812 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:50.852601 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be5129-dac0-4275-9052-c322095b7812 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:50.880370 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:50.891191 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f81fb-76df-4893-ad4d-25f68e5cdf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:50.891750 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f81fb-76df-4893-ad4d-25f68e5cdf26 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:50.892037 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f81fb-76df-4893-ad4d-25f68e5cdf26 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:50.892313 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f81fb-76df-4893-ad4d-25f68e5cdf26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:50.897874 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f81fb-76df-4893-ad4d-25f68e5cdf26 None admin] RBAC: Adding query filter params (role.id=961096b573de42c18dfca520e82b2030, scope.project.id=b533b81163ef4776a421230d7bc3e77c, user.id=04b63821a37440d9a04beafbe6aad2e1) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:50.897874 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f81fb-76df-4893-ad4d-25f68e5cdf26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:50.897874 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f81fb-76df-4893-ad4d-25f68e5cdf26 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:50.903017 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 155/318] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:43:50 2022] GET /identity/v3/role_assignments?user.id=04b63821a37440d9a04beafbe6aad2e1&scope.project.id=b533b81163ef4776a421230d7bc3e77c&role.id=961096b573de42c18dfca520e82b2030 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:51.154362 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5be5f8-6bb0-43c7-b595-27facb6b0622 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:51.154549 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5be5f8-6bb0-43c7-b595-27facb6b0622 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:51.154966 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5be5f8-6bb0-43c7-b595-27facb6b0622 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:51.156353 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 164/319] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:51.162292 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3ee7e-b9cd-4527-981e-591bc0e3b2ad None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:51.162584 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3ee7e-b9cd-4527-981e-591bc0e3b2ad None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:51.162848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3ee7e-b9cd-4527-981e-591bc0e3b2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:51.183196 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-dfc3ee7e-b9cd-4527-981e-591bc0e3b2ad None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:51.184330 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-dfc3ee7e-b9cd-4527-981e-591bc0e3b2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:51.256751 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 156/320] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:51.312799 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288f789-36ec-4f91-b21c-5f9f3220a4b8 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:51.313282 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288f789-36ec-4f91-b21c-5f9f3220a4b8 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:51.313357 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288f789-36ec-4f91-b21c-5f9f3220a4b8 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:51.314804 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 165/321] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:51.321033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8264222-fa0a-4971-a12d-af06a8e7f6e1 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:51.321306 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8264222-fa0a-4971-a12d-af06a8e7f6e1 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:51.321579 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8264222-fa0a-4971-a12d-af06a8e7f6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:51.340395 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-f8264222-fa0a-4971-a12d-af06a8e7f6e1 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:51.341619 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-f8264222-fa0a-4971-a12d-af06a8e7f6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:51.419914 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 157/322] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:51.524385 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288f789-36ec-4f91-b21c-5f9f3220a4b8 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:51.604162 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:51.643800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288f789-36ec-4f91-b21c-5f9f3220a4b8 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:51.680335 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787776f-bb8d-43cb-9594-5625127a4522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:51.680916 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787776f-bb8d-43cb-9594-5625127a4522 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:51.681193 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787776f-bb8d-43cb-9594-5625127a4522 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:51.681460 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787776f-bb8d-43cb-9594-5625127a4522 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:51.682575 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787776f-bb8d-43cb-9594-5625127a4522 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:51.684012 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787776f-bb8d-43cb-9594-5625127a4522 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:51.685656 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 166/323] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:43:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:51.691418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8264222-fa0a-4971-a12d-af06a8e7f6e1 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:51.705034 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787776f-bb8d-43cb-9594-5625127a4522 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:51.799516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:51.818396 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787776f-bb8d-43cb-9594-5625127a4522 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:51.852126 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8264222-fa0a-4971-a12d-af06a8e7f6e1 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:51.857926 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc6810-30db-4cc0-a85e-f0f34548dc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:51.858567 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc6810-30db-4cc0-a85e-f0f34548dc2b None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:51.858847 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc6810-30db-4cc0-a85e-f0f34548dc2b None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:51.859114 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc6810-30db-4cc0-a85e-f0f34548dc2b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:51.862420 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:51.872964 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc6810-30db-4cc0-a85e-f0f34548dc2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:51.878704 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-99fc6810-30db-4cc0-a85e-f0f34548dc2b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:43:51.878704 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:51.878704 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:51.878704 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:51.878704 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:51.878704 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:51.878704 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:51.878704 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:51.878704 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:51.878704 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:51.878704 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:51.878704 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:51.878704 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:51.878704 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:51.878704 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:51.878704 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:51.879606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:51.879606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:51.879606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:51.879606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:51.879606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:51.879606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:51.879606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:51.879606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:51.879606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:51.879606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:51.879606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:51.879606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:51.879606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:51.879606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:51.879606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:51.879606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:51.880382 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:51.880382 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:51.880382 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:51.880382 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:51.880382 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:51.880382 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:51.880382 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:51.880382 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:51.880382 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:51.880382 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:51.880382 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:43:51.880382 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:43:51.885000 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 167/324] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:43:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:43:51.885973 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc6810-30db-4cc0-a85e-f0f34548dc2b None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:51.896007 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d4016-d396-4c78-9078-eebe86257bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:51.897082 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d4016-d396-4c78-9078-eebe86257bef None admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:51.897363 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d4016-d396-4c78-9078-eebe86257bef None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:51.897638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d4016-d396-4c78-9078-eebe86257bef None admin] PATH_INFO: `/v3/groups` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:51.898266 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d4016-d396-4c78-9078-eebe86257bef None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:51.899790 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d4016-d396-4c78-9078-eebe86257bef None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:51.988179 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 158/325] 10.222.0.64 () {60 vars in 1134 bytes} [Wed Aug 24 15:43:51 2022] POST /identity/v3/groups => generated 226 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:43:52.011501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc6810-30db-4cc0-a85e-f0f34548dc2b None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:52.052318 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ac8a1-662a-4516-b8d4-b32f50b474e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:52.054137 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ac8a1-662a-4516-b8d4-b32f50b474e5 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:52.054416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ac8a1-662a-4516-b8d4-b32f50b474e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:52.054684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ac8a1-662a-4516-b8d4-b32f50b474e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:52.055370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ac8a1-662a-4516-b8d4-b32f50b474e5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:52.055669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ac8a1-662a-4516-b8d4-b32f50b474e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:52.057258 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ac8a1-662a-4516-b8d4-b32f50b474e5 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:52.068414 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 168/326] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 24 15:43:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:52.074460 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d4016-d396-4c78-9078-eebe86257bef None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:52.205125 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d4016-d396-4c78-9078-eebe86257bef None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:52.220827 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:52.242923 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc3894-6f60-4431-9d82-a32f10107585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:52.243478 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc3894-6f60-4431-9d82-a32f10107585 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:52.243758 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc3894-6f60-4431-9d82-a32f10107585 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:52.244028 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc3894-6f60-4431-9d82-a32f10107585 None admin] PATH_INFO: `/v3/users/1e54b4ea554a4d90905d8d446654f5ba` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:52.245210 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc3894-6f60-4431-9d82-a32f10107585 None admin] RBAC: Authorizing `identity:get_user(user_id=1e54b4ea554a4d90905d8d446654f5ba)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:52.246752 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc3894-6f60-4431-9d82-a32f10107585 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:52.248811 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 159/327] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:52 2022] GET /identity/v3/users/1e54b4ea554a4d90905d8d446654f5ba => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:52.254488 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ac8a1-662a-4516-b8d4-b32f50b474e5 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:52.348532 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:52.411010 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ac8a1-662a-4516-b8d4-b32f50b474e5 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:52.452102 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93df6a-1eb1-4cc1-b4f8-37cf5d2782ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:52.452815 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93df6a-1eb1-4cc1-b4f8-37cf5d2782ab None admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:52.453101 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93df6a-1eb1-4cc1-b4f8-37cf5d2782ab None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:52.453376 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93df6a-1eb1-4cc1-b4f8-37cf5d2782ab None admin] PATH_INFO: `/v3/system/users/1e54b4ea554a4d90905d8d446654f5ba/roles/961096b573de42c18dfca520e82b2030` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:52.454842 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93df6a-1eb1-4cc1-b4f8-37cf5d2782ab None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1e54b4ea554a4d90905d8d446654f5ba, role_id=961096b573de42c18dfca520e82b2030)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:52.456347 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93df6a-1eb1-4cc1-b4f8-37cf5d2782ab None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:52.469435 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc3962-3eca-4739-b0e8-99de1b6e87f2 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:52.469719 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc3962-3eca-4739-b0e8-99de1b6e87f2 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:52.475507 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc3962-3eca-4739-b0e8-99de1b6e87f2 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:52.475507 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 160/328] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:52.478361 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61182b2b-ef9e-4222-872e-ac47dca30147 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:52.478657 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61182b2b-ef9e-4222-872e-ac47dca30147 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:52.478933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61182b2b-ef9e-4222-872e-ac47dca30147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:52.508940 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-61182b2b-ef9e-4222-872e-ac47dca30147 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:52.508940 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-61182b2b-ef9e-4222-872e-ac47dca30147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:52.527866 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 169/329] 10.222.0.64 () {58 vars in 1334 bytes} [Wed Aug 24 15:43:52 2022] PUT /identity/v3/system/users/1e54b4ea554a4d90905d8d446654f5ba/roles/961096b573de42c18dfca520e82b2030 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:43:52.605667 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 161/330] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:43:52.918037 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93df6a-1eb1-4cc1-b4f8-37cf5d2782ab None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:53.033272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93df6a-1eb1-4cc1-b4f8-37cf5d2782ab None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:53.059171 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:53.076394 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44704d29-a5c5-475d-8192-8241dd585d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:53.077081 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44704d29-a5c5-475d-8192-8241dd585d9c None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:53.077366 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44704d29-a5c5-475d-8192-8241dd585d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:53.078816 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44704d29-a5c5-475d-8192-8241dd585d9c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:53.092056 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44704d29-a5c5-475d-8192-8241dd585d9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:53.100272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-44704d29-a5c5-475d-8192-8241dd585d9c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:43:53.100272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:53.100272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:53.100272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:53.100272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:53.100272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:53.100272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:53.100272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:53.100272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:53.100272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:53.100272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:53.100272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:53.100272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:53.100272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:53.100272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:53.100272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:53.101235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:53.101235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:53.101235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:53.101235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:53.101235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:53.101235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:53.101235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:53.101235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:53.101235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:53.101235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:53.101235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:53.101235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:53.101235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:53.101235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:53.101235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:53.101235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:53.101988 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:53.101988 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:53.101988 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:53.101988 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:53.101988 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:53.101988 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:53.101988 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:53.101988 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:53.101988 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:53.101988 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:53.101988 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:43:53.101988 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:43:53.101988 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 170/331] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:43:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:43:53.107539 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61182b2b-ef9e-4222-872e-ac47dca30147 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:53.274580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61182b2b-ef9e-4222-872e-ac47dca30147 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:53.292663 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:53.321910 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e71d2b-4488-4ad4-9f57-3580be0cdf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:53.322534 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e71d2b-4488-4ad4-9f57-3580be0cdf38 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:53.322811 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e71d2b-4488-4ad4-9f57-3580be0cdf38 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:53.323081 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e71d2b-4488-4ad4-9f57-3580be0cdf38 None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:53.323751 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e71d2b-4488-4ad4-9f57-3580be0cdf38 None admin] RBAC: Adding query filter params (name=member) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:53.324050 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e71d2b-4488-4ad4-9f57-3580be0cdf38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:53.325500 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e71d2b-4488-4ad4-9f57-3580be0cdf38 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:53.335435 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 162/332] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 24 15:43:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:53.341014 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44704d29-a5c5-475d-8192-8241dd585d9c None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:53.480796 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44704d29-a5c5-475d-8192-8241dd585d9c None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:53.526063 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b1df6-6e30-4fc7-b8ed-035fd4b34b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:53.527058 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b1df6-6e30-4fc7-b8ed-035fd4b34b6b None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:53.527588 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b1df6-6e30-4fc7-b8ed-035fd4b34b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:53.528074 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b1df6-6e30-4fc7-b8ed-035fd4b34b6b None admin] PATH_INFO: `/v3/users/c5761b21be1843edb827a43b5e6e64e7` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:53.529525 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b1df6-6e30-4fc7-b8ed-035fd4b34b6b None admin] RBAC: Authorizing `identity:get_user(user_id=c5761b21be1843edb827a43b5e6e64e7)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:53.531199 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b1df6-6e30-4fc7-b8ed-035fd4b34b6b None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:53.533504 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 171/333] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:53 2022] GET /identity/v3/users/c5761b21be1843edb827a43b5e6e64e7 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:53.540103 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e71d2b-4488-4ad4-9f57-3580be0cdf38 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:53.697261 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e71d2b-4488-4ad4-9f57-3580be0cdf38 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:53.744364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17254d5-b651-4f62-a8b7-9ea529849f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:53.745372 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17254d5-b651-4f62-a8b7-9ea529849f1b None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:53.745857 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17254d5-b651-4f62-a8b7-9ea529849f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:53.746477 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17254d5-b651-4f62-a8b7-9ea529849f1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:53.747427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17254d5-b651-4f62-a8b7-9ea529849f1b None admin] RBAC: Adding query filter params (role.id=0ea43d9dfb184e27b48d251fd38463db, user.id=c5761b21be1843edb827a43b5e6e64e7, scope.system=all) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:53.747943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17254d5-b651-4f62-a8b7-9ea529849f1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:53.749659 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17254d5-b651-4f62-a8b7-9ea529849f1b None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:53.768425 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 163/334] 10.222.0.64 () {56 vars in 1308 bytes} [Wed Aug 24 15:43:53 2022] GET /identity/v3/role_assignments?user.id=c5761b21be1843edb827a43b5e6e64e7&scope.system=all&role.id=0ea43d9dfb184e27b48d251fd38463db => generated 510 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:43:54.928546 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc4a8d-0ba5-4fc0-8fae-2b48b5967cbc None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:54.929604 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc4a8d-0ba5-4fc0-8fae-2b48b5967cbc None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:54.930080 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc4a8d-0ba5-4fc0-8fae-2b48b5967cbc None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:54.931946 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 172/335] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:54.938183 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942967e6-e01a-4f5b-acc5-45c4b78411b5 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:54.939106 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942967e6-e01a-4f5b-acc5-45c4b78411b5 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:54.939571 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942967e6-e01a-4f5b-acc5-45c4b78411b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:54.963206 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-942967e6-e01a-4f5b-acc5-45c4b78411b5 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:54.964791 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-942967e6-e01a-4f5b-acc5-45c4b78411b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:54.998514 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:55.051465 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 164/336] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:55.085279 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4f3e4-4a0c-4a7f-9e66-4aa704da8c7e None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:55.085592 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4f3e4-4a0c-4a7f-9e66-4aa704da8c7e None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:55.085824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4f3e4-4a0c-4a7f-9e66-4aa704da8c7e None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:55.087331 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 173/337] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:55.092973 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35390cc9-d6a5-4285-bfc9-3dd7970d2cc8 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:55.093255 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35390cc9-d6a5-4285-bfc9-3dd7970d2cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:55.093526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35390cc9-d6a5-4285-bfc9-3dd7970d2cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:55.113769 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-35390cc9-d6a5-4285-bfc9-3dd7970d2cc8 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:55.114998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-35390cc9-d6a5-4285-bfc9-3dd7970d2cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:55.210033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 165/338] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:55.319406 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db126e8f-8759-454f-9ec1-4f135a9f65b1 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:55.319771 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db126e8f-8759-454f-9ec1-4f135a9f65b1 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:55.320126 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db126e8f-8759-454f-9ec1-4f135a9f65b1 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:55.321751 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 174/339] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:55.327882 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479876ec-4f63-4979-830a-3df208ccb255 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:55.328481 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479876ec-4f63-4979-830a-3df208ccb255 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:55.328983 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479876ec-4f63-4979-830a-3df208ccb255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:55.356736 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-479876ec-4f63-4979-830a-3df208ccb255 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:55.358295 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-479876ec-4f63-4979-830a-3df208ccb255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:55.391936 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1539fce-432a-478f-b74b-1d8ac8affcdc None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:55.392549 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1539fce-432a-478f-b74b-1d8ac8affcdc None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:55.393059 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1539fce-432a-478f-b74b-1d8ac8affcdc None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:55.394606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 175/340] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:55.401834 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3673c3-d87b-4167-8cdd-efd0b06cd8a4 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:55.402471 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3673c3-d87b-4167-8cdd-efd0b06cd8a4 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:55.402949 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3673c3-d87b-4167-8cdd-efd0b06cd8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:55.426982 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-bc3673c3-d87b-4167-8cdd-efd0b06cd8a4 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:55.429467 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-bc3673c3-d87b-4167-8cdd-efd0b06cd8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:55.467953 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 166/341] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:55.495163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:55.509284 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 176/342] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:43:55.515494 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479876ec-4f63-4979-830a-3df208ccb255 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:55.550989 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:55.657575 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3673c3-d87b-4167-8cdd-efd0b06cd8a4 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:55.703582 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479876ec-4f63-4979-830a-3df208ccb255 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:55.752887 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b6e0b-e441-4623-a6b2-40ff46682100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:55.754190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b6e0b-e441-4623-a6b2-40ff46682100 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:55.754721 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b6e0b-e441-4623-a6b2-40ff46682100 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:55.756011 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b6e0b-e441-4623-a6b2-40ff46682100 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:55.772796 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b6e0b-e441-4623-a6b2-40ff46682100 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:55.781662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-a91b6e0b-e441-4623-a6b2-40ff46682100 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:43:55.781662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:55.781662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:55.781662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:55.781662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:55.781662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:55.781662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:55.781662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:55.781662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:55.781662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:55.781662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:55.781662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:55.781662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:55.781662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:55.781662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:55.781662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:55.782592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:55.782592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:55.782592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:55.782592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:55.782592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:55.782592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:55.782592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:55.782592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:55.782592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:55.782592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:55.782592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:55.782592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:55.782592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:55.782592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:55.782592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:55.782592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:55.783373 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:55.783373 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:55.783373 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:55.783373 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:55.783373 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:55.783373 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:55.783373 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:55.783373 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:55.783373 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:55.783373 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:55.783373 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:43:55.783373 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:43:55.786252 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 167/343] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:43:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:43:55.793816 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b6e0b-e441-4623-a6b2-40ff46682100 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:55.846186 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3673c3-d87b-4167-8cdd-efd0b06cd8a4 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:55.915190 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44b470-7645-4bf7-b1b6-2a182a9249df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:55.916238 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44b470-7645-4bf7-b1b6-2a182a9249df None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:55.916803 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44b470-7645-4bf7-b1b6-2a182a9249df None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:55.917266 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44b470-7645-4bf7-b1b6-2a182a9249df None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:55.930312 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44b470-7645-4bf7-b1b6-2a182a9249df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:55.938041 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-9f44b470-7645-4bf7-b1b6-2a182a9249df None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:43:55.938041 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:55.938041 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:55.938041 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:55.938041 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:55.938041 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:55.938041 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:55.938041 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:55.938041 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:55.938041 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:55.938041 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:55.938041 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:55.938041 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:55.938041 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:55.938041 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:55.938041 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:55.938910 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:55.938910 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:55.938910 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:55.938910 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:55.938910 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:55.938910 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:55.938910 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:55.938910 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:55.938910 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:55.938910 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:55.938910 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:55.938910 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:55.938910 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:55.938910 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:55.938910 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:55.938910 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:55.939681 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:55.939681 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:55.939681 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:55.939681 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:55.939681 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:55.939681 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:55.939681 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:55.939681 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:55.939681 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:55.939681 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:55.939681 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:43:55.939681 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:43:55.942504 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 177/344] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 24 15:43:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:43:55.944896 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44b470-7645-4bf7-b1b6-2a182a9249df None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:55.981287 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:55.997336 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:56.016495 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b6e0b-e441-4623-a6b2-40ff46682100 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:56.053595 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5de81-8ec7-4e83-b9af-b635cf4fe1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:56.054465 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5de81-8ec7-4e83-b9af-b635cf4fe1bc None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:56.054884 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5de81-8ec7-4e83-b9af-b635cf4fe1bc None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:56.055297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5de81-8ec7-4e83-b9af-b635cf4fe1bc None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:56.056139 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5de81-8ec7-4e83-b9af-b635cf4fe1bc None admin] RBAC: Adding query filter params (name=member) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:56.056583 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5de81-8ec7-4e83-b9af-b635cf4fe1bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:56.058140 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5de81-8ec7-4e83-b9af-b635cf4fe1bc None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:56.068663 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44b470-7645-4bf7-b1b6-2a182a9249df None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:56.069315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 168/345] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 24 15:43:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:43:56.070334 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5de81-8ec7-4e83-b9af-b635cf4fe1bc None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:56.109659 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45513c2-5de7-4823-9d82-42b653a4f4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:56.110303 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45513c2-5de7-4823-9d82-42b653a4f4ce None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:56.110580 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45513c2-5de7-4823-9d82-42b653a4f4ce None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:56.110851 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45513c2-5de7-4823-9d82-42b653a4f4ce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:56.124365 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45513c2-5de7-4823-9d82-42b653a4f4ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:56.131486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-f45513c2-5de7-4823-9d82-42b653a4f4ce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:43:56.131486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:56.131486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:56.131486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:56.131486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:56.131486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:56.131486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:56.131486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:56.131486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:56.131486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:56.131486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:56.131486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:56.131486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:56.131486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:56.131486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:56.131486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:56.132588 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:56.132588 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:56.132588 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:56.132588 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:56.132588 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:56.132588 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:56.132588 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:56.132588 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:56.132588 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:56.132588 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:56.132588 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:56.132588 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:56.132588 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:56.132588 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:56.132588 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:56.132588 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:56.133660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:56.133660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:56.133660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:56.133660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:56.133660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:56.133660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:56.133660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:56.133660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:56.133660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:56.133660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:56.133660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:43:56.133660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:43:56.137084 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 178/346] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:43:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:43:56.138278 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45513c2-5de7-4823-9d82-42b653a4f4ce None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:56.184580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5de81-8ec7-4e83-b9af-b635cf4fe1bc None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:56.220683 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4237a-c768-45e5-81a4-15e2fb89ad47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:56.221626 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4237a-c768-45e5-81a4-15e2fb89ad47 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:56.222073 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4237a-c768-45e5-81a4-15e2fb89ad47 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:56.222509 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4237a-c768-45e5-81a4-15e2fb89ad47 None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:56.223406 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4237a-c768-45e5-81a4-15e2fb89ad47 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:56.223881 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4237a-c768-45e5-81a4-15e2fb89ad47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:56.226076 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4237a-c768-45e5-81a4-15e2fb89ad47 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:56.235619 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 169/347] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:43:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:56.236847 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4237a-c768-45e5-81a4-15e2fb89ad47 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:56.241494 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:56.268348 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45513c2-5de7-4823-9d82-42b653a4f4ce None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:56.283435 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:56.326845 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d0bd0-91e1-4809-98c4-5b4485300b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:56.327750 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d0bd0-91e1-4809-98c4-5b4485300b31 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:56.328167 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d0bd0-91e1-4809-98c4-5b4485300b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:56.328573 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d0bd0-91e1-4809-98c4-5b4485300b31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:56.340975 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d0bd0-91e1-4809-98c4-5b4485300b31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:56.346416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-3c6d0bd0-91e1-4809-98c4-5b4485300b31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:43:56.346416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:56.346416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:56.346416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:56.346416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:56.346416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:56.346416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:56.346416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:56.346416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:56.346416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:56.346416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:56.346416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:56.346416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:56.346416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:56.346416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:56.346416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:56.347312 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:56.347312 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:56.347312 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:56.347312 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:56.347312 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:56.347312 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:56.347312 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:56.347312 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:56.347312 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:56.347312 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:56.347312 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:56.347312 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:56.347312 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:56.347312 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:56.347312 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:56.347312 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:56.348081 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:56.348081 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:56.348081 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:56.348081 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:56.348081 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:56.348081 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:56.348081 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:56.348081 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:56.348081 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:56.348081 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:56.348081 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:43:56.348081 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:43:56.348804 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4237a-c768-45e5-81a4-15e2fb89ad47 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:56.351211 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 179/348] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:43:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:43:56.352374 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d0bd0-91e1-4809-98c4-5b4485300b31 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:56.404548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f10f64-4cb4-4ae6-b2e4-6d2a3d417bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:56.405191 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f10f64-4cb4-4ae6-b2e4-6d2a3d417bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:56.405466 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f10f64-4cb4-4ae6-b2e4-6d2a3d417bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:56.405736 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f10f64-4cb4-4ae6-b2e4-6d2a3d417bf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:56.490513 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d0bd0-91e1-4809-98c4-5b4485300b31 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:56.504890 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f10f64-4cb4-4ae6-b2e4-6d2a3d417bf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:56.507344 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f10f64-4cb4-4ae6-b2e4-6d2a3d417bf1 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:56.510929 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:56.541738 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2e1dc-ae7e-4021-af38-ef7bca2eb539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:56.543174 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2e1dc-ae7e-4021-af38-ef7bca2eb539 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:56.543896 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2e1dc-ae7e-4021-af38-ef7bca2eb539 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:56.545562 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2e1dc-ae7e-4021-af38-ef7bca2eb539 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:56.546506 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2e1dc-ae7e-4021-af38-ef7bca2eb539 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:56.547015 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2e1dc-ae7e-4021-af38-ef7bca2eb539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:56.548672 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2e1dc-ae7e-4021-af38-ef7bca2eb539 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:56.563621 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 180/349] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 24 15:43:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:56.565057 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2e1dc-ae7e-4021-af38-ef7bca2eb539 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:56.602144 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:56.636475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 170/350] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:43:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:56.637392 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f10f64-4cb4-4ae6-b2e4-6d2a3d417bf1 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:56.713104 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2e1dc-ae7e-4021-af38-ef7bca2eb539 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:56.766288 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f1ee5-fe28-4b14-a343-a16060e8eadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:56.767332 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f1ee5-fe28-4b14-a343-a16060e8eadd None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:56.768952 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f1ee5-fe28-4b14-a343-a16060e8eadd None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:56.769066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f10f64-4cb4-4ae6-b2e4-6d2a3d417bf1 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:56.769594 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f1ee5-fe28-4b14-a343-a16060e8eadd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:56.772840 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:56.819039 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460571a6-7fdf-4409-ad24-105f88458201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:56.819901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460571a6-7fdf-4409-ad24-105f88458201 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:56.820525 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460571a6-7fdf-4409-ad24-105f88458201 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:56.821097 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460571a6-7fdf-4409-ad24-105f88458201 None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:56.821912 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460571a6-7fdf-4409-ad24-105f88458201 None admin] RBAC: Adding query filter params (name=member) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:56.822364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460571a6-7fdf-4409-ad24-105f88458201 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:56.825005 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460571a6-7fdf-4409-ad24-105f88458201 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:56.841230 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 171/351] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 24 15:43:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:56.842430 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460571a6-7fdf-4409-ad24-105f88458201 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:56.875225 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f1ee5-fe28-4b14-a343-a16060e8eadd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:56.876809 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f1ee5-fe28-4b14-a343-a16060e8eadd None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:56.912294 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:56.993790 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460571a6-7fdf-4409-ad24-105f88458201 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:57.030843 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 181/352] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:43:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:57.030843 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f1ee5-fe28-4b14-a343-a16060e8eadd None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:57.038337 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3f351-5817-4e4d-a486-c05956943abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:57.039040 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3f351-5817-4e4d-a486-c05956943abc None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:57.039319 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3f351-5817-4e4d-a486-c05956943abc None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:57.039594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3f351-5817-4e4d-a486-c05956943abc None admin] PATH_INFO: `/v3/users/1e54b4ea554a4d90905d8d446654f5ba` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:57.040805 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3f351-5817-4e4d-a486-c05956943abc None admin] RBAC: Authorizing `identity:get_user(user_id=1e54b4ea554a4d90905d8d446654f5ba)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:57.043287 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3f351-5817-4e4d-a486-c05956943abc None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:57.044978 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 172/353] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:43:56 2022] GET /identity/v3/users/1e54b4ea554a4d90905d8d446654f5ba => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:57.048586 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3f351-5817-4e4d-a486-c05956943abc None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:57.098177 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:57.176864 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f1ee5-fe28-4b14-a343-a16060e8eadd None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:57.177811 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3f351-5817-4e4d-a486-c05956943abc None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:57.210579 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:57.226434 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d1831-5c40-479e-80c2-507935c0096b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:57.227126 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d1831-5c40-479e-80c2-507935c0096b None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:57.227407 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d1831-5c40-479e-80c2-507935c0096b None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:57.227684 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d1831-5c40-479e-80c2-507935c0096b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:57.228698 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb8ee6-1723-4086-9460-9e5d4746dcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:57.229357 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb8ee6-1723-4086-9460-9e5d4746dcba None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:57.229637 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb8ee6-1723-4086-9460-9e5d4746dcba None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:57.229909 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb8ee6-1723-4086-9460-9e5d4746dcba None admin] PATH_INFO: `/v3/projects/db70f99b67e1479f847c3ac324683445` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:57.231078 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb8ee6-1723-4086-9460-9e5d4746dcba None admin] RBAC: Authorizing `identity:get_project(project_id=db70f99b67e1479f847c3ac324683445)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:57.232577 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb8ee6-1723-4086-9460-9e5d4746dcba None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:57.234409 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 182/354] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:43:57 2022] GET /identity/v3/projects/db70f99b67e1479f847c3ac324683445 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:57.235599 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6201b-5eb6-402a-9ec2-c13ee44bcdd9 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:57.235888 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6201b-5eb6-402a-9ec2-c13ee44bcdd9 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:57.236185 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6201b-5eb6-402a-9ec2-c13ee44bcdd9 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:57.244052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 183/355] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:57.245132 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6201b-5eb6-402a-9ec2-c13ee44bcdd9 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:57.322837 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d1831-5c40-479e-80c2-507935c0096b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:57.324331 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d1831-5c40-479e-80c2-507935c0096b None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:57.367015 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:57.378099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6201b-5eb6-402a-9ec2-c13ee44bcdd9 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:57.423972 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13203070-1da3-4d26-9480-bd84e5767051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:57.424647 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13203070-1da3-4d26-9480-bd84e5767051 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:57.425039 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13203070-1da3-4d26-9480-bd84e5767051 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:57.425308 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13203070-1da3-4d26-9480-bd84e5767051 None admin] PATH_INFO: `/v3/projects/db70f99b67e1479f847c3ac324683445` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:57.429804 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13203070-1da3-4d26-9480-bd84e5767051 None admin] RBAC: Authorizing `identity:get_project(project_id=db70f99b67e1479f847c3ac324683445)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:57.431276 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13203070-1da3-4d26-9480-bd84e5767051 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:57.433261 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 184/356] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:43:57 2022] GET /identity/v3/projects/db70f99b67e1479f847c3ac324683445 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:57.434036 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13203070-1da3-4d26-9480-bd84e5767051 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:57.458181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 173/357] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:43:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:57.460022 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb3f27-433e-440a-bcf4-8d9a7af6e74d None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:57.460311 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb3f27-433e-440a-bcf4-8d9a7af6e74d None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:57.460587 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb3f27-433e-440a-bcf4-8d9a7af6e74d None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:57.462155 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 174/358] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:57.462641 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb3f27-433e-440a-bcf4-8d9a7af6e74d None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:57.514334 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:57.562494 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13203070-1da3-4d26-9480-bd84e5767051 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:57.615087 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee000ee5-f751-43b6-8aa2-f2b198db6d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:57.616536 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee000ee5-f751-43b6-8aa2-f2b198db6d80 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:57.616536 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee000ee5-f751-43b6-8aa2-f2b198db6d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:57.616536 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee000ee5-f751-43b6-8aa2-f2b198db6d80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:57.616858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb3f27-433e-440a-bcf4-8d9a7af6e74d None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:57.617109 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee000ee5-f751-43b6-8aa2-f2b198db6d80 None admin] RBAC: Adding query filter params (role.id=961096b573de42c18dfca520e82b2030, user.id=1e54b4ea554a4d90905d8d446654f5ba, scope.system=all) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:57.618232 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee000ee5-f751-43b6-8aa2-f2b198db6d80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:57.618813 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee000ee5-f751-43b6-8aa2-f2b198db6d80 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:57.634354 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 185/359] 10.222.0.64 () {56 vars in 1308 bytes} [Wed Aug 24 15:43:57 2022] GET /identity/v3/role_assignments?user.id=1e54b4ea554a4d90905d8d446654f5ba&scope.system=all&role.id=961096b573de42c18dfca520e82b2030 => generated 510 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:57.635624 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41edda0-996f-456c-b271-25608feed5c1 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:57.635905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41edda0-996f-456c-b271-25608feed5c1 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:57.636172 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41edda0-996f-456c-b271-25608feed5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:57.660117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-e41edda0-996f-456c-b271-25608feed5c1 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:57.662691 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-e41edda0-996f-456c-b271-25608feed5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:57.677899 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d6b2a-f460-4725-bf97-79c22d125d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:57.679586 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d6b2a-f460-4725-bf97-79c22d125d13 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:57.680033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d6b2a-f460-4725-bf97-79c22d125d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:57.680584 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d6b2a-f460-4725-bf97-79c22d125d13 None admin] PATH_INFO: `/v3/groups/9bd3688ec85c4fd7b2f786a879c8072e` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:57.690589 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:57.698127 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d6b2a-f460-4725-bf97-79c22d125d13 None admin] RBAC: Authorizing `identity:get_group(group_id=9bd3688ec85c4fd7b2f786a879c8072e)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:57.700867 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d6b2a-f460-4725-bf97-79c22d125d13 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:57.705883 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 175/360] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 24 15:43:57 2022] GET /identity/v3/groups/9bd3688ec85c4fd7b2f786a879c8072e => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:57.705883 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d6b2a-f460-4725-bf97-79c22d125d13 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:57.775561 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 186/361] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:57.776460 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41edda0-996f-456c-b271-25608feed5c1 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:57.842473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:57.862132 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d6b2a-f460-4725-bf97-79c22d125d13 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:57.918580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd1e62-ae34-4c6b-be9d-e50a5f284a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:57.918855 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd1e62-ae34-4c6b-be9d-e50a5f284a19 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:57.919495 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd1e62-ae34-4c6b-be9d-e50a5f284a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:57.920020 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd1e62-ae34-4c6b-be9d-e50a5f284a19 None admin] PATH_INFO: `/v3/groups/9bd3688ec85c4fd7b2f786a879c8072e` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:57.921947 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd1e62-ae34-4c6b-be9d-e50a5f284a19 None admin] RBAC: Authorizing `identity:get_group(group_id=9bd3688ec85c4fd7b2f786a879c8072e)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:57.924035 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd1e62-ae34-4c6b-be9d-e50a5f284a19 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:57.926327 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 176/362] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 24 15:43:57 2022] GET /identity/v3/groups/9bd3688ec85c4fd7b2f786a879c8072e => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:57.928602 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742d027-0d79-4ebc-b8f5-addc046c8ef4 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:57.929107 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742d027-0d79-4ebc-b8f5-addc046c8ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:57.929519 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742d027-0d79-4ebc-b8f5-addc046c8ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:57.931964 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41edda0-996f-456c-b271-25608feed5c1 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:57.954892 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-7742d027-0d79-4ebc-b8f5-addc046c8ef4 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:57.956120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-7742d027-0d79-4ebc-b8f5-addc046c8ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:57.982353 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edcece-21e5-4101-9e7f-b77312ffc644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:57.983169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edcece-21e5-4101-9e7f-b77312ffc644 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:57.983449 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edcece-21e5-4101-9e7f-b77312ffc644 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:57.983723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edcece-21e5-4101-9e7f-b77312ffc644 None admin] PATH_INFO: `/v3/projects/b533b81163ef4776a421230d7bc3e77c` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:57.985098 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83edcece-21e5-4101-9e7f-b77312ffc644 None admin] RBAC: Authorizing `identity:get_project(project_id=b533b81163ef4776a421230d7bc3e77c)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:57.986807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83edcece-21e5-4101-9e7f-b77312ffc644 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:57.989486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 187/363] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:43:57 2022] GET /identity/v3/projects/b533b81163ef4776a421230d7bc3e77c => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:57.990281 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edcece-21e5-4101-9e7f-b77312ffc644 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:58.038132 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:58.047697 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 177/364] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:58.048930 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742d027-0d79-4ebc-b8f5-addc046c8ef4 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:58.133720 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edcece-21e5-4101-9e7f-b77312ffc644 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:58.160338 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:58.180868 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742d027-0d79-4ebc-b8f5-addc046c8ef4 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:58.191267 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657445d-d2e2-41e9-89a2-2f406a6621ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:58.191989 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657445d-d2e2-41e9-89a2-2f406a6621ef None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:58.192587 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657445d-d2e2-41e9-89a2-2f406a6621ef None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:58.193530 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657445d-d2e2-41e9-89a2-2f406a6621ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:58.194364 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657445d-d2e2-41e9-89a2-2f406a6621ef None admin] RBAC: Adding query filter params (group.id=9bd3688ec85c4fd7b2f786a879c8072e, role.id=0ea43d9dfb184e27b48d251fd38463db, scope.project.id=db70f99b67e1479f847c3ac324683445) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:58.196241 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657445d-d2e2-41e9-89a2-2f406a6621ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:58.198133 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657445d-d2e2-41e9-89a2-2f406a6621ef None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:58.204371 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 188/365] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 24 15:43:57 2022] GET /identity/v3/role_assignments?group.id=9bd3688ec85c4fd7b2f786a879c8072e&scope.project.id=db70f99b67e1479f847c3ac324683445&role.id=0ea43d9dfb184e27b48d251fd38463db => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:58.206233 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657445d-d2e2-41e9-89a2-2f406a6621ef None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:58.223764 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92049719-e2ea-42ad-83de-f891136db344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:58.225030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92049719-e2ea-42ad-83de-f891136db344 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:58.225361 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92049719-e2ea-42ad-83de-f891136db344 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:58.225638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92049719-e2ea-42ad-83de-f891136db344 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:58.226550 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92049719-e2ea-42ad-83de-f891136db344 None admin] RBAC: Adding query filter params (group.id=9bd3688ec85c4fd7b2f786a879c8072e, role.id=38df38770b21458d87720d3c4c6f1ff1, scope.project.id=db70f99b67e1479f847c3ac324683445) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:58.227146 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92049719-e2ea-42ad-83de-f891136db344 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:58.229971 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92049719-e2ea-42ad-83de-f891136db344 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:58.238409 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 178/366] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 24 15:43:58 2022] GET /identity/v3/role_assignments?group.id=9bd3688ec85c4fd7b2f786a879c8072e&scope.project.id=db70f99b67e1479f847c3ac324683445&role.id=38df38770b21458d87720d3c4c6f1ff1 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:58.239326 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92049719-e2ea-42ad-83de-f891136db344 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:58.332117 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:58.361292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657445d-d2e2-41e9-89a2-2f406a6621ef None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:58.398003 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92049719-e2ea-42ad-83de-f891136db344 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:58.417457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd37f85-e11b-49e8-ad2b-87664ef696de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:58.418469 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd37f85-e11b-49e8-ad2b-87664ef696de None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:58.418954 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd37f85-e11b-49e8-ad2b-87664ef696de None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:58.419421 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd37f85-e11b-49e8-ad2b-87664ef696de None admin] PATH_INFO: `/v3/groups/9bd3688ec85c4fd7b2f786a879c8072e` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:58.423029 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd37f85-e11b-49e8-ad2b-87664ef696de None admin] RBAC: Authorizing `identity:get_group(group_id=9bd3688ec85c4fd7b2f786a879c8072e)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:58.424999 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd37f85-e11b-49e8-ad2b-87664ef696de None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:58.428048 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 189/367] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 24 15:43:58 2022] GET /identity/v3/groups/9bd3688ec85c4fd7b2f786a879c8072e => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:58.429588 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd37f85-e11b-49e8-ad2b-87664ef696de None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:58.467701 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81fffa1-1f5d-4d3f-bac1-574cf4f12dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:58.469703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81fffa1-1f5d-4d3f-bac1-574cf4f12dfd None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:58.470101 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81fffa1-1f5d-4d3f-bac1-574cf4f12dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:58.470561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81fffa1-1f5d-4d3f-bac1-574cf4f12dfd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:58.488692 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81fffa1-1f5d-4d3f-bac1-574cf4f12dfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:58.495079 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-a81fffa1-1f5d-4d3f-bac1-574cf4f12dfd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:43:58.495079 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:58.495079 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:58.495079 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:58.495079 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:58.495079 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:58.495079 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:58.495079 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:58.495079 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:58.495079 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:58.495079 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:58.495079 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:58.495079 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:58.495079 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:58.495079 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:58.495079 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:58.496080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:58.496080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:58.496080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:58.496080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:58.496080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:58.496080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:58.496080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:58.496080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:58.496080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:58.496080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:58.496080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:58.496080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:58.496080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:58.496080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:58.496080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:58.496080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:58.496979 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:58.496979 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:58.496979 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:58.496979 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:58.496979 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:58.496979 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:58.496979 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:58.496979 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:58.496979 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:58.496979 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:58.496979 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:43:58.496979 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:43:58.499401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 179/368] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 24 15:43:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:43:58.500479 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81fffa1-1f5d-4d3f-bac1-574cf4f12dfd None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:58.517509 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:58.585466 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd37f85-e11b-49e8-ad2b-87664ef696de None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:58.629948 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb13598-10c2-49ec-a87e-0e274e2b6a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:58.630635 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb13598-10c2-49ec-a87e-0e274e2b6a44 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:58.630916 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb13598-10c2-49ec-a87e-0e274e2b6a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:58.631190 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb13598-10c2-49ec-a87e-0e274e2b6a44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:58.642562 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb13598-10c2-49ec-a87e-0e274e2b6a44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:43:58.647712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-eeb13598-10c2-49ec-a87e-0e274e2b6a44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:43:58.647712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:43:58.647712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:43:58.647712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:43:58.647712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:43:58.647712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:43:58.647712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:43:58.647712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:43:58.647712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:43:58.647712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:43:58.647712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:43:58.647712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:43:58.647712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:43:58.647712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:43:58.647712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:43:58.647712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:43:58.648674 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:43:58.648674 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:43:58.648674 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:43:58.648674 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:43:58.648674 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:43:58.648674 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:43:58.648674 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:43:58.648674 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:43:58.648674 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:43:58.648674 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:43:58.648674 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:43:58.648674 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:43:58.648674 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:43:58.648674 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:43:58.648674 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:43:58.648674 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:43:58.649457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:43:58.649457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:43:58.649457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:43:58.649457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:43:58.649457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:43:58.649457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:43:58.649457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:43:58.649457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:43:58.649457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:43:58.649457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:43:58.649457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:43:58.649457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:43:58.649457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 190/369] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:43:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:43:58.650140 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb13598-10c2-49ec-a87e-0e274e2b6a44 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:58.655401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81fffa1-1f5d-4d3f-bac1-574cf4f12dfd None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:58.684184 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:58.705266 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d20147-9fea-49ac-b4d3-0a62754209a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:58.707051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d20147-9fea-49ac-b4d3-0a62754209a2 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:58.707051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d20147-9fea-49ac-b4d3-0a62754209a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:58.707661 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d20147-9fea-49ac-b4d3-0a62754209a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:58.709057 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d20147-9fea-49ac-b4d3-0a62754209a2 None admin] RBAC: Adding query filter params (group.id=9bd3688ec85c4fd7b2f786a879c8072e, role.id=0ea43d9dfb184e27b48d251fd38463db, scope.project.id=b533b81163ef4776a421230d7bc3e77c) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:58.709853 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d20147-9fea-49ac-b4d3-0a62754209a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:58.712197 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d20147-9fea-49ac-b4d3-0a62754209a2 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:58.719621 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 180/370] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 24 15:43:58 2022] GET /identity/v3/role_assignments?group.id=9bd3688ec85c4fd7b2f786a879c8072e&scope.project.id=b533b81163ef4776a421230d7bc3e77c&role.id=0ea43d9dfb184e27b48d251fd38463db => generated 260 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:58.721467 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d20147-9fea-49ac-b4d3-0a62754209a2 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:58.784456 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb13598-10c2-49ec-a87e-0e274e2b6a44 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:58.797082 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:58.826934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b3857-116a-4607-8205-2f60cc775c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:58.828235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b3857-116a-4607-8205-2f60cc775c4e None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:58.828235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b3857-116a-4607-8205-2f60cc775c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:58.828235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b3857-116a-4607-8205-2f60cc775c4e None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:58.828816 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b3857-116a-4607-8205-2f60cc775c4e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:58.829124 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b3857-116a-4607-8205-2f60cc775c4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:58.830530 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b3857-116a-4607-8205-2f60cc775c4e None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:58.840913 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 191/371] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:43:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:58.847107 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b3857-116a-4607-8205-2f60cc775c4e None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:58.864844 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d20147-9fea-49ac-b4d3-0a62754209a2 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:58.908462 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e19556-6048-493d-b601-d1c487baa6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:58.909678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e19556-6048-493d-b601-d1c487baa6d3 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:58.910154 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e19556-6048-493d-b601-d1c487baa6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:58.910619 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e19556-6048-493d-b601-d1c487baa6d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:58.912188 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e19556-6048-493d-b601-d1c487baa6d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:58.913146 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e19556-6048-493d-b601-d1c487baa6d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:58.915443 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e19556-6048-493d-b601-d1c487baa6d3 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:58.925154 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 181/372] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:43:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:58.933760 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e19556-6048-493d-b601-d1c487baa6d3 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:58.970148 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b3857-116a-4607-8205-2f60cc775c4e None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:59.004113 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597b8a9-b86b-4c29-8b13-3c09da68d4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:59.004800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597b8a9-b86b-4c29-8b13-3c09da68d4b2 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:59.005170 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597b8a9-b86b-4c29-8b13-3c09da68d4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:59.005395 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597b8a9-b86b-4c29-8b13-3c09da68d4b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:59.008958 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:59.049084 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:59.090730 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e19556-6048-493d-b601-d1c487baa6d3 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:59.095987 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597b8a9-b86b-4c29-8b13-3c09da68d4b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:59.097497 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597b8a9-b86b-4c29-8b13-3c09da68d4b2 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:59.132655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d4a6e-3360-48a4-883c-8b99bbeaf21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:59.133404 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d4a6e-3360-48a4-883c-8b99bbeaf21d None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:59.133802 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d4a6e-3360-48a4-883c-8b99bbeaf21d None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:59.134089 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d4a6e-3360-48a4-883c-8b99bbeaf21d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:59.253107 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 192/373] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:43:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 15:43:59.262689 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597b8a9-b86b-4c29-8b13-3c09da68d4b2 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:59.275338 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d4a6e-3360-48a4-883c-8b99bbeaf21d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:59.277246 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d4a6e-3360-48a4-883c-8b99bbeaf21d None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:59.353394 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:59.422774 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 182/374] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:43:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:59.428771 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d4a6e-3360-48a4-883c-8b99bbeaf21d None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:59.433008 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:59.519034 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597b8a9-b86b-4c29-8b13-3c09da68d4b2 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:59.542031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d4a6e-3360-48a4-883c-8b99bbeaf21d None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:59.586506 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e09e64-d5c1-4c31-968d-e8b962d3d662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:59.587984 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e09e64-d5c1-4c31-968d-e8b962d3d662 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:59.588473 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e09e64-d5c1-4c31-968d-e8b962d3d662 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:59.588982 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e09e64-d5c1-4c31-968d-e8b962d3d662 None admin] PATH_INFO: `/v3/projects/23fb7d167a714e0cb4ca2550c38d5f58` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:59.590426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e09e64-d5c1-4c31-968d-e8b962d3d662 None admin] RBAC: Authorizing `identity:get_project(project_id=23fb7d167a714e0cb4ca2550c38d5f58)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:59.592301 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e09e64-d5c1-4c31-968d-e8b962d3d662 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:59.594631 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 183/375] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:43:59 2022] GET /identity/v3/projects/23fb7d167a714e0cb4ca2550c38d5f58 => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:59.600551 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e09e64-d5c1-4c31-968d-e8b962d3d662 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:59.620475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:59.641508 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f1c08-fd96-4262-a065-4f500eed9579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:59.642158 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f1c08-fd96-4262-a065-4f500eed9579 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:59.642442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f1c08-fd96-4262-a065-4f500eed9579 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:59.642714 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f1c08-fd96-4262-a065-4f500eed9579 None admin] PATH_INFO: `/v3/projects/b533b81163ef4776a421230d7bc3e77c` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:59.644243 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f1c08-fd96-4262-a065-4f500eed9579 None admin] RBAC: Authorizing `identity:get_project(project_id=b533b81163ef4776a421230d7bc3e77c)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:59.645516 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f1c08-fd96-4262-a065-4f500eed9579 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:59.652451 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 193/376] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:43:59 2022] GET /identity/v3/projects/b533b81163ef4776a421230d7bc3e77c => generated 302 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:59.653671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f1c08-fd96-4262-a065-4f500eed9579 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:59.726826 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e09e64-d5c1-4c31-968d-e8b962d3d662 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:59.767181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261081ed-f914-49a0-94ea-99651545c477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:59.768297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261081ed-f914-49a0-94ea-99651545c477 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:59.768833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261081ed-f914-49a0-94ea-99651545c477 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:59.769580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261081ed-f914-49a0-94ea-99651545c477 None admin] PATH_INFO: `/v3/groups/375a9228cb604dc2b06277b37546c62e` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:59.777768 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261081ed-f914-49a0-94ea-99651545c477 None admin] RBAC: Authorizing `identity:get_group(group_id=375a9228cb604dc2b06277b37546c62e)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:59.779741 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261081ed-f914-49a0-94ea-99651545c477 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:59.783503 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 184/377] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 24 15:43:59 2022] GET /identity/v3/groups/375a9228cb604dc2b06277b37546c62e => generated 229 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:43:59.790244 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261081ed-f914-49a0-94ea-99651545c477 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:59.856528 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f1c08-fd96-4262-a065-4f500eed9579 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:59.879465 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:59.905080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261081ed-f914-49a0-94ea-99651545c477 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:59.930580 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6057495-9f4d-44c1-a1c7-d09e96f08ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:59.932722 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6057495-9f4d-44c1-a1c7-d09e96f08ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:59.936582 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6057495-9f4d-44c1-a1c7-d09e96f08ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:59.937204 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6057495-9f4d-44c1-a1c7-d09e96f08ac0 None admin] PATH_INFO: `/v3/groups/9bd3688ec85c4fd7b2f786a879c8072e` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:59.938730 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6057495-9f4d-44c1-a1c7-d09e96f08ac0 None admin] RBAC: Authorizing `identity:get_group(group_id=9bd3688ec85c4fd7b2f786a879c8072e)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:59.940384 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6057495-9f4d-44c1-a1c7-d09e96f08ac0 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:59.947725 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 194/378] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 24 15:43:59 2022] GET /identity/v3/groups/9bd3688ec85c4fd7b2f786a879c8072e => generated 226 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:59.955303 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6057495-9f4d-44c1-a1c7-d09e96f08ac0 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:59.960657 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:59.972356 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9db01a-7aae-49fb-b368-0691f5e92ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:59.973359 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9db01a-7aae-49fb-b368-0691f5e92ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:59.975616 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9db01a-7aae-49fb-b368-0691f5e92ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:59.975616 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9db01a-7aae-49fb-b368-0691f5e92ea9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:59.975616 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9db01a-7aae-49fb-b368-0691f5e92ea9 None admin] RBAC: Adding query filter params (group.id=375a9228cb604dc2b06277b37546c62e, role.id=c6745e08f9da4a2bae8510c9983635c3, scope.project.id=23fb7d167a714e0cb4ca2550c38d5f58) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:43:59.975616 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9db01a-7aae-49fb-b368-0691f5e92ea9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:59.978261 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9db01a-7aae-49fb-b368-0691f5e92ea9 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:59.986863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 185/379] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 24 15:43:59 2022] GET /identity/v3/role_assignments?group.id=375a9228cb604dc2b06277b37546c62e&scope.project.id=23fb7d167a714e0cb4ca2550c38d5f58&role.id=c6745e08f9da4a2bae8510c9983635c3 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:00.116554 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6057495-9f4d-44c1-a1c7-d09e96f08ac0 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:00.172846 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14479155-da71-405c-a8f6-a15840d16fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:00.173485 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14479155-da71-405c-a8f6-a15840d16fab None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:00.173771 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14479155-da71-405c-a8f6-a15840d16fab None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:00.174047 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14479155-da71-405c-a8f6-a15840d16fab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:00.174813 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14479155-da71-405c-a8f6-a15840d16fab None admin] RBAC: Adding query filter params (group.id=9bd3688ec85c4fd7b2f786a879c8072e, role.id=38df38770b21458d87720d3c4c6f1ff1, scope.project.id=b533b81163ef4776a421230d7bc3e77c) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:00.175126 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14479155-da71-405c-a8f6-a15840d16fab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:00.176603 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14479155-da71-405c-a8f6-a15840d16fab None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:00.187182 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 195/380] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 24 15:43:59 2022] GET /identity/v3/role_assignments?group.id=9bd3688ec85c4fd7b2f786a879c8072e&scope.project.id=b533b81163ef4776a421230d7bc3e77c&role.id=38df38770b21458d87720d3c4c6f1ff1 => generated 260 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:44:00.650574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cd0c5-e928-44bb-803f-237d8e9f09cd None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:00.651092 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cd0c5-e928-44bb-803f-237d8e9f09cd None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:00.651092 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cd0c5-e928-44bb-803f-237d8e9f09cd None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:00.652749 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 186/381] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:00.658640 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a11611-b69c-4033-b4fc-7aa963263e24 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:00.659156 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a11611-b69c-4033-b4fc-7aa963263e24 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:00.659235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a11611-b69c-4033-b4fc-7aa963263e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:00.681841 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-e8a11611-b69c-4033-b4fc-7aa963263e24 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:00.683069 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-e8a11611-b69c-4033-b4fc-7aa963263e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:00.767099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:00.774380 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 196/382] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:01.030598 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb512ce8-78d9-4124-b826-21416e6850f1 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:01.031229 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb512ce8-78d9-4124-b826-21416e6850f1 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:01.031401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb512ce8-78d9-4124-b826-21416e6850f1 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:01.033003 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 187/383] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:01.038801 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1b5c2-52fd-45cc-924e-b8043cad382e None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:01.039076 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1b5c2-52fd-45cc-924e-b8043cad382e None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:01.039340 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1b5c2-52fd-45cc-924e-b8043cad382e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:01.072141 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-f7c1b5c2-52fd-45cc-924e-b8043cad382e None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:01.073382 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-f7c1b5c2-52fd-45cc-924e-b8043cad382e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:01.166016 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 197/384] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:01.172356 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb512ce8-78d9-4124-b826-21416e6850f1 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:01.337668 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb512ce8-78d9-4124-b826-21416e6850f1 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:01.348461 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c2e6d-4a0f-4921-ae1f-76ec5ad74884 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:01.349344 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c2e6d-4a0f-4921-ae1f-76ec5ad74884 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:01.349861 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c2e6d-4a0f-4921-ae1f-76ec5ad74884 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:01.351720 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 198/385] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:01.357315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861cfc9-6261-4772-9b2d-f4cb44eb52d0 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:01.357888 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861cfc9-6261-4772-9b2d-f4cb44eb52d0 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:01.358413 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861cfc9-6261-4772-9b2d-f4cb44eb52d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:01.389193 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-b861cfc9-6261-4772-9b2d-f4cb44eb52d0 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:01.391479 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-b861cfc9-6261-4772-9b2d-f4cb44eb52d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:01.406734 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edd9d9-514e-40fe-961c-6adcce7857c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:01.407744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edd9d9-514e-40fe-961c-6adcce7857c3 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:01.408234 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edd9d9-514e-40fe-961c-6adcce7857c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:01.408741 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edd9d9-514e-40fe-961c-6adcce7857c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:01.429557 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9edd9d9-514e-40fe-961c-6adcce7857c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:01.438839 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-a9edd9d9-514e-40fe-961c-6adcce7857c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:44:01.438839 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:01.438839 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:01.438839 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:01.438839 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:01.438839 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:01.438839 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:01.438839 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:01.438839 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:01.438839 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:01.438839 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:01.438839 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:01.438839 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:01.438839 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:01.438839 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:01.438839 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:01.439818 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:01.439818 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:01.439818 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:01.439818 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:01.439818 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:01.439818 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:01.439818 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:01.439818 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:01.439818 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:01.439818 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:01.439818 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:01.439818 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:01.439818 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:01.439818 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:01.439818 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:01.439818 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:01.440594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:01.440594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:01.440594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:01.440594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:01.440594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:01.440594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:01.440594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:01.440594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:01.440594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:01.440594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:01.440594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:44:01.440594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:01.447068 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 188/386] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:44:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:01.451481 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edd9d9-514e-40fe-961c-6adcce7857c3 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:01.455335 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:01.542447 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 199/387] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:44:01.543411 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861cfc9-6261-4772-9b2d-f4cb44eb52d0 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:01.595060 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edd9d9-514e-40fe-961c-6adcce7857c3 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:01.631563 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae3013-0bb8-43d8-81fa-986d076166c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:01.632182 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae3013-0bb8-43d8-81fa-986d076166c1 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:01.632460 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae3013-0bb8-43d8-81fa-986d076166c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:01.632782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae3013-0bb8-43d8-81fa-986d076166c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:01.633602 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae3013-0bb8-43d8-81fa-986d076166c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:01.633937 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae3013-0bb8-43d8-81fa-986d076166c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:01.635582 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae3013-0bb8-43d8-81fa-986d076166c1 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:01.644991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 189/388] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 24 15:44:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:01.650761 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae3013-0bb8-43d8-81fa-986d076166c1 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:01.718515 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:01.730649 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:01.764412 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae3013-0bb8-43d8-81fa-986d076166c1 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:01.802907 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbeb36-7b05-4803-bb63-f27d4dd0c38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:01.803958 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbeb36-7b05-4803-bb63-f27d4dd0c38d None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:01.804420 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbeb36-7b05-4803-bb63-f27d4dd0c38d None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:01.805035 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbeb36-7b05-4803-bb63-f27d4dd0c38d None admin] PATH_INFO: `/v3/groups/9bd3688ec85c4fd7b2f786a879c8072e` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:01.806521 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbeb36-7b05-4803-bb63-f27d4dd0c38d None admin] RBAC: Authorizing `identity:get_group(group_id=9bd3688ec85c4fd7b2f786a879c8072e)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:01.808171 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbeb36-7b05-4803-bb63-f27d4dd0c38d None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:01.810365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 190/389] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 24 15:44:01 2022] GET /identity/v3/groups/9bd3688ec85c4fd7b2f786a879c8072e => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:44:01.816472 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbeb36-7b05-4803-bb63-f27d4dd0c38d None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:01.835590 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861cfc9-6261-4772-9b2d-f4cb44eb52d0 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:01.883376 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990bd5f-a4c1-4383-824c-8e69b9034c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:01.883931 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990bd5f-a4c1-4383-824c-8e69b9034c0a None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:01.884208 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990bd5f-a4c1-4383-824c-8e69b9034c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:01.884476 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990bd5f-a4c1-4383-824c-8e69b9034c0a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:01.897244 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990bd5f-a4c1-4383-824c-8e69b9034c0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:01.903353 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-a990bd5f-a4c1-4383-824c-8e69b9034c0a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:44:01.903353 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:01.903353 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:01.903353 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:01.903353 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:01.903353 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:01.903353 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:01.903353 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:01.903353 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:01.903353 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:01.903353 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:01.903353 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:01.903353 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:01.903353 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:01.903353 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:01.903353 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:01.904272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:01.904272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:01.904272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:01.904272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:01.904272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:01.904272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:01.904272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:01.904272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:01.904272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:01.904272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:01.904272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:01.904272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:01.904272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:01.904272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:01.904272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:01.904272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:01.905110 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:01.905110 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:01.905110 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:01.905110 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:01.905110 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:01.905110 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:01.905110 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:01.905110 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:01.905110 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:01.905110 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:01.905110 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:44:01.905110 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:01.909687 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 200/390] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 24 15:44:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:01.910625 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990bd5f-a4c1-4383-824c-8e69b9034c0a None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:01.937943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbeb36-7b05-4803-bb63-f27d4dd0c38d None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:01.972033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:01.978499 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7714d-967c-4613-bb1a-d2596ce270d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:01.979611 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7714d-967c-4613-bb1a-d2596ce270d2 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:01.980111 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7714d-967c-4613-bb1a-d2596ce270d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:01.980579 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7714d-967c-4613-bb1a-d2596ce270d2 None admin] PATH_INFO: `/v3/projects/db70f99b67e1479f847c3ac324683445` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:01.990320 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7714d-967c-4613-bb1a-d2596ce270d2 None admin] RBAC: Authorizing `identity:get_project(project_id=db70f99b67e1479f847c3ac324683445)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:01.990320 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7714d-967c-4613-bb1a-d2596ce270d2 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:01.990810 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 191/391] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:44:01 2022] GET /identity/v3/projects/db70f99b67e1479f847c3ac324683445 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:01.991951 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7714d-967c-4613-bb1a-d2596ce270d2 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:02.045813 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990bd5f-a4c1-4383-824c-8e69b9034c0a None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:02.067253 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:02.090864 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e1807-8888-429b-b37b-9d2fbe723548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:02.091598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e1807-8888-429b-b37b-9d2fbe723548 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:02.091950 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e1807-8888-429b-b37b-9d2fbe723548 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:02.092369 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e1807-8888-429b-b37b-9d2fbe723548 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:02.105273 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e1807-8888-429b-b37b-9d2fbe723548 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:02.110512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-fd6e1807-8888-429b-b37b-9d2fbe723548 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:44:02.110512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:02.110512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:02.110512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:02.110512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:02.110512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:02.110512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:02.110512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:02.110512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:02.110512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:02.110512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:02.110512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:02.110512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:02.110512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:02.110512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:02.110512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:02.111405 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:02.111405 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:02.111405 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:02.111405 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:02.111405 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:02.111405 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:02.111405 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:02.111405 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:02.111405 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:02.111405 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:02.111405 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:02.111405 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:02.111405 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:02.111405 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:02.111405 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:02.111405 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:02.112195 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:02.112195 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:02.112195 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:02.112195 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:02.112195 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:02.112195 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:02.112195 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:02.112195 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:02.112195 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:02.112195 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:02.112195 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:44:02.112195 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:02.113593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7714d-967c-4613-bb1a-d2596ce270d2 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:02.117446 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 201/392] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:44:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:02.117991 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e1807-8888-429b-b37b-9d2fbe723548 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:02.153785 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bedcb32-06fc-4b1b-bcc9-63fc7d11a939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:02.154762 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedcb32-06fc-4b1b-bcc9-63fc7d11a939 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:02.155275 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedcb32-06fc-4b1b-bcc9-63fc7d11a939 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:02.155727 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedcb32-06fc-4b1b-bcc9-63fc7d11a939 None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:02.156863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bedcb32-06fc-4b1b-bcc9-63fc7d11a939 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:02.157365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bedcb32-06fc-4b1b-bcc9-63fc7d11a939 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:02.159134 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bedcb32-06fc-4b1b-bcc9-63fc7d11a939 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:02.169395 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 192/393] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:44:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:02.170483 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bedcb32-06fc-4b1b-bcc9-63fc7d11a939 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:02.241203 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:02.249881 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e1807-8888-429b-b37b-9d2fbe723548 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:02.288905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2e32e-410d-468e-ab0c-5c41372721dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:02.289669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2e32e-410d-468e-ab0c-5c41372721dc None admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:02.290024 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2e32e-410d-468e-ab0c-5c41372721dc None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:02.290392 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2e32e-410d-468e-ab0c-5c41372721dc None admin] PATH_INFO: `/v3/projects/db70f99b67e1479f847c3ac324683445/groups/9bd3688ec85c4fd7b2f786a879c8072e/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:02.293222 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2e32e-410d-468e-ab0c-5c41372721dc None admin] RBAC: Authorizing `identity:create_grant(project_id=db70f99b67e1479f847c3ac324683445, group_id=9bd3688ec85c4fd7b2f786a879c8072e, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:02.294222 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bedcb32-06fc-4b1b-bcc9-63fc7d11a939 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:02.295459 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2e32e-410d-468e-ab0c-5c41372721dc None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:02.339599 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0650fe-b5bf-4576-923d-aacd5410d9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:02.340380 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0650fe-b5bf-4576-923d-aacd5410d9c0 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:02.340708 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0650fe-b5bf-4576-923d-aacd5410d9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:02.346210 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0650fe-b5bf-4576-923d-aacd5410d9c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:02.346210 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0650fe-b5bf-4576-923d-aacd5410d9c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:02.346210 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0650fe-b5bf-4576-923d-aacd5410d9c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:02.346210 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0650fe-b5bf-4576-923d-aacd5410d9c0 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:02.359001 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 193/394] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 24 15:44:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:02.359001 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0650fe-b5bf-4576-923d-aacd5410d9c0 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:02.378484 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 202/395] 10.222.0.64 () {58 vars in 1442 bytes} [Wed Aug 24 15:44:02 2022] PUT /identity/v3/projects/db70f99b67e1479f847c3ac324683445/groups/9bd3688ec85c4fd7b2f786a879c8072e/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:44:02.379437 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2e32e-410d-468e-ab0c-5c41372721dc None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:02.427226 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:02.497665 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0650fe-b5bf-4576-923d-aacd5410d9c0 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:02.506763 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2e32e-410d-468e-ab0c-5c41372721dc None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:02.527582 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:02.541438 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9537c-743c-407c-83cc-94289b4783c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:02.542490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9537c-743c-407c-83cc-94289b4783c4 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:02.543025 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9537c-743c-407c-83cc-94289b4783c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:02.543483 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9537c-743c-407c-83cc-94289b4783c4 None admin] PATH_INFO: `/v3/groups/9bd3688ec85c4fd7b2f786a879c8072e` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:02.544988 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9537c-743c-407c-83cc-94289b4783c4 None admin] RBAC: Authorizing `identity:get_group(group_id=9bd3688ec85c4fd7b2f786a879c8072e)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:02.546744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9537c-743c-407c-83cc-94289b4783c4 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:02.548841 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 194/396] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 24 15:44:02 2022] GET /identity/v3/groups/9bd3688ec85c4fd7b2f786a879c8072e => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:02.550402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8279501-6616-4e4d-a60f-d1f30cc493bc None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:02.550904 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8279501-6616-4e4d-a60f-d1f30cc493bc None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:02.551378 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8279501-6616-4e4d-a60f-d1f30cc493bc None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:02.553923 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 195/397] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:02.557833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8279501-6616-4e4d-a60f-d1f30cc493bc None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:02.562103 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4e22e-a844-4c9e-8346-ad607a51a025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:02.562765 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4e22e-a844-4c9e-8346-ad607a51a025 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:02.563046 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4e22e-a844-4c9e-8346-ad607a51a025 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:02.563322 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4e22e-a844-4c9e-8346-ad607a51a025 None admin] PATH_INFO: `/v3/groups/9bd3688ec85c4fd7b2f786a879c8072e` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:02.564545 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4e22e-a844-4c9e-8346-ad607a51a025 None admin] RBAC: Authorizing `identity:get_group(group_id=9bd3688ec85c4fd7b2f786a879c8072e)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:02.566139 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4e22e-a844-4c9e-8346-ad607a51a025 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:02.572806 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 203/398] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 24 15:44:02 2022] GET /identity/v3/groups/9bd3688ec85c4fd7b2f786a879c8072e => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:02.572806 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6b7e4-7a6f-400f-b724-1217e62adcf0 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:02.572806 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6b7e4-7a6f-400f-b724-1217e62adcf0 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:02.572806 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6b7e4-7a6f-400f-b724-1217e62adcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:02.593969 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-9ff6b7e4-7a6f-400f-b724-1217e62adcf0 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:02.595176 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-9ff6b7e4-7a6f-400f-b724-1217e62adcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:02.675629 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 204/399] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:02.676571 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6b7e4-7a6f-400f-b724-1217e62adcf0 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:02.706921 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8279501-6616-4e4d-a60f-d1f30cc493bc None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:02.715952 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:02.741688 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba6701-5cba-4555-b332-88d414891805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:02.742468 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba6701-5cba-4555-b332-88d414891805 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:02.742661 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba6701-5cba-4555-b332-88d414891805 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:02.742918 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba6701-5cba-4555-b332-88d414891805 None admin] PATH_INFO: `/v3/projects/db70f99b67e1479f847c3ac324683445` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:02.744141 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba6701-5cba-4555-b332-88d414891805 None admin] RBAC: Authorizing `identity:get_project(project_id=db70f99b67e1479f847c3ac324683445)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:02.745927 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba6701-5cba-4555-b332-88d414891805 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:02.748047 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 196/400] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:44:02 2022] GET /identity/v3/projects/db70f99b67e1479f847c3ac324683445 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:02.753694 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba6701-5cba-4555-b332-88d414891805 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:02.793380 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6b7e4-7a6f-400f-b724-1217e62adcf0 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:02.829125 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:02.834710 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c9603-0e80-46f8-abb5-1a633ccec505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:02.835741 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c9603-0e80-46f8-abb5-1a633ccec505 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:02.836251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c9603-0e80-46f8-abb5-1a633ccec505 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:02.836764 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c9603-0e80-46f8-abb5-1a633ccec505 None admin] PATH_INFO: `/v3/projects/b533b81163ef4776a421230d7bc3e77c` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:02.838218 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c9603-0e80-46f8-abb5-1a633ccec505 None admin] RBAC: Authorizing `identity:get_project(project_id=b533b81163ef4776a421230d7bc3e77c)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:02.840141 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c9603-0e80-46f8-abb5-1a633ccec505 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:02.842460 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 205/401] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:44:02 2022] GET /identity/v3/projects/b533b81163ef4776a421230d7bc3e77c => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:02.848389 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c9603-0e80-46f8-abb5-1a633ccec505 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:02.865358 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba6701-5cba-4555-b332-88d414891805 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:02.933054 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02983e8b-6cb3-449d-b380-6a148d82f8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:02.934276 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02983e8b-6cb3-449d-b380-6a148d82f8a4 None admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:02.934946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02983e8b-6cb3-449d-b380-6a148d82f8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:02.936411 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02983e8b-6cb3-449d-b380-6a148d82f8a4 None admin] PATH_INFO: `/v3/projects/db70f99b67e1479f847c3ac324683445/groups/9bd3688ec85c4fd7b2f786a879c8072e/roles/38df38770b21458d87720d3c4c6f1ff1` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:02.941835 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02983e8b-6cb3-449d-b380-6a148d82f8a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=db70f99b67e1479f847c3ac324683445, group_id=9bd3688ec85c4fd7b2f786a879c8072e, role_id=38df38770b21458d87720d3c4c6f1ff1)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:02.944686 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02983e8b-6cb3-449d-b380-6a148d82f8a4 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:02.987964 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c9603-0e80-46f8-abb5-1a633ccec505 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:02.991641 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:03.029643 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 197/402] 10.222.0.64 () {58 vars in 1442 bytes} [Wed Aug 24 15:44:02 2022] PUT /identity/v3/projects/db70f99b67e1479f847c3ac324683445/groups/9bd3688ec85c4fd7b2f786a879c8072e/roles/38df38770b21458d87720d3c4c6f1ff1 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:44:03.035211 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79cee96-570d-4cff-a1f6-fee687cdd1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:03.036810 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cee96-570d-4cff-a1f6-fee687cdd1c9 None admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:03.037296 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cee96-570d-4cff-a1f6-fee687cdd1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:03.037759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cee96-570d-4cff-a1f6-fee687cdd1c9 None admin] PATH_INFO: `/v3/projects/b533b81163ef4776a421230d7bc3e77c/groups/9bd3688ec85c4fd7b2f786a879c8072e/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:03.040311 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79cee96-570d-4cff-a1f6-fee687cdd1c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b533b81163ef4776a421230d7bc3e77c, group_id=9bd3688ec85c4fd7b2f786a879c8072e, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:03.042154 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79cee96-570d-4cff-a1f6-fee687cdd1c9 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:03.069019 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02983e8b-6cb3-449d-b380-6a148d82f8a4 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:03.126930 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 206/403] 10.222.0.64 () {58 vars in 1442 bytes} [Wed Aug 24 15:44:02 2022] PUT /identity/v3/projects/b533b81163ef4776a421230d7bc3e77c/groups/9bd3688ec85c4fd7b2f786a879c8072e/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:44:03.132833 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb952ac-fe72-4f98-b20a-9725ea03ea2c None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:03.133599 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb952ac-fe72-4f98-b20a-9725ea03ea2c None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:03.134076 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb952ac-fe72-4f98-b20a-9725ea03ea2c None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:03.135924 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 207/404] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:03.147581 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a741ad-b6d2-4a4a-b6fa-5d337489602b None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:03.148279 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a741ad-b6d2-4a4a-b6fa-5d337489602b None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:03.148864 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a741ad-b6d2-4a4a-b6fa-5d337489602b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:03.189696 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-f9a741ad-b6d2-4a4a-b6fa-5d337489602b None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:03.191382 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-f9a741ad-b6d2-4a4a-b6fa-5d337489602b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:03.202727 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02983e8b-6cb3-449d-b380-6a148d82f8a4 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:03.228261 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:03.252942 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0caa65e-e232-410b-bd84-2119fac4cc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:03.253527 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0caa65e-e232-410b-bd84-2119fac4cc76 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:03.253811 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0caa65e-e232-410b-bd84-2119fac4cc76 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:03.254092 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0caa65e-e232-410b-bd84-2119fac4cc76 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:03.268134 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0caa65e-e232-410b-bd84-2119fac4cc76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:03.275655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-e0caa65e-e232-410b-bd84-2119fac4cc76 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:44:03.275655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:03.275655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:03.275655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:03.275655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:03.275655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:03.275655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:03.275655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:03.275655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:03.275655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:03.275655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:03.275655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:03.275655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:03.275655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:03.275655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:03.275655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:03.276725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:03.276725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:03.276725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:03.276725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:03.276725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:03.276725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:03.276725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:03.276725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:03.276725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:03.276725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:03.276725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:03.276725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:03.276725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:03.276725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:03.276725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:03.276725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:03.277509 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:03.277509 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:03.277509 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:03.277509 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:03.277509 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:03.277509 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:03.277509 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:03.277509 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:03.277509 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:03.277509 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:03.277509 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:44:03.277509 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:03.281977 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 198/405] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 24 15:44:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:44:03.288770 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0caa65e-e232-410b-bd84-2119fac4cc76 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:03.311542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 208/406] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:03.403721 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0caa65e-e232-410b-bd84-2119fac4cc76 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:03.440739 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc65cd-31c5-4213-8769-db64ed0092bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:03.441364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc65cd-31c5-4213-8769-db64ed0092bb None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:03.441647 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc65cd-31c5-4213-8769-db64ed0092bb None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:03.441922 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc65cd-31c5-4213-8769-db64ed0092bb None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:03.442643 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc65cd-31c5-4213-8769-db64ed0092bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:03.442952 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc65cd-31c5-4213-8769-db64ed0092bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:03.444408 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc65cd-31c5-4213-8769-db64ed0092bb None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:03.459790 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 199/407] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:44:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:03.461846 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a741ad-b6d2-4a4a-b6fa-5d337489602b None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:03.598545 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:03.606032 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a741ad-b6d2-4a4a-b6fa-5d337489602b None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:03.648595 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda825b-ab52-4f9c-a6a1-8802b606889a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:03.649271 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda825b-ab52-4f9c-a6a1-8802b606889a None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:03.649553 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda825b-ab52-4f9c-a6a1-8802b606889a None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:03.649826 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda825b-ab52-4f9c-a6a1-8802b606889a None admin] PATH_INFO: `/v3/groups/9bd3688ec85c4fd7b2f786a879c8072e` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:03.650966 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda825b-ab52-4f9c-a6a1-8802b606889a None admin] RBAC: Authorizing `identity:get_group(group_id=9bd3688ec85c4fd7b2f786a879c8072e)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:03.652414 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda825b-ab52-4f9c-a6a1-8802b606889a None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:03.654347 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 209/408] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 24 15:44:03 2022] GET /identity/v3/groups/9bd3688ec85c4fd7b2f786a879c8072e => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:03.660517 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc65cd-31c5-4213-8769-db64ed0092bb None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:03.685010 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda825b-ab52-4f9c-a6a1-8802b606889a None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:03.735864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:03.800285 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda825b-ab52-4f9c-a6a1-8802b606889a None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:03.839051 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004672a-ed6a-4305-a81b-d92318af8ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:03.839695 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004672a-ed6a-4305-a81b-d92318af8ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:03.839976 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004672a-ed6a-4305-a81b-d92318af8ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:03.840251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004672a-ed6a-4305-a81b-d92318af8ad5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:03.851815 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004672a-ed6a-4305-a81b-d92318af8ad5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:03.856878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-c004672a-ed6a-4305-a81b-d92318af8ad5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:44:03.856878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:03.856878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:03.856878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:03.856878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:03.856878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:03.856878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:03.856878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:03.856878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:03.856878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:03.856878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:03.856878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:03.856878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:03.856878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:03.856878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:03.856878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:03.858542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:03.858542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:03.858542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:03.858542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:03.858542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:03.858542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:03.858542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:03.858542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:03.858542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:03.858542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:03.858542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:03.858542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:03.858542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:03.858542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:03.858542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:03.858542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:03.860080 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:03.860080 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:03.860080 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:03.860080 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:03.860080 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:03.860080 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:03.860080 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:03.860080 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:03.860080 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:03.860080 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:03.860080 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:44:03.860080 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:03.860080 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 210/409] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:44:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:44:03.865972 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004672a-ed6a-4305-a81b-d92318af8ad5 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:03.870969 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc65cd-31c5-4213-8769-db64ed0092bb None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:03.914027 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:03.937589 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bc061-98b7-4835-bebb-90f27b32d2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:03.938641 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bc061-98b7-4835-bebb-90f27b32d2ba None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:03.939168 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bc061-98b7-4835-bebb-90f27b32d2ba None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:03.939657 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bc061-98b7-4835-bebb-90f27b32d2ba None admin] PATH_INFO: `/v3/projects/b533b81163ef4776a421230d7bc3e77c` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:03.945009 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277bc061-98b7-4835-bebb-90f27b32d2ba None admin] RBAC: Authorizing `identity:get_project(project_id=b533b81163ef4776a421230d7bc3e77c)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:03.946913 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277bc061-98b7-4835-bebb-90f27b32d2ba None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:03.949259 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 200/410] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:44:03 2022] GET /identity/v3/projects/b533b81163ef4776a421230d7bc3e77c => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:03.955855 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bc061-98b7-4835-bebb-90f27b32d2ba None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:04.014584 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004672a-ed6a-4305-a81b-d92318af8ad5 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:04.079665 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bc061-98b7-4835-bebb-90f27b32d2ba None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:04.082378 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b728b3-3173-42d3-940d-54a3d2ac4d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:04.083807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b728b3-3173-42d3-940d-54a3d2ac4d37 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:04.083807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b728b3-3173-42d3-940d-54a3d2ac4d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:04.083807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b728b3-3173-42d3-940d-54a3d2ac4d37 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:04.084504 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b728b3-3173-42d3-940d-54a3d2ac4d37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:04.084888 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b728b3-3173-42d3-940d-54a3d2ac4d37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:04.086299 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b728b3-3173-42d3-940d-54a3d2ac4d37 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:04.097566 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:04.117150 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 211/411] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:44:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:04.117150 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b728b3-3173-42d3-940d-54a3d2ac4d37 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:04.129281 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e6957-ba28-4108-b78d-a441473be985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:04.130493 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e6957-ba28-4108-b78d-a441473be985 None admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:04.131082 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e6957-ba28-4108-b78d-a441473be985 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:04.132055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e6957-ba28-4108-b78d-a441473be985 None admin] PATH_INFO: `/v3/projects/b533b81163ef4776a421230d7bc3e77c/groups/9bd3688ec85c4fd7b2f786a879c8072e/roles/38df38770b21458d87720d3c4c6f1ff1` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:04.135891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e6957-ba28-4108-b78d-a441473be985 None admin] RBAC: Authorizing `identity:create_grant(project_id=b533b81163ef4776a421230d7bc3e77c, group_id=9bd3688ec85c4fd7b2f786a879c8072e, role_id=38df38770b21458d87720d3c4c6f1ff1)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:04.137859 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e6957-ba28-4108-b78d-a441473be985 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:04.212140 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:04.229787 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 201/412] 10.222.0.64 () {58 vars in 1442 bytes} [Wed Aug 24 15:44:03 2022] PUT /identity/v3/projects/b533b81163ef4776a421230d7bc3e77c/groups/9bd3688ec85c4fd7b2f786a879c8072e/roles/38df38770b21458d87720d3c4c6f1ff1 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:44:04.230628 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b728b3-3173-42d3-940d-54a3d2ac4d37 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:04.287325 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a90fe-ad8e-4931-b01b-2347dd4c22dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:04.287973 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a90fe-ad8e-4931-b01b-2347dd4c22dd None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:04.288254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a90fe-ad8e-4931-b01b-2347dd4c22dd None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:04.288529 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a90fe-ad8e-4931-b01b-2347dd4c22dd None admin] PATH_INFO: `/v3/groups/375a9228cb604dc2b06277b37546c62e` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:04.289752 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a90fe-ad8e-4931-b01b-2347dd4c22dd None admin] RBAC: Authorizing `identity:get_group(group_id=375a9228cb604dc2b06277b37546c62e)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:04.291206 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a90fe-ad8e-4931-b01b-2347dd4c22dd None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:04.293130 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 212/413] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 24 15:44:04 2022] GET /identity/v3/groups/375a9228cb604dc2b06277b37546c62e => generated 229 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:04.303457 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e6957-ba28-4108-b78d-a441473be985 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:04.461035 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e6957-ba28-4108-b78d-a441473be985 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:04.505084 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0980daa-35c2-4f07-828d-33e928c6f592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:04.506223 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0980daa-35c2-4f07-828d-33e928c6f592 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:04.506762 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0980daa-35c2-4f07-828d-33e928c6f592 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:04.507042 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0980daa-35c2-4f07-828d-33e928c6f592 None admin] PATH_INFO: `/v3/projects/23fb7d167a714e0cb4ca2550c38d5f58` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:04.508297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0980daa-35c2-4f07-828d-33e928c6f592 None admin] RBAC: Authorizing `identity:get_project(project_id=23fb7d167a714e0cb4ca2550c38d5f58)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:04.509809 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0980daa-35c2-4f07-828d-33e928c6f592 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:04.511784 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 202/414] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:44:04 2022] GET /identity/v3/projects/23fb7d167a714e0cb4ca2550c38d5f58 => generated 344 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:04.517338 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a90fe-ad8e-4931-b01b-2347dd4c22dd None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:04.553128 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c591d-d68b-4f1d-9840-8920a5aeea74 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:04.553643 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c591d-d68b-4f1d-9840-8920a5aeea74 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:04.554203 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c591d-d68b-4f1d-9840-8920a5aeea74 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:04.556297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 203/415] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:44:04.562151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4a032-5ec0-43f9-a605-b26194f007df None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:04.562632 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4a032-5ec0-43f9-a605-b26194f007df None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:04.563053 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4a032-5ec0-43f9-a605-b26194f007df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:04.582395 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-20b4a032-5ec0-43f9-a605-b26194f007df None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:04.584141 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-20b4a032-5ec0-43f9-a605-b26194f007df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:04.620054 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:04.664792 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 204/416] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:44:04.747811 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a90fe-ad8e-4931-b01b-2347dd4c22dd None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:04.809453 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868a931-7646-4cb0-aff5-8e87dc4b3901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:04.810595 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868a931-7646-4cb0-aff5-8e87dc4b3901 None admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:04.811090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868a931-7646-4cb0-aff5-8e87dc4b3901 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:04.811580 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868a931-7646-4cb0-aff5-8e87dc4b3901 None admin] PATH_INFO: `/v3/projects/23fb7d167a714e0cb4ca2550c38d5f58/groups/375a9228cb604dc2b06277b37546c62e/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:04.814977 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868a931-7646-4cb0-aff5-8e87dc4b3901 None admin] RBAC: Authorizing `identity:create_grant(project_id=23fb7d167a714e0cb4ca2550c38d5f58, group_id=375a9228cb604dc2b06277b37546c62e, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:04.817765 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868a931-7646-4cb0-aff5-8e87dc4b3901 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:04.899792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 213/417] 10.222.0.64 () {58 vars in 1442 bytes} [Wed Aug 24 15:44:04 2022] PUT /identity/v3/projects/23fb7d167a714e0cb4ca2550c38d5f58/groups/375a9228cb604dc2b06277b37546c62e/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:44:05.115099 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4a032-5ec0-43f9-a605-b26194f007df None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:05.234603 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4a032-5ec0-43f9-a605-b26194f007df None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:05.272085 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b8c53-05af-41aa-9c00-dbfa9eecd830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:05.273011 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b8c53-05af-41aa-9c00-dbfa9eecd830 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:05.273464 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b8c53-05af-41aa-9c00-dbfa9eecd830 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:05.273883 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b8c53-05af-41aa-9c00-dbfa9eecd830 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:05.291381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b8c53-05af-41aa-9c00-dbfa9eecd830 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:05.301567 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-4c0b8c53-05af-41aa-9c00-dbfa9eecd830 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:44:05.301567 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:05.301567 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:05.301567 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:05.301567 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:05.301567 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:05.301567 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:05.301567 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:05.301567 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:05.301567 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:05.301567 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:05.301567 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:05.301567 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:05.301567 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:05.301567 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:05.301567 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:05.302703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:05.302703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:05.302703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:05.302703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:05.302703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:05.302703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:05.302703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:05.302703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:05.302703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:05.302703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:05.302703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:05.302703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:05.302703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:05.302703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:05.302703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:05.302703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:05.303632 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:05.303632 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:05.303632 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:05.303632 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:05.303632 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:05.303632 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:05.303632 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:05.303632 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:05.303632 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:05.303632 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:05.303632 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:44:05.303632 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:05.305880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 205/418] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:44:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:05.315106 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868a931-7646-4cb0-aff5-8e87dc4b3901 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:05.363694 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:05.559751 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868a931-7646-4cb0-aff5-8e87dc4b3901 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:05.643429 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc87fd8-c4ad-451b-a489-ec5e4d117fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:05.644546 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc87fd8-c4ad-451b-a489-ec5e4d117fdd None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:05.645070 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc87fd8-c4ad-451b-a489-ec5e4d117fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:05.645618 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc87fd8-c4ad-451b-a489-ec5e4d117fdd None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:05.646808 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc87fd8-c4ad-451b-a489-ec5e4d117fdd None admin] RBAC: Adding query filter params (name=member) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:05.647352 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc87fd8-c4ad-451b-a489-ec5e4d117fdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:05.649940 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc87fd8-c4ad-451b-a489-ec5e4d117fdd None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:05.674069 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 214/419] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 24 15:44:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:05.681760 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b8c53-05af-41aa-9c00-dbfa9eecd830 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:05.730085 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:05.830410 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b8c53-05af-41aa-9c00-dbfa9eecd830 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:05.840982 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9c539-b17b-42b7-ace2-b0b74bc5b5e1 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:05.841488 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9c539-b17b-42b7-ace2-b0b74bc5b5e1 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:05.841591 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9c539-b17b-42b7-ace2-b0b74bc5b5e1 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:05.843207 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 215/420] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:44:05.850059 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5df922-3f6d-4ab7-9b58-221094e6c3d5 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:05.850415 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5df922-3f6d-4ab7-9b58-221094e6c3d5 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:05.850673 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5df922-3f6d-4ab7-9b58-221094e6c3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:05.875438 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7074eb2-f53d-47ca-b094-d44795dc9468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:05.876062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7074eb2-f53d-47ca-b094-d44795dc9468 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:05.876346 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7074eb2-f53d-47ca-b094-d44795dc9468 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:05.876661 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7074eb2-f53d-47ca-b094-d44795dc9468 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:05.894152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-4b5df922-3f6d-4ab7-9b58-221094e6c3d5 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:05.895554 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-4b5df922-3f6d-4ab7-9b58-221094e6c3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:05.994105 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7074eb2-f53d-47ca-b094-d44795dc9468 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:05.997486 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7074eb2-f53d-47ca-b094-d44795dc9468 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:06.000716 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 216/421] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:06.003013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f22bbd-ca49-4819-8d11-f79cc196cd90 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:06.003762 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f22bbd-ca49-4819-8d11-f79cc196cd90 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:06.004415 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f22bbd-ca49-4819-8d11-f79cc196cd90 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:06.015594 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 217/422] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:06 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:06.024508 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecb9dc-971b-4198-838e-ba54b37d6e1b None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:06.025267 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecb9dc-971b-4198-838e-ba54b37d6e1b None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:06.025969 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecb9dc-971b-4198-838e-ba54b37d6e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:06.044231 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:06.061594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:06.065612 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-20ecb9dc-971b-4198-838e-ba54b37d6e1b None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:06.066832 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-20ecb9dc-971b-4198-838e-ba54b37d6e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:06.157160 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 206/423] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:44:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:06.159246 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7074eb2-f53d-47ca-b094-d44795dc9468 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:06.266314 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 218/424] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:44:06.277212 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7074eb2-f53d-47ca-b094-d44795dc9468 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:06.321666 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:06.322328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ecb9dc-971b-4198-838e-ba54b37d6e1b None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:06.341974 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49f4d6-f657-45e2-80b1-b0b75888fe18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:06.342661 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49f4d6-f657-45e2-80b1-b0b75888fe18 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:06.342944 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49f4d6-f657-45e2-80b1-b0b75888fe18 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:06.343219 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49f4d6-f657-45e2-80b1-b0b75888fe18 None admin] PATH_INFO: `/v3/projects/db70f99b67e1479f847c3ac324683445` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:06.349752 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49f4d6-f657-45e2-80b1-b0b75888fe18 None admin] RBAC: Authorizing `identity:get_project(project_id=db70f99b67e1479f847c3ac324683445)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:06.351234 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49f4d6-f657-45e2-80b1-b0b75888fe18 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:06.353311 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 207/425] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:44:06 2022] GET /identity/v3/projects/db70f99b67e1479f847c3ac324683445 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:44:06.358712 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49f4d6-f657-45e2-80b1-b0b75888fe18 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:06.473015 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ecb9dc-971b-4198-838e-ba54b37d6e1b None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:06.474872 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49f4d6-f657-45e2-80b1-b0b75888fe18 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:06.511761 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ecb4c-94e3-4a65-8b7a-70a1c05ed60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:06.512890 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ecb4c-94e3-4a65-8b7a-70a1c05ed60e None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:06.513372 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ecb4c-94e3-4a65-8b7a-70a1c05ed60e None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:06.513840 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ecb4c-94e3-4a65-8b7a-70a1c05ed60e None admin] PATH_INFO: `/v3/groups/9bd3688ec85c4fd7b2f786a879c8072e` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:06.515181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ecb4c-94e3-4a65-8b7a-70a1c05ed60e None admin] RBAC: Authorizing `identity:get_group(group_id=9bd3688ec85c4fd7b2f786a879c8072e)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:06.516870 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ecb4c-94e3-4a65-8b7a-70a1c05ed60e None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:06.519059 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 208/426] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 24 15:44:06 2022] GET /identity/v3/groups/9bd3688ec85c4fd7b2f786a879c8072e => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:44:06.525019 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ecb4c-94e3-4a65-8b7a-70a1c05ed60e None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:06.549396 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064eb7e8-eb20-4e7a-b8e8-217746c054d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:06.550058 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eb7e8-eb20-4e7a-b8e8-217746c054d1 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:06.550338 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eb7e8-eb20-4e7a-b8e8-217746c054d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:06.550618 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eb7e8-eb20-4e7a-b8e8-217746c054d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:06.552878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:06.570324 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064eb7e8-eb20-4e7a-b8e8-217746c054d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:06.575199 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-064eb7e8-eb20-4e7a-b8e8-217746c054d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:44:06.575199 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:06.575199 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:06.575199 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:06.575199 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:06.575199 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:06.575199 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:06.575199 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:06.575199 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:06.575199 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:06.575199 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:06.575199 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:06.575199 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:06.575199 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:06.575199 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:06.575199 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:06.576151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:06.576151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:06.576151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:06.576151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:06.576151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:06.576151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:06.576151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:06.576151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:06.576151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:06.576151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:06.576151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:06.576151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:06.576151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:06.576151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:06.576151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:06.576151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:06.576962 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:06.576962 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:06.576962 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:06.576962 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:06.576962 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:06.576962 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:06.576962 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:06.576962 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:06.576962 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:06.576962 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:06.576962 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:44:06.576962 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:06.584924 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 219/427] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:44:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:44:06.588938 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064eb7e8-eb20-4e7a-b8e8-217746c054d1 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:06.607633 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:06.647863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ecb4c-94e3-4a65-8b7a-70a1c05ed60e None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:06.684598 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860ff8c-3980-497c-a0f5-bb25a7d4d28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:06.685412 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860ff8c-3980-497c-a0f5-bb25a7d4d28b None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:06.685791 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860ff8c-3980-497c-a0f5-bb25a7d4d28b None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:06.686163 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860ff8c-3980-497c-a0f5-bb25a7d4d28b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:06.687026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3860ff8c-3980-497c-a0f5-bb25a7d4d28b None admin] RBAC: Adding query filter params (group.id=9bd3688ec85c4fd7b2f786a879c8072e, role.id=0ea43d9dfb184e27b48d251fd38463db, scope.project.id=db70f99b67e1479f847c3ac324683445) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:06.687444 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3860ff8c-3980-497c-a0f5-bb25a7d4d28b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:06.689038 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3860ff8c-3980-497c-a0f5-bb25a7d4d28b None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:06.697305 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 209/428] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 24 15:44:06 2022] GET /identity/v3/role_assignments?group.id=9bd3688ec85c4fd7b2f786a879c8072e&scope.project.id=db70f99b67e1479f847c3ac324683445&role.id=0ea43d9dfb184e27b48d251fd38463db => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:44:06.698383 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860ff8c-3980-497c-a0f5-bb25a7d4d28b None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:06.721822 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064eb7e8-eb20-4e7a-b8e8-217746c054d1 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:06.764101 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ec27c-3696-44bc-a623-4706b34768f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:06.765338 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ec27c-3696-44bc-a623-4706b34768f4 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:06.765806 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ec27c-3696-44bc-a623-4706b34768f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:06.766357 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ec27c-3696-44bc-a623-4706b34768f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:06.779993 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ec27c-3696-44bc-a623-4706b34768f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:06.785871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-c86ec27c-3696-44bc-a623-4706b34768f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:44:06.785871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:06.785871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:06.785871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:06.785871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:06.785871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:06.785871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:06.785871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:06.785871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:06.785871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:06.785871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:06.785871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:06.785871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:06.785871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:06.785871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:06.785871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:06.786836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:06.786836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:06.786836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:06.786836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:06.786836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:06.786836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:06.786836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:06.786836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:06.786836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:06.786836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:06.786836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:06.786836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:06.786836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:06.786836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:06.786836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:06.786836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:06.787648 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:06.787648 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:06.787648 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:06.787648 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:06.787648 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:06.787648 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:06.787648 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:06.787648 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:06.787648 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:06.787648 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:06.787648 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:44:06.787648 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:06.790215 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 220/429] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 24 15:44:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:06.796868 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ec27c-3696-44bc-a623-4706b34768f4 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:06.814557 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860ff8c-3980-497c-a0f5-bb25a7d4d28b None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:06.844516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:06.862235 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac29b82-3251-4d44-9377-b5ffe2ec74ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:06.862916 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac29b82-3251-4d44-9377-b5ffe2ec74ea None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:06.863202 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac29b82-3251-4d44-9377-b5ffe2ec74ea None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:06.863476 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac29b82-3251-4d44-9377-b5ffe2ec74ea None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:06.869720 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac29b82-3251-4d44-9377-b5ffe2ec74ea None admin] RBAC: Adding query filter params (name=member) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:06.872610 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac29b82-3251-4d44-9377-b5ffe2ec74ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:06.875138 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac29b82-3251-4d44-9377-b5ffe2ec74ea None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:06.889069 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:06.900079 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 210/430] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 24 15:44:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:06.902263 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac29b82-3251-4d44-9377-b5ffe2ec74ea None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:06.975389 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ec27c-3696-44bc-a623-4706b34768f4 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:07.024154 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56263c99-c76b-450f-a12e-37a7943b4e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:07.024738 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56263c99-c76b-450f-a12e-37a7943b4e73 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:07.025019 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56263c99-c76b-450f-a12e-37a7943b4e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:07.025312 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56263c99-c76b-450f-a12e-37a7943b4e73 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:07.025989 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56263c99-c76b-450f-a12e-37a7943b4e73 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:07.026289 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56263c99-c76b-450f-a12e-37a7943b4e73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:07.027702 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56263c99-c76b-450f-a12e-37a7943b4e73 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:07.038593 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 221/431] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:44:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:07.043423 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c92de9-0381-4386-af46-6ba7e3f294d4 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:07.043423 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c92de9-0381-4386-af46-6ba7e3f294d4 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:07.043423 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c92de9-0381-4386-af46-6ba7e3f294d4 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:07.043423 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 222/432] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:07.047747 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c92de9-0381-4386-af46-6ba7e3f294d4 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:07.069985 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac29b82-3251-4d44-9377-b5ffe2ec74ea None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:07.115156 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da03eb-a2a1-4417-90e4-3d596584f294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:07.115997 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da03eb-a2a1-4417-90e4-3d596584f294 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:07.116277 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da03eb-a2a1-4417-90e4-3d596584f294 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:07.116757 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da03eb-a2a1-4417-90e4-3d596584f294 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:07.195636 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c92de9-0381-4386-af46-6ba7e3f294d4 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:07.196563 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:07.211961 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da03eb-a2a1-4417-90e4-3d596584f294 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:07.213695 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da03eb-a2a1-4417-90e4-3d596584f294 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:07.221045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:07.255543 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d440520-f041-438f-a7ca-255bbedc8c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:07.256561 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d440520-f041-438f-a7ca-255bbedc8c88 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:07.257014 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d440520-f041-438f-a7ca-255bbedc8c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:07.257479 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d440520-f041-438f-a7ca-255bbedc8c88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:07.349780 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d440520-f041-438f-a7ca-255bbedc8c88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:07.351293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d440520-f041-438f-a7ca-255bbedc8c88 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:07.356460 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 211/433] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:44:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:07.361354 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcbff6-3221-4300-919a-1000267e8e96 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:07.361354 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcbff6-3221-4300-919a-1000267e8e96 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:07.361354 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcbff6-3221-4300-919a-1000267e8e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:07.378855 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-33fcbff6-3221-4300-919a-1000267e8e96 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:07.381385 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-33fcbff6-3221-4300-919a-1000267e8e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:07.468655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 212/434] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:07.468655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcbff6-3221-4300-919a-1000267e8e96 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:07.488714 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:07.492810 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 223/435] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:44:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:07.496062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d440520-f041-438f-a7ca-255bbedc8c88 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:07.523072 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:07.600505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcbff6-3221-4300-919a-1000267e8e96 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:07.634166 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d440520-f041-438f-a7ca-255bbedc8c88 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:07.643215 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344371c-15a8-4edc-96c0-6731fd2b42fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:07.644225 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344371c-15a8-4edc-96c0-6731fd2b42fb None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:07.644744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344371c-15a8-4edc-96c0-6731fd2b42fb None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:07.645207 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344371c-15a8-4edc-96c0-6731fd2b42fb None admin] PATH_INFO: `/v3/projects/b533b81163ef4776a421230d7bc3e77c` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:07.647108 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344371c-15a8-4edc-96c0-6731fd2b42fb None admin] RBAC: Authorizing `identity:get_project(project_id=b533b81163ef4776a421230d7bc3e77c)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:07.648959 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344371c-15a8-4edc-96c0-6731fd2b42fb None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:07.656269 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 213/436] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:44:07 2022] GET /identity/v3/projects/b533b81163ef4776a421230d7bc3e77c => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:07.656269 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278a257-15f8-4a2e-989a-0ff795111deb None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:07.656269 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278a257-15f8-4a2e-989a-0ff795111deb None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:07.656269 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278a257-15f8-4a2e-989a-0ff795111deb None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:07.656269 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 214/437] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:07.657427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278a257-15f8-4a2e-989a-0ff795111deb None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:07.681915 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159496f-6a4b-45a4-b18b-90c0fbb4221a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:07.682558 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159496f-6a4b-45a4-b18b-90c0fbb4221a None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:07.682841 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159496f-6a4b-45a4-b18b-90c0fbb4221a None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:07.683111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159496f-6a4b-45a4-b18b-90c0fbb4221a None admin] PATH_INFO: `/v3/projects/db70f99b67e1479f847c3ac324683445` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:07.684241 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159496f-6a4b-45a4-b18b-90c0fbb4221a None admin] RBAC: Authorizing `identity:get_project(project_id=db70f99b67e1479f847c3ac324683445)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:07.685737 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159496f-6a4b-45a4-b18b-90c0fbb4221a None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:07.687365 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 224/438] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:44:07 2022] GET /identity/v3/projects/db70f99b67e1479f847c3ac324683445 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:07.688468 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75169e-200a-45a0-9d52-6048f1a76d17 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:07.688775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75169e-200a-45a0-9d52-6048f1a76d17 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:07.689048 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75169e-200a-45a0-9d52-6048f1a76d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:07.707464 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-0d75169e-200a-45a0-9d52-6048f1a76d17 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:07.708729 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-0d75169e-200a-45a0-9d52-6048f1a76d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:07.766362 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:07.779024 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278a257-15f8-4a2e-989a-0ff795111deb None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:07.780014 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 225/439] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:07.781141 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75169e-200a-45a0-9d52-6048f1a76d17 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:07.800120 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:07.819364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7f3a3-86b5-4767-a79e-ad5efa4daf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:07.820010 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7f3a3-86b5-4767-a79e-ad5efa4daf95 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:07.820291 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7f3a3-86b5-4767-a79e-ad5efa4daf95 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:07.820575 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7f3a3-86b5-4767-a79e-ad5efa4daf95 None admin] PATH_INFO: `/v3/groups/9bd3688ec85c4fd7b2f786a879c8072e` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:07.821723 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e7f3a3-86b5-4767-a79e-ad5efa4daf95 None admin] RBAC: Authorizing `identity:get_group(group_id=9bd3688ec85c4fd7b2f786a879c8072e)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:07.823255 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e7f3a3-86b5-4767-a79e-ad5efa4daf95 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:07.825076 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 215/440] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 24 15:44:07 2022] GET /identity/v3/groups/9bd3688ec85c4fd7b2f786a879c8072e => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:07.830087 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7f3a3-86b5-4767-a79e-ad5efa4daf95 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:07.901110 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75169e-200a-45a0-9d52-6048f1a76d17 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:07.940600 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5303982-0188-4c26-ae88-5d180925f484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:07.941257 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5303982-0188-4c26-ae88-5d180925f484 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:07.941530 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5303982-0188-4c26-ae88-5d180925f484 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:07.941794 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5303982-0188-4c26-ae88-5d180925f484 None admin] PATH_INFO: `/v3/groups/9bd3688ec85c4fd7b2f786a879c8072e` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:07.942963 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5303982-0188-4c26-ae88-5d180925f484 None admin] RBAC: Authorizing `identity:get_group(group_id=9bd3688ec85c4fd7b2f786a879c8072e)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:07.944421 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5303982-0188-4c26-ae88-5d180925f484 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:07.946100 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 226/441] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 24 15:44:07 2022] GET /identity/v3/groups/9bd3688ec85c4fd7b2f786a879c8072e => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:07.948054 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7f3a3-86b5-4767-a79e-ad5efa4daf95 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:07.949704 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5303982-0188-4c26-ae88-5d180925f484 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:07.990811 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee625ab-a8fe-44d2-9f1b-89b8737c8b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:07.991577 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee625ab-a8fe-44d2-9f1b-89b8737c8b6e None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:07.991854 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee625ab-a8fe-44d2-9f1b-89b8737c8b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:07.992120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee625ab-a8fe-44d2-9f1b-89b8737c8b6e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:08.003021 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee625ab-a8fe-44d2-9f1b-89b8737c8b6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:08.008766 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-3ee625ab-a8fe-44d2-9f1b-89b8737c8b6e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:44:08.008766 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:08.008766 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:08.008766 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:08.008766 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:08.008766 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:08.008766 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:08.008766 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:08.008766 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:08.008766 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:08.008766 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:08.008766 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:08.008766 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:08.008766 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:08.008766 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:08.008766 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:08.010348 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:08.010348 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:08.010348 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:08.010348 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:08.010348 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:08.010348 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:08.010348 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:08.010348 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:08.010348 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:08.010348 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:08.010348 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:08.010348 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:08.010348 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:08.010348 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:08.010348 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:08.010348 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:08.011974 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:08.011974 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:08.011974 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:08.011974 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:08.011974 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:08.011974 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:08.011974 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:08.011974 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:08.011974 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:08.011974 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:08.011974 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:44:08.011974 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:08.011974 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 216/442] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 24 15:44:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:08.011974 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee625ab-a8fe-44d2-9f1b-89b8737c8b6e None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:08.033830 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:08.055955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:08.075346 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5303982-0188-4c26-ae88-5d180925f484 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:08.113824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9485eae-c916-42cb-9374-f50d67ad8d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:08.114447 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9485eae-c916-42cb-9374-f50d67ad8d20 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:08.114722 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9485eae-c916-42cb-9374-f50d67ad8d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:08.115003 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9485eae-c916-42cb-9374-f50d67ad8d20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:08.115739 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9485eae-c916-42cb-9374-f50d67ad8d20 None admin] RBAC: Adding query filter params (group.id=9bd3688ec85c4fd7b2f786a879c8072e, role.id=0ea43d9dfb184e27b48d251fd38463db, scope.project.id=b533b81163ef4776a421230d7bc3e77c) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:08.116050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9485eae-c916-42cb-9374-f50d67ad8d20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:08.117534 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9485eae-c916-42cb-9374-f50d67ad8d20 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:08.121527 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee625ab-a8fe-44d2-9f1b-89b8737c8b6e None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:08.125490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 227/443] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 24 15:44:07 2022] GET /identity/v3/role_assignments?group.id=9bd3688ec85c4fd7b2f786a879c8072e&scope.project.id=b533b81163ef4776a421230d7bc3e77c&role.id=0ea43d9dfb184e27b48d251fd38463db => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:08.126302 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9485eae-c916-42cb-9374-f50d67ad8d20 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:08.167774 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de79f9-8cdd-4fbd-8d0c-13df2c67b462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:08.168342 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de79f9-8cdd-4fbd-8d0c-13df2c67b462 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:08.168641 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de79f9-8cdd-4fbd-8d0c-13df2c67b462 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:08.168929 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de79f9-8cdd-4fbd-8d0c-13df2c67b462 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:08.169676 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de79f9-8cdd-4fbd-8d0c-13df2c67b462 None admin] RBAC: Adding query filter params (group.id=9bd3688ec85c4fd7b2f786a879c8072e, role.id=38df38770b21458d87720d3c4c6f1ff1, scope.project.id=db70f99b67e1479f847c3ac324683445) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:08.169993 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de79f9-8cdd-4fbd-8d0c-13df2c67b462 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:08.171489 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de79f9-8cdd-4fbd-8d0c-13df2c67b462 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:08.192678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 217/444] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 24 15:44:08 2022] GET /identity/v3/role_assignments?group.id=9bd3688ec85c4fd7b2f786a879c8072e&scope.project.id=db70f99b67e1479f847c3ac324683445&role.id=38df38770b21458d87720d3c4c6f1ff1 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:08.192678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de79f9-8cdd-4fbd-8d0c-13df2c67b462 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:08.277974 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9485eae-c916-42cb-9374-f50d67ad8d20 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:08.295041 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:08.324770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bed13-03c1-416a-8248-f4ca9a41eec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:08.325465 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bed13-03c1-416a-8248-f4ca9a41eec6 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:08.325850 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bed13-03c1-416a-8248-f4ca9a41eec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:08.326028 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bed13-03c1-416a-8248-f4ca9a41eec6 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:08.327167 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7bed13-03c1-416a-8248-f4ca9a41eec6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:08.327167 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7bed13-03c1-416a-8248-f4ca9a41eec6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:08.328430 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7bed13-03c1-416a-8248-f4ca9a41eec6 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:08.332215 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de79f9-8cdd-4fbd-8d0c-13df2c67b462 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:08.338448 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 228/445] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:44:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:08.344251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bed13-03c1-416a-8248-f4ca9a41eec6 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:08.358509 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:08.388538 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b91ea7-326e-418f-bd61-5059602ef2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:08.389226 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b91ea7-326e-418f-bd61-5059602ef2e7 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:08.389550 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b91ea7-326e-418f-bd61-5059602ef2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:08.389907 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b91ea7-326e-418f-bd61-5059602ef2e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:08.406824 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b91ea7-326e-418f-bd61-5059602ef2e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:08.412598 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-61b91ea7-326e-418f-bd61-5059602ef2e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:44:08.412598 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:08.412598 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:08.412598 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:08.412598 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:08.412598 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:08.412598 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:08.412598 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:08.412598 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:08.412598 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:08.412598 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:08.412598 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:08.412598 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:08.412598 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:08.412598 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:08.412598 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:08.413602 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:08.413602 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:08.413602 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:08.413602 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:08.413602 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:08.413602 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:08.413602 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:08.413602 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:08.413602 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:08.413602 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:08.413602 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:08.413602 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:08.413602 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:08.413602 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:08.413602 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:08.413602 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:08.414427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:08.414427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:08.414427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:08.414427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:08.414427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:08.414427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:08.414427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:08.414427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:08.414427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:08.414427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:08.414427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:44:08.414427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:08.416933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 218/446] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:44:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:08.419960 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b91ea7-326e-418f-bd61-5059602ef2e7 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:08.484043 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bed13-03c1-416a-8248-f4ca9a41eec6 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:08.525073 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d0f54-a8d7-4654-b6b9-23d9477614f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:08.525690 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d0f54-a8d7-4654-b6b9-23d9477614f0 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:08.525971 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d0f54-a8d7-4654-b6b9-23d9477614f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:08.526243 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d0f54-a8d7-4654-b6b9-23d9477614f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:08.563417 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b91ea7-326e-418f-bd61-5059602ef2e7 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:08.604416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d0f54-a8d7-4654-b6b9-23d9477614f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:08.605938 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d0f54-a8d7-4654-b6b9-23d9477614f0 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:08.606199 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbedc8c-4ee7-40a4-ade3-a2f965e2fde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:08.606829 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbedc8c-4ee7-40a4-ade3-a2f965e2fde7 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:08.607111 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbedc8c-4ee7-40a4-ade3-a2f965e2fde7 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:08.607383 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbedc8c-4ee7-40a4-ade3-a2f965e2fde7 None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:08.608071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbedc8c-4ee7-40a4-ade3-a2f965e2fde7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:08.608378 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbedc8c-4ee7-40a4-ade3-a2f965e2fde7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:08.609901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbedc8c-4ee7-40a4-ade3-a2f965e2fde7 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:08.617486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:08.619878 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 219/447] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:44:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:44:08.628680 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbedc8c-4ee7-40a4-ade3-a2f965e2fde7 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:08.632982 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:08.729090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 229/448] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:44:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 15:44:08.739766 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d0f54-a8d7-4654-b6b9-23d9477614f0 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:08.761135 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbedc8c-4ee7-40a4-ade3-a2f965e2fde7 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:08.796153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d340c-9714-4831-9b8a-f07d35e0e817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:08.797063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d340c-9714-4831-9b8a-f07d35e0e817 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:08.797469 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d340c-9714-4831-9b8a-f07d35e0e817 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:08.797874 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d340c-9714-4831-9b8a-f07d35e0e817 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:08.839496 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d0f54-a8d7-4654-b6b9-23d9477614f0 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:08.848843 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:08.866314 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d340c-9714-4831-9b8a-f07d35e0e817 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:08.867758 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d340c-9714-4831-9b8a-f07d35e0e817 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:08.869643 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:08.874810 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d8331-bcfa-46ff-aa09-4fe1d317a39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:08.875449 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d8331-bcfa-46ff-aa09-4fe1d317a39a None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:08.875731 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d8331-bcfa-46ff-aa09-4fe1d317a39a None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:08.876003 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d8331-bcfa-46ff-aa09-4fe1d317a39a None admin] PATH_INFO: `/v3/projects/b533b81163ef4776a421230d7bc3e77c` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:08.877234 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d8331-bcfa-46ff-aa09-4fe1d317a39a None admin] RBAC: Authorizing `identity:get_project(project_id=b533b81163ef4776a421230d7bc3e77c)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:08.878763 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d8331-bcfa-46ff-aa09-4fe1d317a39a None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:08.881333 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 230/449] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:44:08 2022] GET /identity/v3/projects/b533b81163ef4776a421230d7bc3e77c => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:08.886933 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d8331-bcfa-46ff-aa09-4fe1d317a39a None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:08.974622 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 220/450] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:44:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 15:44:08.980546 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d340c-9714-4831-9b8a-f07d35e0e817 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:08.998135 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d8331-bcfa-46ff-aa09-4fe1d317a39a None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:09.035251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba5e8d-7657-4726-843b-63f1ed4a3e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:09.036763 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba5e8d-7657-4726-843b-63f1ed4a3e8b None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:09.037049 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba5e8d-7657-4726-843b-63f1ed4a3e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:09.037309 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba5e8d-7657-4726-843b-63f1ed4a3e8b None admin] PATH_INFO: `/v3/groups/9bd3688ec85c4fd7b2f786a879c8072e` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:09.038489 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba5e8d-7657-4726-843b-63f1ed4a3e8b None admin] RBAC: Authorizing `identity:get_group(group_id=9bd3688ec85c4fd7b2f786a879c8072e)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:09.039999 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba5e8d-7657-4726-843b-63f1ed4a3e8b None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:09.041649 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 231/451] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 24 15:44:08 2022] GET /identity/v3/groups/9bd3688ec85c4fd7b2f786a879c8072e => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:44:09.047800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba5e8d-7657-4726-843b-63f1ed4a3e8b None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:09.083387 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d340c-9714-4831-9b8a-f07d35e0e817 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:09.085102 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:09.095590 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:09.121616 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c9951-7827-4e2a-b75d-aa211befc247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:09.122254 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c9951-7827-4e2a-b75d-aa211befc247 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:09.122528 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c9951-7827-4e2a-b75d-aa211befc247 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:09.122792 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c9951-7827-4e2a-b75d-aa211befc247 None admin] PATH_INFO: `/v3/projects/23fb7d167a714e0cb4ca2550c38d5f58` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:09.124965 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c9951-7827-4e2a-b75d-aa211befc247 None admin] RBAC: Authorizing `identity:get_project(project_id=23fb7d167a714e0cb4ca2550c38d5f58)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:09.125515 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c9951-7827-4e2a-b75d-aa211befc247 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:09.127523 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 221/452] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:44:08 2022] GET /identity/v3/projects/23fb7d167a714e0cb4ca2550c38d5f58 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:44:09.135277 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c9951-7827-4e2a-b75d-aa211befc247 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:09.161439 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba5e8d-7657-4726-843b-63f1ed4a3e8b None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:09.208982 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ddcef4-79fe-45b2-9061-553975107536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:09.209589 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddcef4-79fe-45b2-9061-553975107536 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:09.209866 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddcef4-79fe-45b2-9061-553975107536 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:09.210137 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddcef4-79fe-45b2-9061-553975107536 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:09.210885 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ddcef4-79fe-45b2-9061-553975107536 None admin] RBAC: Adding query filter params (group.id=9bd3688ec85c4fd7b2f786a879c8072e, role.id=38df38770b21458d87720d3c4c6f1ff1, scope.project.id=b533b81163ef4776a421230d7bc3e77c) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:09.211186 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ddcef4-79fe-45b2-9061-553975107536 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:09.212655 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ddcef4-79fe-45b2-9061-553975107536 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:09.219068 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 232/453] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 24 15:44:09 2022] GET /identity/v3/role_assignments?group.id=9bd3688ec85c4fd7b2f786a879c8072e&scope.project.id=b533b81163ef4776a421230d7bc3e77c&role.id=38df38770b21458d87720d3c4c6f1ff1 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:44:09.255430 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c9951-7827-4e2a-b75d-aa211befc247 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:09.297361 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31631296-30d0-4b32-8d0a-0a3097347316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:09.298028 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31631296-30d0-4b32-8d0a-0a3097347316 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:09.298298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31631296-30d0-4b32-8d0a-0a3097347316 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:09.298568 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31631296-30d0-4b32-8d0a-0a3097347316 None admin] PATH_INFO: `/v3/groups/375a9228cb604dc2b06277b37546c62e` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:09.299803 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31631296-30d0-4b32-8d0a-0a3097347316 None admin] RBAC: Authorizing `identity:get_group(group_id=375a9228cb604dc2b06277b37546c62e)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:09.301895 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31631296-30d0-4b32-8d0a-0a3097347316 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:09.303895 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 222/454] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 24 15:44:09 2022] GET /identity/v3/groups/375a9228cb604dc2b06277b37546c62e => generated 229 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:09.310008 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ddcef4-79fe-45b2-9061-553975107536 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:09.422492 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ddcef4-79fe-45b2-9061-553975107536 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:09.432241 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:09.463940 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9364b2-9a41-459e-9b23-e0a5d3c4132b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:09.464550 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9364b2-9a41-459e-9b23-e0a5d3c4132b None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:09.464864 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9364b2-9a41-459e-9b23-e0a5d3c4132b None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:09.465258 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9364b2-9a41-459e-9b23-e0a5d3c4132b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:09.466041 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9364b2-9a41-459e-9b23-e0a5d3c4132b None admin] RBAC: Adding query filter params (group.id=375a9228cb604dc2b06277b37546c62e, role.id=c6745e08f9da4a2bae8510c9983635c3, scope.project.id=23fb7d167a714e0cb4ca2550c38d5f58) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:09.466352 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9364b2-9a41-459e-9b23-e0a5d3c4132b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:09.467805 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9364b2-9a41-459e-9b23-e0a5d3c4132b None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:09.475146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 233/455] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 24 15:44:09 2022] GET /identity/v3/role_assignments?group.id=375a9228cb604dc2b06277b37546c62e&scope.project.id=23fb7d167a714e0cb4ca2550c38d5f58&role.id=c6745e08f9da4a2bae8510c9983635c3 => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:11.820293 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d668a-ecb7-46e4-be9f-2bd00b7ad1fa None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:11.820847 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d668a-ecb7-46e4-be9f-2bd00b7ad1fa None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:11.820847 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d668a-ecb7-46e4-be9f-2bd00b7ad1fa None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:11.822478 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 223/456] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:11.828346 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604849fb-1e5c-45e7-9eb2-4aa5a88b6d92 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:11.829170 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604849fb-1e5c-45e7-9eb2-4aa5a88b6d92 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:11.829586 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604849fb-1e5c-45e7-9eb2-4aa5a88b6d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:11.858113 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-604849fb-1e5c-45e7-9eb2-4aa5a88b6d92 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:11.859576 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-604849fb-1e5c-45e7-9eb2-4aa5a88b6d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:11.984161 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 234/457] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:12.130958 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf2f1b-e8e0-411a-9e7c-8bdb188e363b None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:12.131320 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf2f1b-e8e0-411a-9e7c-8bdb188e363b None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:12.131772 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf2f1b-e8e0-411a-9e7c-8bdb188e363b None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:12.133553 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 224/458] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:12.139373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3535674-4958-48ef-b7e8-957f00a1fe4c None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:12.139659 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3535674-4958-48ef-b7e8-957f00a1fe4c None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:12.139927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3535674-4958-48ef-b7e8-957f00a1fe4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:12.161898 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-d3535674-4958-48ef-b7e8-957f00a1fe4c None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:12.163104 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-d3535674-4958-48ef-b7e8-957f00a1fe4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:12.254013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 235/459] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:12.352670 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf2f1b-e8e0-411a-9e7c-8bdb188e363b None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:12.406257 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:12.481689 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf2f1b-e8e0-411a-9e7c-8bdb188e363b None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:12.529130 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d72af-997b-4cb4-b962-5b43f1bc95e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:12.529776 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d72af-997b-4cb4-b962-5b43f1bc95e9 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:12.530054 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d72af-997b-4cb4-b962-5b43f1bc95e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:12.530572 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d72af-997b-4cb4-b962-5b43f1bc95e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:12.546050 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d72af-997b-4cb4-b962-5b43f1bc95e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:12.547522 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d72af-997b-4cb4-b962-5b43f1bc95e9 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:12.566318 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-e43d72af-997b-4cb4-b962-5b43f1bc95e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:12.566318 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:12.566318 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:12.566318 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:12.566318 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:12.566318 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:12.566318 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:12.566318 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:12.566318 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:12.566318 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:12.566318 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:12.566318 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:12.566318 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:12.566318 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:12.566318 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:12.566318 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:12.567812 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:12.567812 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:12.567812 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:12.567812 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:12.567812 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:12.567812 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:12.567812 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:12.567812 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:12.567812 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:12.567812 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:12.567812 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:12.567812 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:12.567812 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:12.567812 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:12.567812 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:12.567812 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:12.567812 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:12.568953 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:12.568953 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:12.568953 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:12.568953 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 225/460] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:12.575370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3535674-4958-48ef-b7e8-957f00a1fe4c None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:12.585814 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d72af-997b-4cb4-b962-5b43f1bc95e9 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:12.633810 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:12.734879 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3535674-4958-48ef-b7e8-957f00a1fe4c None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:12.741072 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:12.758446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d72af-997b-4cb4-b962-5b43f1bc95e9 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:12.784181 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e64ec-8ffa-4c64-8c1f-3dd6bd3e2f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:12.784824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e64ec-8ffa-4c64-8c1f-3dd6bd3e2f0e None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:12.785104 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e64ec-8ffa-4c64-8c1f-3dd6bd3e2f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:12.785419 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e64ec-8ffa-4c64-8c1f-3dd6bd3e2f0e None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:12.786076 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e64ec-8ffa-4c64-8c1f-3dd6bd3e2f0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:12.786383 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e64ec-8ffa-4c64-8c1f-3dd6bd3e2f0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:12.787782 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e64ec-8ffa-4c64-8c1f-3dd6bd3e2f0e None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:12.797267 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a265be-e70e-4b91-9262-641ef9174a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:12.797912 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a265be-e70e-4b91-9262-641ef9174a93 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:12.798195 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a265be-e70e-4b91-9262-641ef9174a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:12.798477 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a265be-e70e-4b91-9262-641ef9174a93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:12.801813 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 236/461] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:12.803345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e48e8-93d0-4061-a37a-55abc6daf37d None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:12.803764 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e48e8-93d0-4061-a37a-55abc6daf37d None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:12.804181 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e48e8-93d0-4061-a37a-55abc6daf37d None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:12.805610 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 237/462] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:12.806934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bc06e-21e8-4718-aa1c-37b5799e56fc None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:12.807352 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bc06e-21e8-4718-aa1c-37b5799e56fc None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:12.807767 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bc06e-21e8-4718-aa1c-37b5799e56fc None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:12.809513 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 238/463] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:12.810382 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908bc06e-21e8-4718-aa1c-37b5799e56fc None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:12.813131 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a265be-e70e-4b91-9262-641ef9174a93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:12.815736 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a265be-e70e-4b91-9262-641ef9174a93 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:12.836725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-e7a265be-e70e-4b91-9262-641ef9174a93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:12.836725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:12.836725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:12.836725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:12.836725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:12.836725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:12.836725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:12.836725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:12.836725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:12.836725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:12.836725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:12.836725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:12.836725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:12.836725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:12.836725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:12.836725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:12.841523 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:12.841523 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:12.841523 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:12.841523 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:12.841523 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:12.841523 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:12.841523 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:12.841523 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:12.841523 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:12.841523 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:12.841523 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:12.841523 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:12.841523 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:12.841523 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:12.841523 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:12.841523 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:12.841523 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:12.843617 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:12.843617 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:12.843617 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:12.843617 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 226/464] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:12.843617 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295beaa4-7e57-467c-be17-f47948f3daaa None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:12.843617 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295beaa4-7e57-467c-be17-f47948f3daaa None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:12.843617 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295beaa4-7e57-467c-be17-f47948f3daaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:12.859520 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-295beaa4-7e57-467c-be17-f47948f3daaa None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:12.861760 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-295beaa4-7e57-467c-be17-f47948f3daaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:12.932481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:12.951668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908bc06e-21e8-4718-aa1c-37b5799e56fc None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:12.951874 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 227/465] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:12.951874 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749f43b-aaa8-4005-a07c-b304b1c6bf7c None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:12.951874 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749f43b-aaa8-4005-a07c-b304b1c6bf7c None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:12.951874 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749f43b-aaa8-4005-a07c-b304b1c6bf7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:12.972933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-1749f43b-aaa8-4005-a07c-b304b1c6bf7c None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:12.974816 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-1749f43b-aaa8-4005-a07c-b304b1c6bf7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:12.992353 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9918b-1d2e-4fc5-808e-c6464232dcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:12.992944 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9918b-1d2e-4fc5-808e-c6464232dcf3 None admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:12.993226 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9918b-1d2e-4fc5-808e-c6464232dcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:12.993546 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9918b-1d2e-4fc5-808e-c6464232dcf3 None admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:12.994286 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9918b-1d2e-4fc5-808e-c6464232dcf3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:12.996104 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9918b-1d2e-4fc5-808e-c6464232dcf3 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:13.055275 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 228/466] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:13.056035 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749f43b-aaa8-4005-a07c-b304b1c6bf7c None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:13.065310 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:13.084944 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 239/467] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 24 15:44:12 2022] POST /identity/v3/users => generated 246 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:44:13.201925 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749f43b-aaa8-4005-a07c-b304b1c6bf7c None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:13.240894 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce8850-4bfa-4cf5-97a2-ffe2b22339cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:13.241530 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce8850-4bfa-4cf5-97a2-ffe2b22339cd None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:13.241858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce8850-4bfa-4cf5-97a2-ffe2b22339cd None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:13.242133 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce8850-4bfa-4cf5-97a2-ffe2b22339cd None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:13.242872 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce8850-4bfa-4cf5-97a2-ffe2b22339cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:13.243119 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce8850-4bfa-4cf5-97a2-ffe2b22339cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:13.244554 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce8850-4bfa-4cf5-97a2-ffe2b22339cd None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:13.259639 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 229/468] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:13.265761 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9918b-1d2e-4fc5-808e-c6464232dcf3 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:13.282200 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce8850-4bfa-4cf5-97a2-ffe2b22339cd None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:13.359513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:13.414353 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce8850-4bfa-4cf5-97a2-ffe2b22339cd None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:13.461620 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9918b-1d2e-4fc5-808e-c6464232dcf3 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:13.463031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50195b16-caaa-4858-9051-6a3d537c07b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:13.463856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50195b16-caaa-4858-9051-6a3d537c07b0 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:13.464143 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50195b16-caaa-4858-9051-6a3d537c07b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:13.464415 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50195b16-caaa-4858-9051-6a3d537c07b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:13.482184 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50195b16-caaa-4858-9051-6a3d537c07b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:13.483676 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50195b16-caaa-4858-9051-6a3d537c07b0 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:13.505140 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-50195b16-caaa-4858-9051-6a3d537c07b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:13.505140 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:13.505140 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:13.505140 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:13.505140 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:13.505140 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:13.505140 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:13.505140 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:13.505140 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:13.505140 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:13.505140 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:13.505140 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:13.505140 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:13.505140 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:13.505140 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:13.505140 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:13.506063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:13.506063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:13.506063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:13.506063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:13.506063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:13.506063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:13.506063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:13.506063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:13.506063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:13.506063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:13.506063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:13.506063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:13.506063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:13.506063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:13.506063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:13.506063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:13.506063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:13.506965 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:13.506965 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:13.506965 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:13.506965 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 230/469] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:44:13.507184 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50195b16-caaa-4858-9051-6a3d537c07b0 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:13.510232 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1d2e3-59e3-4489-b84a-2f2f611232a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:13.511410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1d2e3-59e3-4489-b84a-2f2f611232a4 None admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:13.511896 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1d2e3-59e3-4489-b84a-2f2f611232a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:13.513362 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1d2e3-59e3-4489-b84a-2f2f611232a4 None admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:13.513669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f1d2e3-59e3-4489-b84a-2f2f611232a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:13.515146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f1d2e3-59e3-4489-b84a-2f2f611232a4 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:13.600654 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 240/470] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 24 15:44:13 2022] POST /identity/v3/users => generated 248 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:44:13.601478 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1d2e3-59e3-4489-b84a-2f2f611232a4 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:13.610626 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:13.646855 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50195b16-caaa-4858-9051-6a3d537c07b0 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:13.671910 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:13.708984 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293a9b4-7a1b-4bc4-8b57-abcdf57e2c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:13.709651 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293a9b4-7a1b-4bc4-8b57-abcdf57e2c00 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:13.709936 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293a9b4-7a1b-4bc4-8b57-abcdf57e2c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:13.710210 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293a9b4-7a1b-4bc4-8b57-abcdf57e2c00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:13.723774 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293a9b4-7a1b-4bc4-8b57-abcdf57e2c00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:13.726812 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293a9b4-7a1b-4bc4-8b57-abcdf57e2c00 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:13.745333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-f293a9b4-7a1b-4bc4-8b57-abcdf57e2c00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:13.745333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:13.745333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:13.745333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:13.745333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:13.745333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:13.745333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:13.745333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:13.745333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:13.745333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:13.745333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:13.745333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:13.745333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:13.745333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:13.745333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:13.745333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:13.746358 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:13.746358 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:13.746358 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:13.746358 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:13.746358 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:13.746358 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:13.746358 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:13.746358 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:13.746358 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:13.746358 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:13.746358 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:13.746358 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:13.746358 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:13.746358 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:13.746358 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:13.746358 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:13.746358 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:13.747175 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:13.747175 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:13.747175 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:13.751701 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 231/471] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:13.753039 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d38d4e-3202-43b8-be2e-38ba6c998ccc None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:13.753328 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d38d4e-3202-43b8-be2e-38ba6c998ccc None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:13.753609 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d38d4e-3202-43b8-be2e-38ba6c998ccc None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:13.755917 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 232/472] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:13.757287 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1d2e3-59e3-4489-b84a-2f2f611232a4 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:13.761748 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d38d4e-3202-43b8-be2e-38ba6c998ccc None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:13.797188 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941fc50c-2e0c-4f95-84e0-185c89e13d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:13.798363 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fc50c-2e0c-4f95-84e0-185c89e13d26 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:13.798363 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fc50c-2e0c-4f95-84e0-185c89e13d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:13.798551 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fc50c-2e0c-4f95-84e0-185c89e13d26 None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:13.799180 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941fc50c-2e0c-4f95-84e0-185c89e13d26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:13.799539 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941fc50c-2e0c-4f95-84e0-185c89e13d26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:13.801549 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941fc50c-2e0c-4f95-84e0-185c89e13d26 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:13.820709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 241/473] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:13.820709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15002cb3-511c-4b9b-af2d-b734a0cc8c03 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:13.820709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15002cb3-511c-4b9b-af2d-b734a0cc8c03 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:13.820709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15002cb3-511c-4b9b-af2d-b734a0cc8c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:13.846488 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-15002cb3-511c-4b9b-af2d-b734a0cc8c03 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:13.847751 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-15002cb3-511c-4b9b-af2d-b734a0cc8c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:13.922307 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d38d4e-3202-43b8-be2e-38ba6c998ccc None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:13.936222 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:13.949959 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 242/474] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:13.951020 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15002cb3-511c-4b9b-af2d-b734a0cc8c03 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:13.968010 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fceb2c-2c6e-4e15-9438-f17ee80a1457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:13.968937 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fceb2c-2c6e-4e15-9438-f17ee80a1457 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:13.969360 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fceb2c-2c6e-4e15-9438-f17ee80a1457 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:13.969771 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fceb2c-2c6e-4e15-9438-f17ee80a1457 None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:13.970559 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fceb2c-2c6e-4e15-9438-f17ee80a1457 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:13.971001 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fceb2c-2c6e-4e15-9438-f17ee80a1457 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:13.972533 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fceb2c-2c6e-4e15-9438-f17ee80a1457 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:13.987817 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 233/475] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:13.995196 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fceb2c-2c6e-4e15-9438-f17ee80a1457 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:14.028558 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:14.111071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fceb2c-2c6e-4e15-9438-f17ee80a1457 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:14.149219 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7320a-c699-4682-9fa9-79e87fd4bb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:14.150278 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7320a-c699-4682-9fa9-79e87fd4bb8a None admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:14.150698 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7320a-c699-4682-9fa9-79e87fd4bb8a None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:14.151153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7320a-c699-4682-9fa9-79e87fd4bb8a None admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:14.151933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7320a-c699-4682-9fa9-79e87fd4bb8a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:14.153571 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7320a-c699-4682-9fa9-79e87fd4bb8a None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:14.160582 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15002cb3-511c-4b9b-af2d-b734a0cc8c03 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:14.206403 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d72f4-48f7-4551-a407-da3d5685e12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:14.207889 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d72f4-48f7-4551-a407-da3d5685e12f None admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:14.208916 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d72f4-48f7-4551-a407-da3d5685e12f None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:14.209383 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d72f4-48f7-4551-a407-da3d5685e12f None admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:14.210178 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063d72f4-48f7-4551-a407-da3d5685e12f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:14.211888 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063d72f4-48f7-4551-a407-da3d5685e12f None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:14.264505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 234/476] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 24 15:44:13 2022] POST /identity/v3/users => generated 249 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:44:14.292247 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7320a-c699-4682-9fa9-79e87fd4bb8a None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:14.321685 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 243/477] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 24 15:44:13 2022] POST /identity/v3/users => generated 248 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:44:14.402189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:14.433422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7320a-c699-4682-9fa9-79e87fd4bb8a None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:14.487574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8e398-2753-400c-8dba-a1784ab6e804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:14.488210 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8e398-2753-400c-8dba-a1784ab6e804 None admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:14.489234 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8e398-2753-400c-8dba-a1784ab6e804 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:14.489720 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8e398-2753-400c-8dba-a1784ab6e804 None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:14.490473 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb8e398-2753-400c-8dba-a1784ab6e804 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:14.491882 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb8e398-2753-400c-8dba-a1784ab6e804 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:14.537794 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.sql.core [None req-1fb8e398-2753-400c-8dba-a1784ab6e804 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 15:44:14.537794 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 15:44:14.537794 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [parameters: {'id': '706e764af1af4b939e7d446dcc379c23', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 15:44:14.537794 dv-cinder-849325-3-smb devstack@keystone.service[81717]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81717) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 15:44:14.555431 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-1fb8e398-2753-400c-8dba-a1784ab6e804 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 15:44:14.555431 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:14.555431 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 15:44:14.555431 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 15:44:14.555431 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 15:44:14.555431 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 15:44:14.555431 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 15:44:14.555431 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 15:44:14.555431 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 15:44:14.555431 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application conn.query(q) Aug 24 15:44:14.555431 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 15:44:14.555431 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 15:44:14.555431 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 15:44:14.555431 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application result.read() Aug 24 15:44:14.555431 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 15:44:14.556339 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 15:44:14.556339 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 15:44:14.556339 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 15:44:14.556339 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 15:44:14.556339 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 15:44:14.556339 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 15:44:14.556339 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 15:44:14.556339 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 15:44:14.556339 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:14.556339 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 15:44:14.556339 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:14.556339 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:14.556339 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 15:44:14.556339 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 15:44:14.556339 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 15:44:14.556339 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 15:44:14.556339 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 15:44:14.556339 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application next(self.gen) Aug 24 15:44:14.557901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 15:44:14.557901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application yield resource Aug 24 15:44:14.557901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 15:44:14.557901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application next(self.gen) Aug 24 15:44:14.557901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 15:44:14.557901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 15:44:14.557901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 15:44:14.557901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 15:44:14.557901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 15:44:14.557901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise self.value Aug 24 15:44:14.557901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 15:44:14.557901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 15:44:14.557901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 15:44:14.557901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application session.commit() Aug 24 15:44:14.557901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 15:44:14.557901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 15:44:14.557901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 15:44:14.558767 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 15:44:14.558767 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 15:44:14.558767 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self.session.flush() Aug 24 15:44:14.558767 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 15:44:14.558767 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 15:44:14.558767 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 15:44:14.558767 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 15:44:14.558767 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 15:44:14.558767 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application compat.raise_( Aug 24 15:44:14.558767 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 15:44:14.558767 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception Aug 24 15:44:14.558767 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 15:44:14.558767 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 15:44:14.558767 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 15:44:14.558767 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 15:44:14.558767 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 15:44:14.558767 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 15:44:14.559715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 15:44:14.559715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 15:44:14.559715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 15:44:14.559715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 15:44:14.559715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 15:44:14.559715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 15:44:14.559715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 15:44:14.559715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 15:44:14.559715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 15:44:14.559715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 15:44:14.559715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 15:44:14.559715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 15:44:14.559715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 15:44:14.559715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 15:44:14.559715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 15:44:14.559715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception Aug 24 15:44:14.560540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 15:44:14.560540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 15:44:14.560540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 15:44:14.560540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 15:44:14.560540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 15:44:14.560540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 15:44:14.560540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 15:44:14.560540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application conn.query(q) Aug 24 15:44:14.560540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 15:44:14.560540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 15:44:14.560540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 15:44:14.560540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application result.read() Aug 24 15:44:14.560540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 15:44:14.560540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 15:44:14.560540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 15:44:14.560540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 15:44:14.563364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 15:44:14.563364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 15:44:14.563364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 15:44:14.563364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 15:44:14.563364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 15:44:14.563364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 15:44:14.563364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [parameters: {'id': '706e764af1af4b939e7d446dcc379c23', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 15:44:14.563364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 15:44:14.563364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:14.563364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:44:14.563364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:14.563364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:14.563364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:14.563364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:14.563364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:14.563364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:14.565422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:14.565422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:14.565422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:14.565422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:14.565422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:14.565422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:14.565422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 15:44:14.565422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 15:44:14.565422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:14.565422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:14.565422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 15:44:14.565422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 15:44:14.565422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 15:44:14.565422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 15:44:14.565422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 15:44:14.565422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:14.567902 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 235/478] 10.222.0.64 () {60 vars in 1131 bytes} [Wed Aug 24 15:44:14 2022] POST /identity/v3/roles => generated 144 bytes in 265 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:44:14.568087 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d72f4-48f7-4551-a407-da3d5685e12f None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:14.626224 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:14.682834 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d72f4-48f7-4551-a407-da3d5685e12f None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:14.719830 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59296380-7875-467c-b47d-68ca941c62eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:14.720479 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59296380-7875-467c-b47d-68ca941c62eb None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:14.720795 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59296380-7875-467c-b47d-68ca941c62eb None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:14.721072 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59296380-7875-467c-b47d-68ca941c62eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:14.733073 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59296380-7875-467c-b47d-68ca941c62eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:14.738597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-59296380-7875-467c-b47d-68ca941c62eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:44:14.738597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:14.738597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:14.738597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:14.738597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:14.738597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:14.738597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:14.738597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:14.738597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:14.738597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:14.738597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:14.738597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:14.738597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:14.738597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:14.738597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:14.738597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:14.739505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:14.739505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:14.739505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:14.739505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:14.739505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:14.739505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:14.739505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:14.739505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:14.739505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:14.739505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:14.739505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:14.739505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:14.739505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:14.739505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:14.739505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:14.739505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:14.740542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:14.740542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:14.740542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:14.740542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:14.740542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:14.740542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:14.740542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:14.740542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:14.740542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:14.740542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:14.740542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:44:14.740542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:14.740542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 244/479] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 24 15:44:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:14.745667 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8e398-2753-400c-8dba-a1784ab6e804 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:14.874521 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8e398-2753-400c-8dba-a1784ab6e804 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:14.917165 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89b58b-6846-44b8-af47-496e96067d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:14.917803 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89b58b-6846-44b8-af47-496e96067d22 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:14.918085 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89b58b-6846-44b8-af47-496e96067d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:14.918356 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89b58b-6846-44b8-af47-496e96067d22 None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:14.919043 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89b58b-6846-44b8-af47-496e96067d22 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:14.919346 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89b58b-6846-44b8-af47-496e96067d22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:14.920772 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89b58b-6846-44b8-af47-496e96067d22 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:14.936773 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 236/480] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:44:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:15.521685 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325f3b4-f4a1-4bfc-8f19-f807b66c0a00 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:15.522194 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325f3b4-f4a1-4bfc-8f19-f807b66c0a00 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:15.522194 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325f3b4-f4a1-4bfc-8f19-f807b66c0a00 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:15.523823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 245/481] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:15.529065 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c8ea0-4fa7-4593-98fc-f34470ce6396 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:15.529351 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c8ea0-4fa7-4593-98fc-f34470ce6396 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:15.529626 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c8ea0-4fa7-4593-98fc-f34470ce6396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:15.554846 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-cf7c8ea0-4fa7-4593-98fc-f34470ce6396 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:15.555969 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-cf7c8ea0-4fa7-4593-98fc-f34470ce6396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:15.558122 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:15.667383 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 237/482] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:15.897026 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4ee0a-57f8-4c9c-8170-e0d4acd824f1 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:15.897365 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4ee0a-57f8-4c9c-8170-e0d4acd824f1 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:15.897466 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4ee0a-57f8-4c9c-8170-e0d4acd824f1 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:15.899118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 246/483] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:15.904675 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce95d1-3f36-4f63-932d-e08b88400345 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:15.904970 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce95d1-3f36-4f63-932d-e08b88400345 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:15.905503 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce95d1-3f36-4f63-932d-e08b88400345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:15.929126 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-e4ce95d1-3f36-4f63-932d-e08b88400345 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:15.930325 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e4ce95d1-3f36-4f63-932d-e08b88400345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:16.037542 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 238/484] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:16.109082 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4ee0a-57f8-4c9c-8170-e0d4acd824f1 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:16.253189 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4ee0a-57f8-4c9c-8170-e0d4acd824f1 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:16.268651 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:16.304652 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5315b58-b817-4741-9573-0d5e30c52706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:16.305302 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5315b58-b817-4741-9573-0d5e30c52706 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:16.305986 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5315b58-b817-4741-9573-0d5e30c52706 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:16.306613 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5315b58-b817-4741-9573-0d5e30c52706 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:16.325188 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5315b58-b817-4741-9573-0d5e30c52706 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:16.329959 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-d5315b58-b817-4741-9573-0d5e30c52706 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:16.329959 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:16.329959 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:16.329959 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:16.329959 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:16.329959 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:16.329959 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:16.329959 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:16.329959 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:16.329959 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:16.329959 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:16.329959 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:16.329959 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:16.329959 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:16.329959 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:16.329959 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:16.330875 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:16.330875 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:16.330875 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:16.330875 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:16.330875 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:16.330875 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:16.330875 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:16.330875 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:16.330875 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:16.330875 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:16.330875 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:16.330875 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:16.330875 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:16.330875 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:16.330875 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:16.330875 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:16.332374 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:16.332374 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:16.332374 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:16.332374 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:16.332374 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:16.332374 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:16.332374 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:16.332374 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:16.332374 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:16.332374 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:16.332374 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:16.332374 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:16.332374 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 247/485] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 24 15:44:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:16.337266 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce95d1-3f36-4f63-932d-e08b88400345 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:16.403832 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5315b58-b817-4741-9573-0d5e30c52706 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:16.447562 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:16.507346 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce95d1-3f36-4f63-932d-e08b88400345 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:16.549873 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a6fd1-4a8b-4aca-8260-aaf3d43e2b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:16.551367 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a6fd1-4a8b-4aca-8260-aaf3d43e2b5f None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:16.551738 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a6fd1-4a8b-4aca-8260-aaf3d43e2b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:16.552027 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a6fd1-4a8b-4aca-8260-aaf3d43e2b5f None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:16.553813 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a6fd1-4a8b-4aca-8260-aaf3d43e2b5f None admin] RBAC: Adding query filter params (name=service) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:16.553813 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a6fd1-4a8b-4aca-8260-aaf3d43e2b5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:16.555921 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a6fd1-4a8b-4aca-8260-aaf3d43e2b5f None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:16.568747 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 239/486] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 24 15:44:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:16.571393 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a6fd1-4a8b-4aca-8260-aaf3d43e2b5f None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:16.627644 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5315b58-b817-4741-9573-0d5e30c52706 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:16.687516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a6fd1-4a8b-4aca-8260-aaf3d43e2b5f None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:16.707865 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1bc823-9582-4e1d-99e8-8e633c159cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:16.708840 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1bc823-9582-4e1d-99e8-8e633c159cd5 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:16.709270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1bc823-9582-4e1d-99e8-8e633c159cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:16.709719 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1bc823-9582-4e1d-99e8-8e633c159cd5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:16.719347 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:16.726963 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0a1ad-f99f-42cf-b165-e9210b7e16cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:16.727857 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0a1ad-f99f-42cf-b165-e9210b7e16cb None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:16.728324 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0a1ad-f99f-42cf-b165-e9210b7e16cb None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:16.746930 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0a1ad-f99f-42cf-b165-e9210b7e16cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:16.747118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1bc823-9582-4e1d-99e8-8e633c159cd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:16.747118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-1c1bc823-9582-4e1d-99e8-8e633c159cd5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:16.747118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:16.747118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:16.747118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:16.747118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:16.747118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:16.747118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:16.747118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:16.747118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:16.747118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:16.747118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:16.747118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:16.747118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:16.748058 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:16.748058 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:16.748058 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:16.748058 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:16.748058 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:16.748058 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:16.748058 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:16.748058 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:16.748058 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:16.748058 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:16.748058 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:16.748058 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:16.748058 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:16.748058 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:16.748058 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:16.748058 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:16.748058 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:16.749053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:16.749053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:16.749053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:16.749053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:16.749053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:16.749053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:16.749053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:16.749053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:16.749053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:16.749053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:16.749053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:16.749053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:16.749053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:16.749053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:16.749053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 248/487] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 24 15:44:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:16.749793 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0a1ad-f99f-42cf-b165-e9210b7e16cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:16.749793 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0a1ad-f99f-42cf-b165-e9210b7e16cb None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:16.749914 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1bc823-9582-4e1d-99e8-8e633c159cd5 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:16.762055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-7fb0a1ad-f99f-42cf-b165-e9210b7e16cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:16.762055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:16.762055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:16.762055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:16.762055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:16.762055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:16.762055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:16.762055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:16.762055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:16.762055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:16.762055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:16.762055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:16.762055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:16.762055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:16.762055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:16.762055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:16.763270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:16.763270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:16.763270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:16.763270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:16.763270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:16.763270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:16.763270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:16.763270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:16.763270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:16.763270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:16.763270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:16.763270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:16.763270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:16.763270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:16.763270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:16.763270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:16.763270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:16.764259 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:16.764259 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:16.764259 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:16.770515 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 240/488] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:16.772303 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0a1ad-f99f-42cf-b165-e9210b7e16cb None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:16.818602 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:16.898000 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0a1ad-f99f-42cf-b165-e9210b7e16cb None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:16.929794 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1bc823-9582-4e1d-99e8-8e633c159cd5 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:16.935143 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eabbb4-7375-4e82-8967-a7a31510ac7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:16.935967 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eabbb4-7375-4e82-8967-a7a31510ac7d None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:16.936388 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eabbb4-7375-4e82-8967-a7a31510ac7d None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:16.936839 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eabbb4-7375-4e82-8967-a7a31510ac7d None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:16.937666 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eabbb4-7375-4e82-8967-a7a31510ac7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:16.938202 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eabbb4-7375-4e82-8967-a7a31510ac7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:16.939745 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eabbb4-7375-4e82-8967-a7a31510ac7d None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:16.958884 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 241/489] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:44:16.960721 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70693de4-be3f-45bc-bfb1-19284e23d1d6 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:16.961171 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70693de4-be3f-45bc-bfb1-19284e23d1d6 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:16.961606 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70693de4-be3f-45bc-bfb1-19284e23d1d6 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:16.963815 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 242/490] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:16.968801 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70693de4-be3f-45bc-bfb1-19284e23d1d6 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:16.973566 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc5690-d1cc-4b31-89c0-b2263e1021c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:16.974192 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc5690-d1cc-4b31-89c0-b2263e1021c1 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:16.974471 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc5690-d1cc-4b31-89c0-b2263e1021c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:16.974743 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc5690-d1cc-4b31-89c0-b2263e1021c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:16.975549 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc5690-d1cc-4b31-89c0-b2263e1021c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:16.975854 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc5690-d1cc-4b31-89c0-b2263e1021c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:16.977533 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc5690-d1cc-4b31-89c0-b2263e1021c1 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:16.987068 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 249/491] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 24 15:44:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:16.989130 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3531128-a910-4787-83a2-253fbb05048e None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:16.989130 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3531128-a910-4787-83a2-253fbb05048e None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:16.989404 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3531128-a910-4787-83a2-253fbb05048e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:17.009398 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-a3531128-a910-4787-83a2-253fbb05048e None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:17.010664 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-a3531128-a910-4787-83a2-253fbb05048e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:17.034473 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:17.103804 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 250/492] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:17.104913 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3531128-a910-4787-83a2-253fbb05048e None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:17.105930 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70693de4-be3f-45bc-bfb1-19284e23d1d6 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:17.143557 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:17.146835 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69ebae-30c9-4ab8-a7ce-fe4cb8bfa626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:17.147759 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69ebae-30c9-4ab8-a7ce-fe4cb8bfa626 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:17.148234 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69ebae-30c9-4ab8-a7ce-fe4cb8bfa626 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:17.148775 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69ebae-30c9-4ab8-a7ce-fe4cb8bfa626 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:17.157467 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c69ebae-30c9-4ab8-a7ce-fe4cb8bfa626 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:17.159410 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c69ebae-30c9-4ab8-a7ce-fe4cb8bfa626 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:17.174302 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-1c69ebae-30c9-4ab8-a7ce-fe4cb8bfa626 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:44:17.174302 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:17.174302 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:17.174302 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:17.174302 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:17.174302 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:17.174302 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:17.174302 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:17.174302 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:17.174302 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:17.174302 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:17.174302 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:17.174302 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:44:17.174302 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:44:17.174302 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:44:17.174302 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:44:17.175377 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:17.175377 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:17.175377 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:44:17.175377 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:17.175377 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:44:17.175377 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:17.175377 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:17.175377 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:17.175377 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:17.175377 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:17.175377 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:17.175377 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:17.175377 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:17.175377 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:17.175377 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:17.175377 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:17.175377 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:17.175377 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:17.176813 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:17.176813 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:17.176813 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:44:17.176813 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:44:17.176813 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:44:17.176813 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:44:17.176813 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:44:17.176813 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:44:17.176813 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:44:17.176813 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:17.178525 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 243/493] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 24 15:44:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:17.180226 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e256da-8c3c-4e78-9b72-87c82f1e2fe2 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:17.182379 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e256da-8c3c-4e78-9b72-87c82f1e2fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:17.182659 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e256da-8c3c-4e78-9b72-87c82f1e2fe2 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:17.184186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 244/494] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:17.185498 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e256da-8c3c-4e78-9b72-87c82f1e2fe2 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:17.252152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3531128-a910-4787-83a2-253fbb05048e None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:17.291278 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118adee-54d7-4568-ac9d-c6991b749a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:17.291880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118adee-54d7-4568-ac9d-c6991b749a96 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:17.292167 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118adee-54d7-4568-ac9d-c6991b749a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:17.292441 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118adee-54d7-4568-ac9d-c6991b749a96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:17.303964 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118adee-54d7-4568-ac9d-c6991b749a96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:17.305515 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118adee-54d7-4568-ac9d-c6991b749a96 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:17.322117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-6118adee-54d7-4568-ac9d-c6991b749a96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:17.322117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:17.322117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:17.322117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:17.322117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:17.322117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:17.322117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:17.322117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:17.322117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:17.322117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:17.322117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:17.322117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:17.322117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:17.322117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:17.322117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:17.322117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:17.323055 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:17.323055 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:17.323055 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:17.323055 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:17.323055 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:17.323055 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:17.323055 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:17.323055 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:17.323055 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:17.323055 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:17.323055 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:17.323055 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:17.323055 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:17.323055 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:17.323055 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:17.323055 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:17.323055 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:17.323884 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:17.323884 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:17.323884 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:17.328097 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 251/495] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:17.329540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85412179-fe24-4408-81f7-f4e1b8930693 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:17.329880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85412179-fe24-4408-81f7-f4e1b8930693 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:17.330156 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85412179-fe24-4408-81f7-f4e1b8930693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:17.330569 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e256da-8c3c-4e78-9b72-87c82f1e2fe2 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:17.349686 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-85412179-fe24-4408-81f7-f4e1b8930693 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:17.350962 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-85412179-fe24-4408-81f7-f4e1b8930693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:17.353869 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:17.369296 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f421e9-fb39-493a-afd2-7f4c74578362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:17.370272 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f421e9-fb39-493a-afd2-7f4c74578362 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:17.370767 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f421e9-fb39-493a-afd2-7f4c74578362 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:17.371196 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f421e9-fb39-493a-afd2-7f4c74578362 None admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:17.374592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f421e9-fb39-493a-afd2-7f4c74578362 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:17.374592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f421e9-fb39-493a-afd2-7f4c74578362 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:17.374592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f421e9-fb39-493a-afd2-7f4c74578362 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:17.420052 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 245/496] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 24 15:44:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:17.421568 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f421e9-fb39-493a-afd2-7f4c74578362 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:17.430717 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 252/497] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:17.431736 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85412179-fe24-4408-81f7-f4e1b8930693 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:17.443305 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:17.544740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f421e9-fb39-493a-afd2-7f4c74578362 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:17.583843 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85412179-fe24-4408-81f7-f4e1b8930693 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:17.588194 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ffb7d-2199-479a-86da-96d0f9b7d0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:17.588836 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ffb7d-2199-479a-86da-96d0f9b7d0a8 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:17.589115 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ffb7d-2199-479a-86da-96d0f9b7d0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:17.589389 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ffb7d-2199-479a-86da-96d0f9b7d0a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:17.590037 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ffb7d-2199-479a-86da-96d0f9b7d0a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:17.590336 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ffb7d-2199-479a-86da-96d0f9b7d0a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:17.591722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ffb7d-2199-479a-86da-96d0f9b7d0a8 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:17.610830 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 246/498] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:17.610830 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ffb7d-2199-479a-86da-96d0f9b7d0a8 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:17.625728 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dfcdca-2135-46d1-b750-a7b7a77632b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:17.625993 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfcdca-2135-46d1-b750-a7b7a77632b1 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:17.626142 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfcdca-2135-46d1-b750-a7b7a77632b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:17.626407 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfcdca-2135-46d1-b750-a7b7a77632b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:17.643061 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dfcdca-2135-46d1-b750-a7b7a77632b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:17.644063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:17.648668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-e2dfcdca-2135-46d1-b750-a7b7a77632b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:17.648668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:17.648668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:17.648668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:17.648668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:17.648668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:17.648668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:17.648668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:17.648668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:17.648668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:17.648668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:17.648668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:17.648668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:17.648668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:17.648668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:17.648668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:17.649578 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:17.649578 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:17.649578 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:17.649578 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:17.649578 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:17.649578 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:17.649578 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:17.649578 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:17.649578 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:17.649578 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:17.649578 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:17.649578 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:17.649578 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:17.649578 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:17.649578 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:17.649578 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:17.650447 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:17.650447 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:17.650447 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:17.650447 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:17.650447 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:17.650447 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:17.650447 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:17.650447 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:17.650447 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:17.650447 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:17.650447 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:17.650447 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:17.650447 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 253/499] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 24 15:44:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:17.651417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040261ff-70ab-486c-a797-a2727d52ddd0 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:17.651505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040261ff-70ab-486c-a797-a2727d52ddd0 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:17.651713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040261ff-70ab-486c-a797-a2727d52ddd0 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:17.656660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 254/500] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:17.656660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040261ff-70ab-486c-a797-a2727d52ddd0 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:17.733347 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:17.748269 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ffb7d-2199-479a-86da-96d0f9b7d0a8 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:17.777566 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040261ff-70ab-486c-a797-a2727d52ddd0 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:17.785932 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd222f0e-ba7d-4aea-be43-5edd2c567416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:17.786557 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd222f0e-ba7d-4aea-be43-5edd2c567416 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:17.786895 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd222f0e-ba7d-4aea-be43-5edd2c567416 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:17.787249 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd222f0e-ba7d-4aea-be43-5edd2c567416 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:17.814080 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5baf8-f5b1-41e3-b2db-5a6b9003d825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:17.814638 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5baf8-f5b1-41e3-b2db-5a6b9003d825 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:17.814915 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5baf8-f5b1-41e3-b2db-5a6b9003d825 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:17.815193 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5baf8-f5b1-41e3-b2db-5a6b9003d825 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:17.824213 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5baf8-f5b1-41e3-b2db-5a6b9003d825 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:17.825746 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5baf8-f5b1-41e3-b2db-5a6b9003d825 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:17.839315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-c4a5baf8-f5b1-41e3-b2db-5a6b9003d825 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 15:44:17.839315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:17.839315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:17.839315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:17.839315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:17.839315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:17.839315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:17.839315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:17.839315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:17.839315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:17.839315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:17.839315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:17.839315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:44:17.839315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:44:17.839315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:44:17.839315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:44:17.840292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:17.840292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:17.840292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:44:17.840292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:17.840292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:44:17.840292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:17.840292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:17.840292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:17.840292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:17.840292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:17.840292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:17.840292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:17.840292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:17.840292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:17.840292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:17.840292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:17.840292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:17.840292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:17.841189 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:17.841189 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:17.841189 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:44:17.841189 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:44:17.841189 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:44:17.841189 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:44:17.841189 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:44:17.841189 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:44:17.841189 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 15:44:17.841189 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:17.841189 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 255/501] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:44:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:17.841743 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5baf8-f5b1-41e3-b2db-5a6b9003d825 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:17.866847 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd222f0e-ba7d-4aea-be43-5edd2c567416 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:17.868331 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd222f0e-ba7d-4aea-be43-5edd2c567416 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:17.892081 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:17.955525 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5baf8-f5b1-41e3-b2db-5a6b9003d825 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:17.975372 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 247/502] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:44:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:17.976648 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2e22c-0bf2-4806-8055-ae012f1124ca None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:17.976937 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2e22c-0bf2-4806-8055-ae012f1124ca None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:17.977205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2e22c-0bf2-4806-8055-ae012f1124ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:17.984172 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:17.995906 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5501ca8-3ad2-4ce9-a11d-5d907a31d150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:17.998489 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-c1a2e22c-0bf2-4806-8055-ae012f1124ca None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:17.998596 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5501ca8-3ad2-4ce9-a11d-5d907a31d150 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:17.998596 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5501ca8-3ad2-4ce9-a11d-5d907a31d150 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:17.998596 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5501ca8-3ad2-4ce9-a11d-5d907a31d150 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:17.998824 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-c1a2e22c-0bf2-4806-8055-ae012f1124ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:17.998915 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5501ca8-3ad2-4ce9-a11d-5d907a31d150 None admin] RBAC: Adding query filter params (name=service) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:17.998915 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5501ca8-3ad2-4ce9-a11d-5d907a31d150 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:17.999511 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5501ca8-3ad2-4ce9-a11d-5d907a31d150 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:18.009295 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 256/503] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 24 15:44:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:18.010220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5501ca8-3ad2-4ce9-a11d-5d907a31d150 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:18.087040 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 248/504] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:18.087817 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2e22c-0bf2-4806-8055-ae012f1124ca None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:18.130542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5501ca8-3ad2-4ce9-a11d-5d907a31d150 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:18.154684 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:18.168828 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9611d-23c5-4d99-943a-d808a11e543e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:18.170036 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9611d-23c5-4d99-943a-d808a11e543e None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:18.170036 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9611d-23c5-4d99-943a-d808a11e543e None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:18.170036 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9611d-23c5-4d99-943a-d808a11e543e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:18.185692 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9611d-23c5-4d99-943a-d808a11e543e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:18.192882 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-0cb9611d-23c5-4d99-943a-d808a11e543e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:18.192882 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:18.192882 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:18.192882 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:18.192882 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:18.192882 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:18.192882 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:18.192882 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:18.192882 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:18.192882 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:18.192882 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:18.192882 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:18.192882 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:18.192882 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:18.192882 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:18.192882 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:18.193926 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:18.193926 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:18.193926 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:18.193926 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:18.193926 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:18.193926 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:18.193926 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:18.193926 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:18.193926 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:18.193926 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:18.193926 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:18.193926 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:18.193926 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:18.193926 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:18.193926 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:18.193926 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:18.194684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:18.194684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:18.194684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:18.194684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:18.194684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:18.194684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:18.194684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:18.194684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:18.194684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:18.194684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:18.194684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:18.194684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:18.195269 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 257/505] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 24 15:44:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:18.196468 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9611d-23c5-4d99-943a-d808a11e543e None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:18.217934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2e22c-0bf2-4806-8055-ae012f1124ca None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:18.250453 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:18.262201 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a5c4f-7042-489b-b5c2-32f39b6a8522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:18.267365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a5c4f-7042-489b-b5c2-32f39b6a8522 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:18.267365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a5c4f-7042-489b-b5c2-32f39b6a8522 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:18.267365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a5c4f-7042-489b-b5c2-32f39b6a8522 None admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:18.267365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a5c4f-7042-489b-b5c2-32f39b6a8522 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:18.267365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a5c4f-7042-489b-b5c2-32f39b6a8522 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:18.267365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a5c4f-7042-489b-b5c2-32f39b6a8522 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:18.295525 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 249/506] 10.222.0.64 () {56 vars in 1137 bytes} [Wed Aug 24 15:44:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:18.295525 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a5c4f-7042-489b-b5c2-32f39b6a8522 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:18.326400 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9611d-23c5-4d99-943a-d808a11e543e None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:18.366190 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523def67-60b3-4893-9cd4-51c7f666fe2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:18.366744 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523def67-60b3-4893-9cd4-51c7f666fe2d None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:18.367019 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523def67-60b3-4893-9cd4-51c7f666fe2d None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:18.367284 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523def67-60b3-4893-9cd4-51c7f666fe2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:18.377910 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523def67-60b3-4893-9cd4-51c7f666fe2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:18.379607 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523def67-60b3-4893-9cd4-51c7f666fe2d None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:18.395870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-523def67-60b3-4893-9cd4-51c7f666fe2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:18.395870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:18.395870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:18.395870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:18.395870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:18.395870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:18.395870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:18.395870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:18.395870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:18.395870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:18.395870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:18.395870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:18.395870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:18.395870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:18.395870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:18.395870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:18.396901 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:18.396901 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:18.396901 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:18.396901 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:18.396901 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:18.396901 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:18.396901 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:18.396901 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:18.396901 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:18.396901 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:18.396901 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:18.396901 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:18.396901 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:18.396901 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:18.396901 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:18.396901 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:18.396901 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:18.397727 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:18.397727 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:18.397727 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:18.397727 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 258/507] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:18.397948 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523def67-60b3-4893-9cd4-51c7f666fe2d None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:18.407790 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a5c4f-7042-489b-b5c2-32f39b6a8522 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:18.419676 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:18.445090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bb899-abcd-4d71-9616-6f640b8ddc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:18.445718 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bb899-abcd-4d71-9616-6f640b8ddc6e None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:18.446000 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bb899-abcd-4d71-9616-6f640b8ddc6e None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:18.446281 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bb899-abcd-4d71-9616-6f640b8ddc6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:18.462367 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bb899-abcd-4d71-9616-6f640b8ddc6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:18.463845 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bb899-abcd-4d71-9616-6f640b8ddc6e None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:18.479808 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-c34bb899-abcd-4d71-9616-6f640b8ddc6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:18.479808 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:18.479808 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:18.479808 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:18.479808 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:18.479808 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:18.479808 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:18.479808 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:18.479808 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:18.479808 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:18.479808 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:18.479808 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:18.479808 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:18.479808 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:18.479808 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:18.479808 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:18.480897 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:18.480897 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:18.480897 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:18.480897 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:18.480897 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:18.480897 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:18.480897 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:18.480897 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:18.480897 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:18.480897 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:18.480897 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:18.480897 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:18.480897 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:18.480897 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:18.480897 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:18.480897 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:18.480897 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:18.481744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:18.481744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:18.481744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:18.481744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 250/508] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:18.481744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bb899-abcd-4d71-9616-6f640b8ddc6e None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:18.505192 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:18.511363 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523def67-60b3-4893-9cd4-51c7f666fe2d None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:18.552001 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e4679-9ed5-464f-b560-f83b97248734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:18.552608 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e4679-9ed5-464f-b560-f83b97248734 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:18.552918 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e4679-9ed5-464f-b560-f83b97248734 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:18.553190 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e4679-9ed5-464f-b560-f83b97248734 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:18.553864 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e4679-9ed5-464f-b560-f83b97248734 None admin] RBAC: Adding query filter params (name=service) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:18.554168 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e4679-9ed5-464f-b560-f83b97248734 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:18.555559 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e4679-9ed5-464f-b560-f83b97248734 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:18.564935 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 259/509] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 24 15:44:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:18.565855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e4679-9ed5-464f-b560-f83b97248734 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:18.604503 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bb899-abcd-4d71-9616-6f640b8ddc6e None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:18.639866 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0137047-3a62-45be-9939-99ade41b761d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:18.640398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0137047-3a62-45be-9939-99ade41b761d None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:18.640701 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0137047-3a62-45be-9939-99ade41b761d None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:18.640973 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0137047-3a62-45be-9939-99ade41b761d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:18.670765 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:18.676005 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e4679-9ed5-464f-b560-f83b97248734 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:18.711703 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1240f-cfed-4de3-b7d2-acdbe893d9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:18.712333 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1240f-cfed-4de3-b7d2-acdbe893d9a0 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:18.712615 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1240f-cfed-4de3-b7d2-acdbe893d9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:18.712915 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1240f-cfed-4de3-b7d2-acdbe893d9a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:18.713703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0137047-3a62-45be-9939-99ade41b761d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:18.715160 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0137047-3a62-45be-9939-99ade41b761d None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:18.724816 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c1240f-cfed-4de3-b7d2-acdbe893d9a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:18.726410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c1240f-cfed-4de3-b7d2-acdbe893d9a0 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:18.746370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-f5c1240f-cfed-4de3-b7d2-acdbe893d9a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:18.746370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:18.746370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:18.746370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:18.746370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:18.746370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:18.746370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:18.746370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:18.746370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:18.746370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:18.746370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:18.746370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:18.746370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:18.746370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:18.746370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:18.746370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:18.747425 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:18.747425 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:18.747425 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:18.747425 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:18.747425 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:18.747425 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:18.747425 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:18.747425 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:18.747425 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:18.747425 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:18.747425 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:18.747425 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:18.747425 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:18.747425 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:18.747425 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:18.747425 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:18.747425 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:18.748272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:18.748272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:18.748272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:18.748272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 260/510] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:18.748272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1240f-cfed-4de3-b7d2-acdbe893d9a0 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:18.765681 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:18.851924 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 251/511] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:44:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:18.852854 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0137047-3a62-45be-9939-99ade41b761d None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:18.857457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1240f-cfed-4de3-b7d2-acdbe893d9a0 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:18.894263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff2798-24a2-45ee-90f9-227c33cbe9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:18.895341 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff2798-24a2-45ee-90f9-227c33cbe9da None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:18.895619 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff2798-24a2-45ee-90f9-227c33cbe9da None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:18.895883 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff2798-24a2-45ee-90f9-227c33cbe9da None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:18.896587 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff2798-24a2-45ee-90f9-227c33cbe9da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:18.896863 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff2798-24a2-45ee-90f9-227c33cbe9da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:18.898271 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff2798-24a2-45ee-90f9-227c33cbe9da None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:18.910754 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 261/512] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:18.911611 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff2798-24a2-45ee-90f9-227c33cbe9da None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:18.917909 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:18.969489 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0137047-3a62-45be-9939-99ade41b761d None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:18.996236 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:19.009336 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a536cd-2468-4aa1-8524-cd833e4fd4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:19.009953 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a536cd-2468-4aa1-8524-cd833e4fd4f5 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:19.010265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a536cd-2468-4aa1-8524-cd833e4fd4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:19.010537 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a536cd-2468-4aa1-8524-cd833e4fd4f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:19.011200 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a536cd-2468-4aa1-8524-cd833e4fd4f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:19.011505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a536cd-2468-4aa1-8524-cd833e4fd4f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:19.012964 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a536cd-2468-4aa1-8524-cd833e4fd4f5 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:19.026047 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 252/513] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:19.026751 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a536cd-2468-4aa1-8524-cd833e4fd4f5 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:19.028612 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff2798-24a2-45ee-90f9-227c33cbe9da None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:19.067973 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ba14a-e776-4f66-b5cf-9ad56ebe6401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:19.068758 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ba14a-e776-4f66-b5cf-9ad56ebe6401 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:19.069031 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ba14a-e776-4f66-b5cf-9ad56ebe6401 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:19.069295 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ba14a-e776-4f66-b5cf-9ad56ebe6401 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:19.079600 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ba14a-e776-4f66-b5cf-9ad56ebe6401 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:19.081093 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ba14a-e776-4f66-b5cf-9ad56ebe6401 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:19.096985 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-393ba14a-e776-4f66-b5cf-9ad56ebe6401 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:19.096985 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:19.096985 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:19.096985 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:19.096985 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:19.096985 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:19.096985 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:19.096985 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:19.096985 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:19.096985 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:19.096985 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:19.096985 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:19.096985 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:19.096985 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:19.096985 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:19.096985 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:19.098709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:19.098709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:19.098709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:19.098709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:19.098709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:19.098709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:19.098709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:19.098709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:19.098709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:19.098709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:19.098709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:19.098709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:19.098709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:19.098709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:19.098709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:19.098709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:19.098709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:19.099746 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:19.099746 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:19.099746 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:19.099746 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 262/514] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:19.100003 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ba14a-e776-4f66-b5cf-9ad56ebe6401 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:19.137151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a536cd-2468-4aa1-8524-cd833e4fd4f5 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:19.160846 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:19.178549 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71576a5-7e98-48e3-9e41-87a020e84df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:19.179170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71576a5-7e98-48e3-9e41-87a020e84df0 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:19.179446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71576a5-7e98-48e3-9e41-87a020e84df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:19.179718 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71576a5-7e98-48e3-9e41-87a020e84df0 None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:19.180366 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71576a5-7e98-48e3-9e41-87a020e84df0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:19.180692 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71576a5-7e98-48e3-9e41-87a020e84df0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:19.182088 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71576a5-7e98-48e3-9e41-87a020e84df0 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:19.194307 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 253/515] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:19.195164 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71576a5-7e98-48e3-9e41-87a020e84df0 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:19.210365 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ba14a-e776-4f66-b5cf-9ad56ebe6401 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:19.235847 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:19.247293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05079834-6fa2-4f11-a5fc-184b6ab565da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:19.247929 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05079834-6fa2-4f11-a5fc-184b6ab565da None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:19.248210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05079834-6fa2-4f11-a5fc-184b6ab565da None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:19.260586 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05079834-6fa2-4f11-a5fc-184b6ab565da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:19.260586 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05079834-6fa2-4f11-a5fc-184b6ab565da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:19.262258 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05079834-6fa2-4f11-a5fc-184b6ab565da None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:19.278344 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-05079834-6fa2-4f11-a5fc-184b6ab565da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:19.278344 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:19.278344 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:19.278344 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:19.278344 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:19.278344 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:19.278344 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:19.278344 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:19.278344 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:19.278344 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:19.278344 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:19.278344 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:19.278344 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:19.278344 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:19.278344 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:19.278344 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:19.279330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:19.279330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:19.279330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:19.279330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:19.279330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:19.279330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:19.279330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:19.279330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:19.279330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:19.279330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:19.279330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:19.279330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:19.279330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:19.279330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:19.279330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:19.279330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:19.279330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:19.280572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:19.280572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:19.280572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:19.280572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 263/516] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:19.280572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05079834-6fa2-4f11-a5fc-184b6ab565da None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:19.312883 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71576a5-7e98-48e3-9e41-87a020e84df0 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:19.350642 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97284832-d883-4835-8c4a-03d87c44e2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:19.351274 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97284832-d883-4835-8c4a-03d87c44e2d5 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:19.351551 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97284832-d883-4835-8c4a-03d87c44e2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:19.351822 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97284832-d883-4835-8c4a-03d87c44e2d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:19.358831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97284832-d883-4835-8c4a-03d87c44e2d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:19.360277 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97284832-d883-4835-8c4a-03d87c44e2d5 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:19.373166 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-97284832-d883-4835-8c4a-03d87c44e2d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:19.373166 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:19.373166 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:19.373166 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:19.373166 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:19.373166 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:19.373166 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:19.373166 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:19.373166 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:19.373166 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:19.373166 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:19.373166 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:19.373166 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:44:19.373166 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:44:19.373166 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:44:19.374086 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:44:19.374086 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:19.374086 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:19.374086 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:19.374086 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:19.374086 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:19.374086 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:19.374086 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:19.374086 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:19.374086 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:19.374086 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:19.374086 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:19.374086 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:19.374086 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:19.374086 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:19.374086 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:19.374086 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:19.375202 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:44:19.375202 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:44:19.375202 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:44:19.375202 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:44:19.375202 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:44:19.375202 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:44:19.375202 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:19.375202 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:19.375202 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 254/517] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:44:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:19.375813 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97284832-d883-4835-8c4a-03d87c44e2d5 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:19.396590 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05079834-6fa2-4f11-a5fc-184b6ab565da None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:19.424768 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:19.431916 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686800c1-e028-45e0-9df5-090de3ba4053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:19.432558 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686800c1-e028-45e0-9df5-090de3ba4053 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:19.432873 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686800c1-e028-45e0-9df5-090de3ba4053 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:19.435149 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686800c1-e028-45e0-9df5-090de3ba4053 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:19.441703 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686800c1-e028-45e0-9df5-090de3ba4053 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:19.443266 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686800c1-e028-45e0-9df5-090de3ba4053 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:19.455103 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-686800c1-e028-45e0-9df5-090de3ba4053 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 15:44:19.455103 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:19.455103 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:19.455103 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:19.455103 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:19.455103 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:19.455103 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:19.455103 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:19.455103 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:19.455103 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:19.455103 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:19.455103 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:19.455103 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:44:19.455103 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:44:19.455103 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:44:19.455103 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:44:19.456091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:19.456091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:19.456091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:44:19.456091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:19.456091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:44:19.456091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:19.456091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:19.456091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:19.456091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:19.456091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:19.456091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:19.456091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:19.456091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:19.456091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:19.456091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:19.456091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:19.456091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:19.456091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:19.457601 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:19.457601 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:19.457601 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:44:19.457601 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:44:19.457601 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:44:19.457601 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:44:19.457601 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:44:19.457601 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:44:19.457601 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 15:44:19.457601 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:19.457601 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 264/518] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 24 15:44:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:19.457601 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686800c1-e028-45e0-9df5-090de3ba4053 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:19.486571 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97284832-d883-4835-8c4a-03d87c44e2d5 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:19.494970 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:19.522462 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75da83d-ed38-4ea6-95c8-a05fe9ea73be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:19.528102 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75da83d-ed38-4ea6-95c8-a05fe9ea73be None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:19.528102 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75da83d-ed38-4ea6-95c8-a05fe9ea73be None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:19.528102 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75da83d-ed38-4ea6-95c8-a05fe9ea73be None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:19.528102 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75da83d-ed38-4ea6-95c8-a05fe9ea73be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:19.528102 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75da83d-ed38-4ea6-95c8-a05fe9ea73be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:19.528102 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75da83d-ed38-4ea6-95c8-a05fe9ea73be None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:19.545291 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 255/519] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:19.546145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75da83d-ed38-4ea6-95c8-a05fe9ea73be None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:19.565120 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686800c1-e028-45e0-9df5-090de3ba4053 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:19.603066 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf2b34-7f9c-4472-85ec-f07cccc0c7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:19.603697 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf2b34-7f9c-4472-85ec-f07cccc0c7e3 None admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:19.604029 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf2b34-7f9c-4472-85ec-f07cccc0c7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:19.604309 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf2b34-7f9c-4472-85ec-f07cccc0c7e3 None admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:19.605300 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf2b34-7f9c-4472-85ec-f07cccc0c7e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:19.607464 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf2b34-7f9c-4472-85ec-f07cccc0c7e3 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:19.658892 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:19.662100 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75da83d-ed38-4ea6-95c8-a05fe9ea73be None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:19.696530 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9c5cd-4eb9-48c6-ad35-fe1dd649bfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:19.697070 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9c5cd-4eb9-48c6-ad35-fe1dd649bfa0 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:19.697347 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9c5cd-4eb9-48c6-ad35-fe1dd649bfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:19.697617 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9c5cd-4eb9-48c6-ad35-fe1dd649bfa0 None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:19.698255 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9c5cd-4eb9-48c6-ad35-fe1dd649bfa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:19.698594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9c5cd-4eb9-48c6-ad35-fe1dd649bfa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:19.704435 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9c5cd-4eb9-48c6-ad35-fe1dd649bfa0 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:19.712586 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 256/521] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:19.712793 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 265/521] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 24 15:44:19 2022] POST /identity/v3/users => generated 247 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:44:19.714236 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9c5cd-4eb9-48c6-ad35-fe1dd649bfa0 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:19.723638 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf2b34-7f9c-4472-85ec-f07cccc0c7e3 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:19.849066 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:19.861603 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9c5cd-4eb9-48c6-ad35-fe1dd649bfa0 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:19.866108 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf2b34-7f9c-4472-85ec-f07cccc0c7e3 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:19.906998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda8089-2ba8-41eb-a9a9-21abf8dbb277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:19.908063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda8089-2ba8-41eb-a9a9-21abf8dbb277 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:19.908477 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda8089-2ba8-41eb-a9a9-21abf8dbb277 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:19.908913 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda8089-2ba8-41eb-a9a9-21abf8dbb277 None admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:19.910240 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda8089-2ba8-41eb-a9a9-21abf8dbb277 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:19.910240 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda8089-2ba8-41eb-a9a9-21abf8dbb277 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:19.911644 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda8089-2ba8-41eb-a9a9-21abf8dbb277 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:19.912223 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f77ad-23e8-4b41-bc5f-24cb242ec320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:19.912914 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f77ad-23e8-4b41-bc5f-24cb242ec320 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:19.913244 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f77ad-23e8-4b41-bc5f-24cb242ec320 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:19.913519 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f77ad-23e8-4b41-bc5f-24cb242ec320 None admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:19.914241 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f77ad-23e8-4b41-bc5f-24cb242ec320 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:19.914606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f77ad-23e8-4b41-bc5f-24cb242ec320 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:19.916105 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f77ad-23e8-4b41-bc5f-24cb242ec320 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:19.933574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 257/522] 10.222.0.64 () {56 vars in 1139 bytes} [Wed Aug 24 15:44:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:19.934437 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda8089-2ba8-41eb-a9a9-21abf8dbb277 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:19.943210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 266/523] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:44:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:19.946688 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f77ad-23e8-4b41-bc5f-24cb242ec320 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:19.963302 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:20.056453 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda8089-2ba8-41eb-a9a9-21abf8dbb277 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:20.070605 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f77ad-23e8-4b41-bc5f-24cb242ec320 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:20.100066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b0b5f-9200-438a-9717-33a326150d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:20.101018 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b0b5f-9200-438a-9717-33a326150d71 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:20.101303 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b0b5f-9200-438a-9717-33a326150d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:20.101579 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b0b5f-9200-438a-9717-33a326150d71 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:20.108222 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899297e-1f34-425d-92fa-77aed472f4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:20.109262 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899297e-1f34-425d-92fa-77aed472f4d8 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:20.109617 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899297e-1f34-425d-92fa-77aed472f4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:20.109865 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899297e-1f34-425d-92fa-77aed472f4d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:20.110259 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b0b5f-9200-438a-9717-33a326150d71 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:20.111737 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b0b5f-9200-438a-9717-33a326150d71 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:20.119268 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899297e-1f34-425d-92fa-77aed472f4d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:20.120997 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899297e-1f34-425d-92fa-77aed472f4d8 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:20.125055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-812b0b5f-9200-438a-9717-33a326150d71 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 15:44:20.125055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:20.125055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:20.125055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:20.125055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:20.125055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:20.125055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:20.125055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:20.125055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:20.125055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:20.125055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:20.125055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:20.125055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:44:20.125055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:44:20.125055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:44:20.125055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:44:20.126023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:20.126023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:20.126023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:44:20.126023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:20.126023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:44:20.126023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:20.126023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:20.126023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:20.126023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:20.126023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:20.126023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:20.126023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:20.126023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:20.126023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:20.126023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:20.126023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:20.126023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:20.126023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:20.126907 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:20.126907 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:20.126907 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:44:20.126907 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:44:20.126907 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:44:20.126907 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:44:20.126907 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:44:20.126907 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:44:20.126907 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 15:44:20.126907 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:20.126907 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 258/524] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:44:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:20.127467 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b0b5f-9200-438a-9717-33a326150d71 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:20.144481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-6899297e-1f34-425d-92fa-77aed472f4d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:20.144481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:20.144481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:20.144481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:20.144481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:20.144481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:20.144481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:20.144481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:20.144481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:20.144481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:20.144481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:20.144481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:20.144481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:44:20.144481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:44:20.144481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:44:20.146147 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:44:20.146147 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:20.146147 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:20.146147 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:20.146147 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:20.146147 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:20.146147 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:20.146147 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:20.146147 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:20.146147 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:20.146147 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:20.146147 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:20.146147 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:20.146147 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:20.146147 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:20.146147 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:20.146147 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:20.146964 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:44:20.146964 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:44:20.146964 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:44:20.146964 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:44:20.146964 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:44:20.146964 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:44:20.146964 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:20.146964 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:20.146964 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 267/525] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:44:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:20.146964 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899297e-1f34-425d-92fa-77aed472f4d8 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:20.167988 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:20.231445 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:20.252840 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b0b5f-9200-438a-9717-33a326150d71 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:20.289101 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899297e-1f34-425d-92fa-77aed472f4d8 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:20.295524 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963c4d2-6ab3-4adf-84b6-8611ab8a47b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:20.296690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963c4d2-6ab3-4adf-84b6-8611ab8a47b3 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:20.296984 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963c4d2-6ab3-4adf-84b6-8611ab8a47b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:20.297282 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963c4d2-6ab3-4adf-84b6-8611ab8a47b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:20.328454 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d031f80-f4be-43f3-a605-9d6334e0704a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:20.332485 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d031f80-f4be-43f3-a605-9d6334e0704a None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:20.332485 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d031f80-f4be-43f3-a605-9d6334e0704a None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:20.332485 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d031f80-f4be-43f3-a605-9d6334e0704a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:20.332485 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d031f80-f4be-43f3-a605-9d6334e0704a None admin] RBAC: Adding query filter params (role.id=a74cbb295dd8432985940aa21806f970, scope.project.id=9b25a7c01ab540ceae16dd618b848f2d, user.id=e5f0d8fe42e74d68bfa9a0e365bab4b6) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:20.332485 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d031f80-f4be-43f3-a605-9d6334e0704a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:20.334046 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d031f80-f4be-43f3-a605-9d6334e0704a None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:20.348852 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 268/526] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:44:20 2022] GET /identity/v3/role_assignments?user.id=e5f0d8fe42e74d68bfa9a0e365bab4b6&scope.project.id=9b25a7c01ab540ceae16dd618b848f2d&role.id=a74cbb295dd8432985940aa21806f970 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:20.350615 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d031f80-f4be-43f3-a605-9d6334e0704a None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:20.393567 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963c4d2-6ab3-4adf-84b6-8611ab8a47b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:20.395830 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963c4d2-6ab3-4adf-84b6-8611ab8a47b3 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:20.475744 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:20.502307 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:20.505436 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d031f80-f4be-43f3-a605-9d6334e0704a None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:20.532571 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 259/527] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:44:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:20.534082 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963c4d2-6ab3-4adf-84b6-8611ab8a47b3 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:20.546254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da5d8f-d392-4cea-b983-09d86cdd9f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:20.546878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da5d8f-d392-4cea-b983-09d86cdd9f0e None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:20.547164 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da5d8f-d392-4cea-b983-09d86cdd9f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:20.547440 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da5d8f-d392-4cea-b983-09d86cdd9f0e None admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:20.548192 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da5d8f-d392-4cea-b983-09d86cdd9f0e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:20.548845 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da5d8f-d392-4cea-b983-09d86cdd9f0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:20.550100 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da5d8f-d392-4cea-b983-09d86cdd9f0e None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:20.593223 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 269/528] 10.222.0.64 () {56 vars in 1137 bytes} [Wed Aug 24 15:44:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:20.594259 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da5d8f-d392-4cea-b983-09d86cdd9f0e None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:20.651154 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963c4d2-6ab3-4adf-84b6-8611ab8a47b3 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:20.689006 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca00ad-587e-4887-9890-04607467862d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:20.689972 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca00ad-587e-4887-9890-04607467862d None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:20.690468 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca00ad-587e-4887-9890-04607467862d None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:20.691206 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca00ad-587e-4887-9890-04607467862d None admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:20.692839 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca00ad-587e-4887-9890-04607467862d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:20.693678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca00ad-587e-4887-9890-04607467862d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:20.696427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca00ad-587e-4887-9890-04607467862d None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:20.713643 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da5d8f-d392-4cea-b983-09d86cdd9f0e None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:20.719617 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 260/529] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:44:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:20.721489 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca00ad-587e-4887-9890-04607467862d None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:20.759063 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386ac2d-11ec-495f-8865-9561552dd100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:20.759769 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386ac2d-11ec-495f-8865-9561552dd100 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:20.760000 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386ac2d-11ec-495f-8865-9561552dd100 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:20.760281 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386ac2d-11ec-495f-8865-9561552dd100 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:20.762521 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:20.773894 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386ac2d-11ec-495f-8865-9561552dd100 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:20.775682 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386ac2d-11ec-495f-8865-9561552dd100 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:20.781418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:20.796099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-9386ac2d-11ec-495f-8865-9561552dd100 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:20.796099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:20.796099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:20.796099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:20.796099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:20.796099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:20.796099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:20.796099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:20.796099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:20.796099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:20.796099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:20.796099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:20.796099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:20.796099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:20.796099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:20.796099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:20.797328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:20.797328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:20.797328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:20.797328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:20.797328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:20.797328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:20.797328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:20.797328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:20.797328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:20.797328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:20.797328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:20.797328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:20.797328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:20.797328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:20.797328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:20.797328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:20.797328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:20.798161 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:20.798161 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:20.798161 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:20.800295 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 270/530] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:20.801592 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386ac2d-11ec-495f-8865-9561552dd100 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:20.864680 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca00ad-587e-4887-9890-04607467862d None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:20.923584 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442a3dd-2b6d-4240-b2e2-17ea48ca7264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:20.924656 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442a3dd-2b6d-4240-b2e2-17ea48ca7264 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:20.925033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442a3dd-2b6d-4240-b2e2-17ea48ca7264 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:20.925666 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442a3dd-2b6d-4240-b2e2-17ea48ca7264 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:20.949198 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386ac2d-11ec-495f-8865-9561552dd100 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:20.989627 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3d24d-c4b7-49d5-9740-3c03460a89fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:20.990237 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3d24d-c4b7-49d5-9740-3c03460a89fb None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:20.990520 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3d24d-c4b7-49d5-9740-3c03460a89fb None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:20.990901 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3d24d-c4b7-49d5-9740-3c03460a89fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:20.991812 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3d24d-c4b7-49d5-9740-3c03460a89fb None admin] RBAC: Adding query filter params (role.id=a74cbb295dd8432985940aa21806f970, scope.project.id=9b25a7c01ab540ceae16dd618b848f2d, user.id=f21fda517a384dc5a6a9f36d68ac1a2d) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:20.992131 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3d24d-c4b7-49d5-9740-3c03460a89fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:20.993614 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3d24d-c4b7-49d5-9740-3c03460a89fb None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:21.000098 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 271/531] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:44:20 2022] GET /identity/v3/role_assignments?user.id=f21fda517a384dc5a6a9f36d68ac1a2d&scope.project.id=9b25a7c01ab540ceae16dd618b848f2d&role.id=a74cbb295dd8432985940aa21806f970 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:21.001010 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3d24d-c4b7-49d5-9740-3c03460a89fb None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:21.022780 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442a3dd-2b6d-4240-b2e2-17ea48ca7264 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:21.024826 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442a3dd-2b6d-4240-b2e2-17ea48ca7264 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:21.072159 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:21.096266 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:21.171873 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3d24d-c4b7-49d5-9740-3c03460a89fb None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:21.222576 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f70ec0-c087-47f4-8340-20e23d750e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:21.223352 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f70ec0-c087-47f4-8340-20e23d750e53 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:21.223637 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f70ec0-c087-47f4-8340-20e23d750e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:21.223904 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f70ec0-c087-47f4-8340-20e23d750e53 None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:21.224610 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f70ec0-c087-47f4-8340-20e23d750e53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:21.224989 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f70ec0-c087-47f4-8340-20e23d750e53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:21.226403 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f70ec0-c087-47f4-8340-20e23d750e53 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:21.235346 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 261/532] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:44:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:21.241662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442a3dd-2b6d-4240-b2e2-17ea48ca7264 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:21.249245 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 272/533] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:21.255946 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f70ec0-c087-47f4-8340-20e23d750e53 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:21.407594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442a3dd-2b6d-4240-b2e2-17ea48ca7264 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:21.444893 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78153684-f93d-4cff-8de3-3e5d5e6b816b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:21.445562 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78153684-f93d-4cff-8de3-3e5d5e6b816b None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:21.445843 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78153684-f93d-4cff-8de3-3e5d5e6b816b None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:21.446116 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78153684-f93d-4cff-8de3-3e5d5e6b816b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:21.453949 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:21.458327 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78153684-f93d-4cff-8de3-3e5d5e6b816b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:21.459809 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78153684-f93d-4cff-8de3-3e5d5e6b816b None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:21.470464 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f70ec0-c087-47f4-8340-20e23d750e53 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:21.483150 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:21.483624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-78153684-f93d-4cff-8de3-3e5d5e6b816b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:21.483624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:21.483624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:21.483624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:21.483624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:21.483624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:21.483624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:21.483624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:21.483624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:21.483624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:21.483624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:21.483624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:21.483624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:21.483624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:21.483624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:21.483624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:21.484740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:21.484740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:21.484740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:21.484740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:21.484740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:21.484740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:21.484740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:21.484740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:21.484740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:21.484740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:21.484740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:21.484740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:21.484740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:21.484740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:21.484740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:21.484740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:21.484740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:21.485735 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:21.485735 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:21.485735 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:21.485735 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 262/534] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:44:21.494283 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78153684-f93d-4cff-8de3-3e5d5e6b816b None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:21.523686 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e0551-1421-41bf-b933-195a617ba942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:21.524696 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e0551-1421-41bf-b933-195a617ba942 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:21.525891 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e0551-1421-41bf-b933-195a617ba942 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:21.526487 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e0551-1421-41bf-b933-195a617ba942 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:21.543530 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e0551-1421-41bf-b933-195a617ba942 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:21.546331 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e0551-1421-41bf-b933-195a617ba942 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:21.570172 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-6e1e0551-1421-41bf-b933-195a617ba942 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:21.570172 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:21.570172 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:21.570172 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:21.570172 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:21.570172 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:21.570172 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:21.570172 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:21.570172 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:21.570172 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:21.570172 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:21.570172 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:21.570172 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:44:21.570172 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:44:21.570172 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:44:21.571467 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:44:21.571467 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:21.571467 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:21.571467 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:21.571467 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:21.571467 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:21.571467 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:21.571467 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:21.571467 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:21.571467 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:21.571467 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:21.571467 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:21.571467 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:21.571467 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:21.571467 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:21.571467 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:21.571467 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:21.572824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:44:21.572824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:44:21.572824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:44:21.572824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:44:21.572824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:44:21.572824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:44:21.572824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:21.572824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:21.579054 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 273/535] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:44:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:44:21.592816 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e0551-1421-41bf-b933-195a617ba942 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:21.724047 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78153684-f93d-4cff-8de3-3e5d5e6b816b None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:21.749965 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e0551-1421-41bf-b933-195a617ba942 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:21.769834 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb7558-dbb5-4f61-b3ef-cf88a5bba330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:21.770505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb7558-dbb5-4f61-b3ef-cf88a5bba330 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:21.770978 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb7558-dbb5-4f61-b3ef-cf88a5bba330 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:21.771448 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb7558-dbb5-4f61-b3ef-cf88a5bba330 None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:21.772583 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb7558-dbb5-4f61-b3ef-cf88a5bba330 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:21.773155 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb7558-dbb5-4f61-b3ef-cf88a5bba330 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:21.775113 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb7558-dbb5-4f61-b3ef-cf88a5bba330 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:21.791418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580490f-4443-4f89-9233-092d68981d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:21.792284 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580490f-4443-4f89-9233-092d68981d6a None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:21.792760 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580490f-4443-4f89-9233-092d68981d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:21.793182 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580490f-4443-4f89-9233-092d68981d6a None admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:21.793322 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 263/536] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:21.794182 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580490f-4443-4f89-9233-092d68981d6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:21.794645 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580490f-4443-4f89-9233-092d68981d6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:21.801270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580490f-4443-4f89-9233-092d68981d6a None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:21.805890 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb7558-dbb5-4f61-b3ef-cf88a5bba330 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:21.816527 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 274/537] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:44:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:21.824736 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580490f-4443-4f89-9233-092d68981d6a None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:21.857446 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:21.935753 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580490f-4443-4f89-9233-092d68981d6a None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:21.940653 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:21.974003 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ef113-7b3d-4bf1-8f47-048b5b818ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:21.974630 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ef113-7b3d-4bf1-8f47-048b5b818ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:21.974914 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ef113-7b3d-4bf1-8f47-048b5b818ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:21.975191 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ef113-7b3d-4bf1-8f47-048b5b818ea6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:21.975936 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ef113-7b3d-4bf1-8f47-048b5b818ea6 None admin] RBAC: Adding query filter params (role.id=a74cbb295dd8432985940aa21806f970, scope.project.id=9b25a7c01ab540ceae16dd618b848f2d, user.id=80f7e6f1af76404096d4c717cbcf20f3) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:21.976252 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ef113-7b3d-4bf1-8f47-048b5b818ea6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:21.977758 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ef113-7b3d-4bf1-8f47-048b5b818ea6 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:21.988838 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 275/538] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:44:21 2022] GET /identity/v3/role_assignments?user.id=80f7e6f1af76404096d4c717cbcf20f3&scope.project.id=9b25a7c01ab540ceae16dd618b848f2d&role.id=a74cbb295dd8432985940aa21806f970 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:21.990320 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5df286-1495-404c-a47a-6a5c611d4e42 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:21.990655 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5df286-1495-404c-a47a-6a5c611d4e42 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:21.990918 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5df286-1495-404c-a47a-6a5c611d4e42 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:21.993498 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 276/539] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:21.998354 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19f050-7f6a-4e82-954c-bf1c91f259a2 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:21.998646 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19f050-7f6a-4e82-954c-bf1c91f259a2 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:21.998921 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19f050-7f6a-4e82-954c-bf1c91f259a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:22.010742 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb7558-dbb5-4f61-b3ef-cf88a5bba330 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:22.031861 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-3e19f050-7f6a-4e82-954c-bf1c91f259a2 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:22.033113 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-3e19f050-7f6a-4e82-954c-bf1c91f259a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:22.066588 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3083c-a00d-44af-b133-ae91a26ad8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:22.067951 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3083c-a00d-44af-b133-ae91a26ad8b5 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:22.070239 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3083c-a00d-44af-b133-ae91a26ad8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:22.070978 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3083c-a00d-44af-b133-ae91a26ad8b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:22.093057 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef3083c-a00d-44af-b133-ae91a26ad8b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:22.095043 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef3083c-a00d-44af-b133-ae91a26ad8b5 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:22.117382 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-2ef3083c-a00d-44af-b133-ae91a26ad8b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:22.117382 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:22.117382 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:22.117382 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:22.117382 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:22.117382 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:22.117382 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:22.117382 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:22.117382 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:22.117382 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:22.117382 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:22.117382 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:22.117382 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:44:22.117382 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:44:22.117382 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:44:22.118490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:44:22.118490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:22.118490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:22.118490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:22.118490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:22.118490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:22.118490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:22.118490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:22.118490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:22.118490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:22.118490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:22.118490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:22.118490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:22.118490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:22.118490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:22.118490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:22.118490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:22.119502 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:44:22.119502 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:44:22.119502 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:44:22.119502 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:44:22.119502 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:44:22.119502 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:44:22.119502 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:22.119502 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:22.127554 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 264/540] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:44:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:22.135409 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3083c-a00d-44af-b133-ae91a26ad8b5 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:22.209543 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 277/541] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:22.284858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3083c-a00d-44af-b133-ae91a26ad8b5 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:22.296684 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:22.323629 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab4443-55b4-42a1-ab98-52452906030d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:22.324255 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab4443-55b4-42a1-ab98-52452906030d None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:22.324530 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab4443-55b4-42a1-ab98-52452906030d None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:22.324827 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab4443-55b4-42a1-ab98-52452906030d None admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:22.325526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab4443-55b4-42a1-ab98-52452906030d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:22.325834 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab4443-55b4-42a1-ab98-52452906030d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:22.327357 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab4443-55b4-42a1-ab98-52452906030d None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:22.345562 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 265/542] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:44:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:22.348230 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19f050-7f6a-4e82-954c-bf1c91f259a2 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:22.379543 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:22.458189 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19f050-7f6a-4e82-954c-bf1c91f259a2 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:22.495081 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbdae6-acd4-49ae-8d77-d3cb3ec9a7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:22.495701 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbdae6-acd4-49ae-8d77-d3cb3ec9a7d6 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:22.495984 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbdae6-acd4-49ae-8d77-d3cb3ec9a7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:22.496258 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbdae6-acd4-49ae-8d77-d3cb3ec9a7d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:22.497091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbdae6-acd4-49ae-8d77-d3cb3ec9a7d6 None admin] RBAC: Adding query filter params (role.id=a74cbb295dd8432985940aa21806f970, scope.project.id=9b25a7c01ab540ceae16dd618b848f2d, user.id=89d937fedccb484a8a494cd686361fac) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:22.497402 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbdae6-acd4-49ae-8d77-d3cb3ec9a7d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:22.498929 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbdae6-acd4-49ae-8d77-d3cb3ec9a7d6 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:22.508756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 278/543] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:44:22 2022] GET /identity/v3/role_assignments?user.id=89d937fedccb484a8a494cd686361fac&scope.project.id=9b25a7c01ab540ceae16dd618b848f2d&role.id=a74cbb295dd8432985940aa21806f970 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:44:22.567988 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18c61e-16cf-47f8-8ec8-4116397209cb None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:22.568308 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18c61e-16cf-47f8-8ec8-4116397209cb None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:22.568539 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18c61e-16cf-47f8-8ec8-4116397209cb None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:22.570352 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 266/544] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:22.575689 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237d2a2-4c03-41fa-8f16-d6d3a4294d66 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:22.576036 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237d2a2-4c03-41fa-8f16-d6d3a4294d66 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:22.576310 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237d2a2-4c03-41fa-8f16-d6d3a4294d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:22.582075 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18c61e-16cf-47f8-8ec8-4116397209cb None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:22.604066 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-5237d2a2-4c03-41fa-8f16-d6d3a4294d66 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:22.605477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-5237d2a2-4c03-41fa-8f16-d6d3a4294d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:22.746670 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18c61e-16cf-47f8-8ec8-4116397209cb None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:22.753560 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 279/545] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:22.796066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57564ee9-e57e-4171-ad26-deaf3028f2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:22.796792 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57564ee9-e57e-4171-ad26-deaf3028f2eb None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:22.797072 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57564ee9-e57e-4171-ad26-deaf3028f2eb None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:22.797344 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57564ee9-e57e-4171-ad26-deaf3028f2eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:22.815228 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57564ee9-e57e-4171-ad26-deaf3028f2eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:22.820297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-57564ee9-e57e-4171-ad26-deaf3028f2eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:22.820297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:22.820297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:22.820297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:22.820297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:22.820297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:22.820297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:22.820297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:22.820297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:22.820297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:22.820297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:22.820297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:22.820297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:22.820297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:22.820297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:22.820297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:22.821218 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:22.821218 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:22.821218 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:22.821218 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:22.821218 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:22.821218 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:22.821218 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:22.821218 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:22.821218 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:22.821218 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:22.821218 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:22.821218 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:22.821218 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:22.821218 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:22.821218 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:22.821218 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:22.821990 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:22.821990 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:22.821990 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:22.821990 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:22.821990 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:22.821990 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:22.821990 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:22.821990 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:22.821990 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:22.821990 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:22.821990 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:22.821990 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:22.821990 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 267/546] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 24 15:44:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:22.827575 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237d2a2-4c03-41fa-8f16-d6d3a4294d66 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:22.857993 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:22.979683 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237d2a2-4c03-41fa-8f16-d6d3a4294d66 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:23.020700 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143f659-755e-4a09-b7b4-24eed164f742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:23.021329 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143f659-755e-4a09-b7b4-24eed164f742 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:23.021607 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143f659-755e-4a09-b7b4-24eed164f742 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:23.021877 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143f659-755e-4a09-b7b4-24eed164f742 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:23.022551 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143f659-755e-4a09-b7b4-24eed164f742 None admin] RBAC: Adding query filter params (name=service) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:23.022851 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143f659-755e-4a09-b7b4-24eed164f742 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:23.024224 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143f659-755e-4a09-b7b4-24eed164f742 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:23.035756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 280/547] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 24 15:44:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:23.041997 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57564ee9-e57e-4171-ad26-deaf3028f2eb None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:23.076473 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:23.132915 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143f659-755e-4a09-b7b4-24eed164f742 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:23.156519 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57564ee9-e57e-4171-ad26-deaf3028f2eb None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:23.204367 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13971049-7b82-450e-b31b-ca80b08e32e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:23.205418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13971049-7b82-450e-b31b-ca80b08e32e7 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:23.205903 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13971049-7b82-450e-b31b-ca80b08e32e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:23.206474 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13971049-7b82-450e-b31b-ca80b08e32e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:23.229117 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13971049-7b82-450e-b31b-ca80b08e32e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:23.230947 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13971049-7b82-450e-b31b-ca80b08e32e7 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:23.258879 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-13971049-7b82-450e-b31b-ca80b08e32e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:23.258879 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:23.258879 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:23.258879 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:23.258879 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:23.258879 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:23.258879 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:23.258879 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:23.258879 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:23.258879 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:23.258879 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:23.258879 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:23.258879 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:23.258879 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:23.258879 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:23.258879 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:23.259933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:23.259933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:23.259933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:23.259933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:23.259933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:23.259933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:23.259933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:23.259933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:23.259933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:23.259933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:23.259933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:23.259933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:23.259933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:23.259933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:23.259933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:23.259933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:23.259933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:23.260810 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:23.260810 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:23.260810 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:23.265524 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 268/548] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:23.271593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13971049-7b82-450e-b31b-ca80b08e32e7 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:23.312413 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:23.359222 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143f659-755e-4a09-b7b4-24eed164f742 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:23.397151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433310e-201f-4ed4-ab6e-7346dd8f658c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:23.397720 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433310e-201f-4ed4-ab6e-7346dd8f658c None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:23.398002 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433310e-201f-4ed4-ab6e-7346dd8f658c None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:23.398276 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433310e-201f-4ed4-ab6e-7346dd8f658c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:23.410204 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433310e-201f-4ed4-ab6e-7346dd8f658c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:23.415522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-c433310e-201f-4ed4-ab6e-7346dd8f658c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:23.415522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:23.415522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:23.415522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:23.415522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:23.415522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:23.415522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:23.415522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:23.415522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:23.415522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:23.415522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:23.415522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:23.415522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:23.415522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:23.415522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:23.415522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:23.416613 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:23.416613 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:23.416613 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:23.416613 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:23.416613 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:23.416613 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:23.416613 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:23.416613 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:23.416613 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:23.416613 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:23.416613 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:23.416613 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:23.416613 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:23.416613 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:23.416613 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:23.416613 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:23.417463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:23.417463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:23.417463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:23.417463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:23.417463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:23.417463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:23.417463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:23.417463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:23.417463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:23.417463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:23.417463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:23.417463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:23.420729 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 281/549] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 24 15:44:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:23.422698 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433310e-201f-4ed4-ab6e-7346dd8f658c None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:23.442205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:23.480125 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13971049-7b82-450e-b31b-ca80b08e32e7 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:23.545092 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433310e-201f-4ed4-ab6e-7346dd8f658c None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:23.561100 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2207282-bc01-4ddb-8c67-9d19128bbf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:23.562546 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2207282-bc01-4ddb-8c67-9d19128bbf96 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:23.563033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2207282-bc01-4ddb-8c67-9d19128bbf96 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:23.563508 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2207282-bc01-4ddb-8c67-9d19128bbf96 None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:23.564971 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2207282-bc01-4ddb-8c67-9d19128bbf96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:23.565784 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2207282-bc01-4ddb-8c67-9d19128bbf96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:23.568273 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2207282-bc01-4ddb-8c67-9d19128bbf96 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:23.586720 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 269/550] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:23.588771 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2eb89-3416-48fe-852c-e57db5fe46e6 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:23.589575 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2eb89-3416-48fe-852c-e57db5fe46e6 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:23.590612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2eb89-3416-48fe-852c-e57db5fe46e6 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:23.596907 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 270/551] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:23.598488 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2eb89-3416-48fe-852c-e57db5fe46e6 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:23.606207 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77e489-3cce-43bb-9e01-a1d90635962f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:23.606833 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77e489-3cce-43bb-9e01-a1d90635962f None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:23.607122 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77e489-3cce-43bb-9e01-a1d90635962f None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:23.607384 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77e489-3cce-43bb-9e01-a1d90635962f None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:23.608131 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77e489-3cce-43bb-9e01-a1d90635962f None admin] RBAC: Adding query filter params (name=service) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:23.608680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77e489-3cce-43bb-9e01-a1d90635962f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:23.610947 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77e489-3cce-43bb-9e01-a1d90635962f None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:23.625711 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 282/552] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 24 15:44:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:44:23.627110 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3e42f-b7ee-47d9-878c-da39d510be20 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:23.627401 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3e42f-b7ee-47d9-878c-da39d510be20 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:23.627790 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3e42f-b7ee-47d9-878c-da39d510be20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:23.635106 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:23.648973 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-b2f3e42f-b7ee-47d9-878c-da39d510be20 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:23.650282 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-b2f3e42f-b7ee-47d9-878c-da39d510be20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:23.740678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 283/553] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:23.741820 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3e42f-b7ee-47d9-878c-da39d510be20 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:23.761692 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2eb89-3416-48fe-852c-e57db5fe46e6 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:23.850275 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128fd18-5589-48bd-86e2-80f0a44d7469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:23.850922 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128fd18-5589-48bd-86e2-80f0a44d7469 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:23.851202 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128fd18-5589-48bd-86e2-80f0a44d7469 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:23.851470 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128fd18-5589-48bd-86e2-80f0a44d7469 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:23.870464 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128fd18-5589-48bd-86e2-80f0a44d7469 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:23.873786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128fd18-5589-48bd-86e2-80f0a44d7469 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:23.898654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-7128fd18-5589-48bd-86e2-80f0a44d7469 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 15:44:23.898654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:23.898654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:23.898654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:23.898654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:23.898654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:23.898654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:23.898654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:23.898654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:23.898654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:23.898654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:23.898654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:23.898654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:44:23.898654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:44:23.898654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:44:23.898654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:44:23.899687 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:23.899687 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:23.899687 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:44:23.899687 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:23.899687 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:44:23.899687 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:23.899687 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:23.899687 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:23.899687 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:23.899687 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:23.899687 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:23.899687 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:23.899687 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:23.899687 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:23.899687 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:23.899687 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:23.899687 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:23.899687 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:23.900607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:23.900607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:23.900607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:44:23.900607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:44:23.900607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:44:23.900607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:44:23.900607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:44:23.900607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:44:23.900607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 15:44:23.900607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:23.908273 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 271/554] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:44:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:23.913580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128fd18-5589-48bd-86e2-80f0a44d7469 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:23.916952 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:23.924483 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3e42f-b7ee-47d9-878c-da39d510be20 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:23.981069 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:24.002104 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16502680-94ab-42c4-bd99-8ddfa4abd93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:24.002610 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16502680-94ab-42c4-bd99-8ddfa4abd93e None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:24.002892 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16502680-94ab-42c4-bd99-8ddfa4abd93e None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:24.003682 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16502680-94ab-42c4-bd99-8ddfa4abd93e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:24.038028 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16502680-94ab-42c4-bd99-8ddfa4abd93e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:24.038807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128fd18-5589-48bd-86e2-80f0a44d7469 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:24.039502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16502680-94ab-42c4-bd99-8ddfa4abd93e None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:24.072782 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-16502680-94ab-42c4-bd99-8ddfa4abd93e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:24.072782 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:24.072782 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:24.072782 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:24.072782 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:24.072782 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:24.072782 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:24.072782 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:24.072782 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:24.072782 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:24.072782 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:24.072782 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:24.072782 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:24.072782 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:24.072782 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:24.072782 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:24.073776 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:24.073776 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:24.073776 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:24.073776 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:24.073776 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:24.073776 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:24.073776 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:24.073776 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:24.073776 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:24.073776 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:24.073776 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:24.073776 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:24.073776 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:24.073776 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:24.073776 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:24.073776 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:24.073776 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:24.079250 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:24.079250 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:24.079250 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:24.079250 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 284/555] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:24.084339 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ff532-914a-44eb-84c8-13f2455674dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:24.085314 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ff532-914a-44eb-84c8-13f2455674dd None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:24.085797 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ff532-914a-44eb-84c8-13f2455674dd None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:24.086266 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ff532-914a-44eb-84c8-13f2455674dd None admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:24.087206 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ff532-914a-44eb-84c8-13f2455674dd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:24.087708 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ff532-914a-44eb-84c8-13f2455674dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:24.089810 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ff532-914a-44eb-84c8-13f2455674dd None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:24.090983 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16502680-94ab-42c4-bd99-8ddfa4abd93e None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:24.110896 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 272/556] 10.222.0.64 () {56 vars in 1135 bytes} [Wed Aug 24 15:44:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:24.116440 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ff532-914a-44eb-84c8-13f2455674dd None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:24.191612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:24.239294 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16502680-94ab-42c4-bd99-8ddfa4abd93e None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:24.247335 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ff532-914a-44eb-84c8-13f2455674dd None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:24.284043 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6ea66-8108-4d9e-9715-d8b49093a7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:24.284856 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6ea66-8108-4d9e-9715-d8b49093a7b0 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:24.285147 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6ea66-8108-4d9e-9715-d8b49093a7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:24.285495 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6ea66-8108-4d9e-9715-d8b49093a7b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:24.286222 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6ea66-8108-4d9e-9715-d8b49093a7b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:24.286588 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6ea66-8108-4d9e-9715-d8b49093a7b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:24.288110 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6ea66-8108-4d9e-9715-d8b49093a7b0 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:24.289690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce29795-9f74-48a0-89fb-f52b69360103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:24.295540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce29795-9f74-48a0-89fb-f52b69360103 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:24.295540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce29795-9f74-48a0-89fb-f52b69360103 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:24.295540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce29795-9f74-48a0-89fb-f52b69360103 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:24.304717 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 285/557] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:24.305700 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6ea66-8108-4d9e-9715-d8b49093a7b0 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:24.365426 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:24.374573 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce29795-9f74-48a0-89fb-f52b69360103 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:24.376440 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce29795-9f74-48a0-89fb-f52b69360103 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:24.445644 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6ea66-8108-4d9e-9715-d8b49093a7b0 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:24.450460 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:24.497930 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b06305-5b61-471f-83f3-e8a9861770e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:24.498966 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b06305-5b61-471f-83f3-e8a9861770e5 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:24.499264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 273/558] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:44:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:24.499657 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b06305-5b61-471f-83f3-e8a9861770e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:24.500111 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce29795-9f74-48a0-89fb-f52b69360103 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:24.500423 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b06305-5b61-471f-83f3-e8a9861770e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:24.517228 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b06305-5b61-471f-83f3-e8a9861770e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:24.522650 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-b5b06305-5b61-471f-83f3-e8a9861770e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:24.522650 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:24.522650 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:24.522650 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:24.522650 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:24.522650 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:24.522650 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:24.522650 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:24.522650 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:24.522650 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:24.522650 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:24.522650 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:24.522650 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:24.522650 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:24.522650 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:24.522650 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:24.524062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:24.524062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:24.524062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:24.524062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:24.524062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:24.524062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:24.524062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:24.524062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:24.524062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:24.524062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:24.524062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:24.524062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:24.524062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:24.524062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:24.524062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:24.524062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:24.524896 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:24.524896 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:24.524896 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:24.524896 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:24.524896 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:24.524896 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:24.524896 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:24.524896 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:24.524896 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:24.524896 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:24.524896 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:24.524896 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:24.527575 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 286/559] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 24 15:44:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:24.528978 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe0671-b330-483e-ad65-ab83fcae06ff None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:24.529335 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe0671-b330-483e-ad65-ab83fcae06ff None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:24.529931 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe0671-b330-483e-ad65-ab83fcae06ff None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:24.531240 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 287/560] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:24.532086 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe0671-b330-483e-ad65-ab83fcae06ff None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:24.624864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce29795-9f74-48a0-89fb-f52b69360103 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:24.671453 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355879f9-c2dd-42f2-b55b-497a7e6e7416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:24.672097 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355879f9-c2dd-42f2-b55b-497a7e6e7416 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:24.672379 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355879f9-c2dd-42f2-b55b-497a7e6e7416 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:24.672677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355879f9-c2dd-42f2-b55b-497a7e6e7416 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:24.673557 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe0671-b330-483e-ad65-ab83fcae06ff None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:24.678537 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:24.682515 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355879f9-c2dd-42f2-b55b-497a7e6e7416 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:24.684015 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355879f9-c2dd-42f2-b55b-497a7e6e7416 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:24.703975 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-355879f9-c2dd-42f2-b55b-497a7e6e7416 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:44:24.703975 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:24.703975 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:24.703975 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:24.703975 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:24.703975 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:24.703975 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:24.703975 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:24.703975 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:24.703975 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:24.703975 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:24.703975 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:24.703975 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:44:24.703975 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:44:24.703975 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:44:24.703975 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:44:24.705132 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:24.705132 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:24.705132 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:44:24.705132 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:24.705132 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:44:24.705132 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:24.705132 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:24.705132 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:24.705132 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:24.705132 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:24.705132 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:24.705132 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:24.705132 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:24.705132 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:24.705132 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:24.705132 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:24.705132 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:24.705132 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:24.706059 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:24.706059 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:24.706059 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:44:24.706059 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:44:24.706059 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:44:24.706059 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:44:24.706059 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:44:24.706059 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:44:24.706059 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:44:24.706059 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:24.706059 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 274/561] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 24 15:44:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:24.706059 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355879f9-c2dd-42f2-b55b-497a7e6e7416 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:24.716391 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b49487-2023-4abe-a192-ff0caafcbb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:24.716935 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b49487-2023-4abe-a192-ff0caafcbb17 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:24.717218 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b49487-2023-4abe-a192-ff0caafcbb17 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:24.717493 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b49487-2023-4abe-a192-ff0caafcbb17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:24.730277 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b49487-2023-4abe-a192-ff0caafcbb17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:24.731781 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b49487-2023-4abe-a192-ff0caafcbb17 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:24.735005 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:24.750745 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-30b49487-2023-4abe-a192-ff0caafcbb17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:24.750745 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:24.750745 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:24.750745 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:24.750745 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:24.750745 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:24.750745 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:24.750745 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:24.750745 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:24.750745 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:24.750745 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:24.750745 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:24.750745 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:24.750745 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:24.750745 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:24.750745 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:24.751772 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:24.751772 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:24.751772 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:24.751772 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:24.751772 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:24.751772 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:24.751772 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:24.751772 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:24.751772 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:24.751772 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:24.751772 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:24.751772 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:24.751772 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:24.751772 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:24.751772 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:24.751772 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:24.751772 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:24.752837 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:24.752837 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:24.752837 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:24.752837 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 288/562] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:24.753081 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f957f-e4ea-4dfd-b864-5949a6ec11a8 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:24.753475 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f957f-e4ea-4dfd-b864-5949a6ec11a8 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:24.753612 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f957f-e4ea-4dfd-b864-5949a6ec11a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:24.815559 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-a49f957f-e4ea-4dfd-b864-5949a6ec11a8 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:24.816992 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-a49f957f-e4ea-4dfd-b864-5949a6ec11a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:24.878706 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355879f9-c2dd-42f2-b55b-497a7e6e7416 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:24.886875 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 289/563] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:24.887723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f957f-e4ea-4dfd-b864-5949a6ec11a8 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:24.926431 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45897ca4-eb8b-41ba-8fc1-f7192043e1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:24.927032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45897ca4-eb8b-41ba-8fc1-f7192043e1e9 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:24.927310 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45897ca4-eb8b-41ba-8fc1-f7192043e1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:24.927577 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45897ca4-eb8b-41ba-8fc1-f7192043e1e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:24.928479 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45897ca4-eb8b-41ba-8fc1-f7192043e1e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:24.928966 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45897ca4-eb8b-41ba-8fc1-f7192043e1e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:24.930420 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45897ca4-eb8b-41ba-8fc1-f7192043e1e9 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:24.939505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 275/564] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 24 15:44:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:24.940353 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45897ca4-eb8b-41ba-8fc1-f7192043e1e9 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:24.990140 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:25.014539 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f957f-e4ea-4dfd-b864-5949a6ec11a8 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:25.040247 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:25.057249 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec32fcd-55b1-45d4-a5fa-257bb87d13dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:25.057866 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec32fcd-55b1-45d4-a5fa-257bb87d13dc None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:25.058136 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec32fcd-55b1-45d4-a5fa-257bb87d13dc None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:25.058408 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec32fcd-55b1-45d4-a5fa-257bb87d13dc None admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:25.059140 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec32fcd-55b1-45d4-a5fa-257bb87d13dc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:25.059440 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec32fcd-55b1-45d4-a5fa-257bb87d13dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:25.061083 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec32fcd-55b1-45d4-a5fa-257bb87d13dc None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:25.061976 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45897ca4-eb8b-41ba-8fc1-f7192043e1e9 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:25.086694 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 290/565] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 24 15:44:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:25.086694 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4873a-cc2e-4885-9690-be877a73fd11 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:25.086694 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4873a-cc2e-4885-9690-be877a73fd11 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:25.086694 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4873a-cc2e-4885-9690-be877a73fd11 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:25.086694 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 291/566] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:25.086694 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4873a-cc2e-4885-9690-be877a73fd11 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:25.116208 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299b3af-d34d-4aa4-b254-15f913c9a4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:25.116854 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299b3af-d34d-4aa4-b254-15f913c9a4fc None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:25.117134 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299b3af-d34d-4aa4-b254-15f913c9a4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:25.117403 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299b3af-d34d-4aa4-b254-15f913c9a4fc None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:25.118764 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299b3af-d34d-4aa4-b254-15f913c9a4fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:25.118764 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299b3af-d34d-4aa4-b254-15f913c9a4fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:25.119817 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299b3af-d34d-4aa4-b254-15f913c9a4fc None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:25.139025 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 276/567] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:25.139025 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299b3af-d34d-4aa4-b254-15f913c9a4fc None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:25.216037 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4873a-cc2e-4885-9690-be877a73fd11 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:25.251291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2775fe5-ad42-4aa5-923b-39e5c86cfbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:25.251495 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299b3af-d34d-4aa4-b254-15f913c9a4fc None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:25.251837 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2775fe5-ad42-4aa5-923b-39e5c86cfbd5 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:25.252214 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2775fe5-ad42-4aa5-923b-39e5c86cfbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:25.252493 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2775fe5-ad42-4aa5-923b-39e5c86cfbd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:25.262586 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2775fe5-ad42-4aa5-923b-39e5c86cfbd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:25.264076 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2775fe5-ad42-4aa5-923b-39e5c86cfbd5 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:25.266598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:25.279440 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-f2775fe5-ad42-4aa5-923b-39e5c86cfbd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:25.279440 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:25.279440 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:25.279440 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:25.279440 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:25.279440 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:25.279440 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:25.279440 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:25.279440 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:25.279440 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:25.279440 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:25.279440 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:25.279440 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:25.279440 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:25.279440 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:25.279440 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:25.280850 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:25.280850 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:25.280850 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:25.280850 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:25.280850 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:25.280850 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:25.280850 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:25.280850 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:25.280850 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:25.280850 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:25.280850 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:25.280850 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:25.280850 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:25.280850 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:25.280850 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:25.280850 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:25.280850 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:25.281705 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:25.281705 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:25.281705 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:25.281705 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 292/568] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:25.282491 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f6f02-600d-4280-afd5-bb467abd673c None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:25.282776 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f6f02-600d-4280-afd5-bb467abd673c None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:25.283050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f6f02-600d-4280-afd5-bb467abd673c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:25.292203 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b277ecd-a34b-4c53-8032-805b9fca17a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:25.292897 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b277ecd-a34b-4c53-8032-805b9fca17a9 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:25.293174 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b277ecd-a34b-4c53-8032-805b9fca17a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:25.293440 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b277ecd-a34b-4c53-8032-805b9fca17a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:25.302548 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-762f6f02-600d-4280-afd5-bb467abd673c None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:25.303762 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-762f6f02-600d-4280-afd5-bb467abd673c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:25.307053 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b277ecd-a34b-4c53-8032-805b9fca17a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:25.308517 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b277ecd-a34b-4c53-8032-805b9fca17a9 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:25.310433 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:25.324163 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-6b277ecd-a34b-4c53-8032-805b9fca17a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:25.324163 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:25.324163 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:25.324163 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:25.324163 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:25.324163 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:25.324163 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:25.324163 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:25.324163 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:25.324163 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:25.324163 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:25.324163 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:25.324163 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:25.324163 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:25.324163 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:25.324163 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:25.325445 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:25.325445 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:25.325445 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:25.325445 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:25.325445 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:25.325445 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:25.325445 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:25.325445 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:25.325445 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:25.325445 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:25.325445 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:25.325445 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:25.325445 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:25.325445 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:25.325445 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:25.325445 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:25.325445 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:25.326311 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:25.326311 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:25.326311 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:25.326311 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 277/569] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:25.326536 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b277ecd-a34b-4c53-8032-805b9fca17a9 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:25.378133 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 293/570] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:25.379016 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f6f02-600d-4280-afd5-bb467abd673c None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:25.447076 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b277ecd-a34b-4c53-8032-805b9fca17a9 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:25.488311 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509b947-8519-4c2a-91b6-4d4981d0f6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:25.489054 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509b947-8519-4c2a-91b6-4d4981d0f6a9 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:25.489310 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509b947-8519-4c2a-91b6-4d4981d0f6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:25.489586 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509b947-8519-4c2a-91b6-4d4981d0f6a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:25.496883 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1509b947-8519-4c2a-91b6-4d4981d0f6a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:25.497214 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f6f02-600d-4280-afd5-bb467abd673c None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:25.498341 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1509b947-8519-4c2a-91b6-4d4981d0f6a9 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:25.513943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-1509b947-8519-4c2a-91b6-4d4981d0f6a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:25.513943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:25.513943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:25.513943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:25.513943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:25.513943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:25.513943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:25.513943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:25.513943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:25.513943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:25.513943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:25.513943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:25.513943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:44:25.513943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:44:25.513943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:44:25.514869 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:44:25.514869 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:25.514869 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:25.514869 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:25.514869 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:25.514869 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:25.514869 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:25.514869 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:25.514869 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:25.514869 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:25.514869 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:25.514869 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:25.514869 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:25.514869 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:25.514869 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:25.514869 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:25.514869 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:25.515746 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:44:25.515746 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:44:25.515746 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:44:25.515746 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:44:25.515746 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:44:25.515746 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:44:25.515746 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:25.515746 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:25.515746 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 278/571] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:44:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:25.515746 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509b947-8519-4c2a-91b6-4d4981d0f6a9 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:25.536028 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:25.545319 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5511b-1ee0-40cd-a7e1-d3286d1a9b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:25.552788 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5511b-1ee0-40cd-a7e1-d3286d1a9b8b None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:25.552788 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5511b-1ee0-40cd-a7e1-d3286d1a9b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:25.552788 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5511b-1ee0-40cd-a7e1-d3286d1a9b8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:25.559305 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5511b-1ee0-40cd-a7e1-d3286d1a9b8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:25.564157 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-84e5511b-1ee0-40cd-a7e1-d3286d1a9b8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:25.564157 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:25.564157 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:25.564157 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:25.564157 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:25.564157 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:25.564157 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:25.564157 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:25.564157 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:25.564157 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:25.564157 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:25.564157 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:25.564157 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:25.564157 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:25.564157 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:25.564157 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:25.565291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:25.565291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:25.565291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:25.565291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:25.565291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:25.565291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:25.565291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:25.565291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:25.565291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:25.565291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:25.565291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:25.565291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:25.565291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:25.565291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:25.565291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:25.565291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:25.566775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:25.566775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:25.566775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:25.566775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:25.566775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:25.566775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:25.566775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:25.566775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:25.566775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:25.566775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:25.566775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:25.566775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:25.566775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 294/572] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 24 15:44:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:25.567484 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5511b-1ee0-40cd-a7e1-d3286d1a9b8b None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:25.584991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:25.636859 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509b947-8519-4c2a-91b6-4d4981d0f6a9 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:25.673501 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10155d2f-7ea4-4c6a-9657-a93e97bb2fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:25.674112 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10155d2f-7ea4-4c6a-9657-a93e97bb2fee None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:25.674393 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10155d2f-7ea4-4c6a-9657-a93e97bb2fee None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:25.674669 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10155d2f-7ea4-4c6a-9657-a93e97bb2fee None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:25.675426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10155d2f-7ea4-4c6a-9657-a93e97bb2fee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:25.675749 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10155d2f-7ea4-4c6a-9657-a93e97bb2fee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:25.677162 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10155d2f-7ea4-4c6a-9657-a93e97bb2fee None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:25.688029 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5511b-1ee0-40cd-a7e1-d3286d1a9b8b None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:25.691806 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 279/573] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:25.692755 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10155d2f-7ea4-4c6a-9657-a93e97bb2fee None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:25.725904 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ff9f3-8299-478a-b58e-f054f95d8582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:25.726517 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ff9f3-8299-478a-b58e-f054f95d8582 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:25.726795 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ff9f3-8299-478a-b58e-f054f95d8582 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:25.727064 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ff9f3-8299-478a-b58e-f054f95d8582 None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:25.727714 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ff9f3-8299-478a-b58e-f054f95d8582 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:25.728015 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ff9f3-8299-478a-b58e-f054f95d8582 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:25.729449 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ff9f3-8299-478a-b58e-f054f95d8582 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:25.742187 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 295/574] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:25.743150 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ff9f3-8299-478a-b58e-f054f95d8582 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:25.794185 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:25.803626 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10155d2f-7ea4-4c6a-9657-a93e97bb2fee None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:25.819125 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:25.840752 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3336f2-2e60-4bb7-a143-07902082b6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:25.841512 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3336f2-2e60-4bb7-a143-07902082b6ba None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:25.841928 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3336f2-2e60-4bb7-a143-07902082b6ba None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:25.842330 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3336f2-2e60-4bb7-a143-07902082b6ba None admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:25.843520 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3336f2-2e60-4bb7-a143-07902082b6ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:25.844147 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3336f2-2e60-4bb7-a143-07902082b6ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:25.845869 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3336f2-2e60-4bb7-a143-07902082b6ba None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:25.851102 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ff9f3-8299-478a-b58e-f054f95d8582 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:25.857784 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 280/575] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:44:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:25.858621 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3336f2-2e60-4bb7-a143-07902082b6ba None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:25.894878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8029b3a-be54-416a-b9ee-17be30bdc0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:25.895493 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8029b3a-be54-416a-b9ee-17be30bdc0be None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:25.895773 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8029b3a-be54-416a-b9ee-17be30bdc0be None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:25.896041 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8029b3a-be54-416a-b9ee-17be30bdc0be None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:25.896739 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8029b3a-be54-416a-b9ee-17be30bdc0be None admin] RBAC: Adding query filter params (name=service) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:25.897041 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8029b3a-be54-416a-b9ee-17be30bdc0be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:25.898414 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8029b3a-be54-416a-b9ee-17be30bdc0be None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:25.907065 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 296/576] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 24 15:44:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:25.907893 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8029b3a-be54-416a-b9ee-17be30bdc0be None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:25.968563 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3336f2-2e60-4bb7-a143-07902082b6ba None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:26.009458 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f9fa1-326d-456b-9005-6e2a25a81bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:26.010384 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f9fa1-326d-456b-9005-6e2a25a81bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:26.010841 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f9fa1-326d-456b-9005-6e2a25a81bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:26.011269 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f9fa1-326d-456b-9005-6e2a25a81bb6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:26.023895 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8029b3a-be54-416a-b9ee-17be30bdc0be None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:26.026631 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f9fa1-326d-456b-9005-6e2a25a81bb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:26.032162 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-917f9fa1-326d-456b-9005-6e2a25a81bb6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:26.032162 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:26.032162 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:26.032162 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:26.032162 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:26.032162 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:26.032162 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:26.032162 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:26.032162 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:26.032162 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:26.032162 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:26.032162 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:26.032162 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:26.032162 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:26.032162 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:26.032162 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:26.033151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:26.033151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:26.033151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:26.033151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:26.033151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:26.033151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:26.033151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:26.033151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:26.033151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:26.033151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:26.033151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:26.033151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:26.033151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:26.033151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:26.033151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:26.033151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:26.033966 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:26.033966 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:26.033966 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:26.033966 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:26.033966 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:26.033966 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:26.033966 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:26.033966 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:26.033966 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:26.033966 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:26.033966 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:26.033966 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:26.033966 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 281/577] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 24 15:44:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:26.034734 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f9fa1-326d-456b-9005-6e2a25a81bb6 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:26.035641 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:26.062981 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c472e4-51fd-489d-acbd-41c2fb61f57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:26.063869 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c472e4-51fd-489d-acbd-41c2fb61f57e None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:26.064157 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c472e4-51fd-489d-acbd-41c2fb61f57e None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:26.064428 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c472e4-51fd-489d-acbd-41c2fb61f57e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:26.071552 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:26.074070 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c472e4-51fd-489d-acbd-41c2fb61f57e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:26.075549 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c472e4-51fd-489d-acbd-41c2fb61f57e None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:26.087223 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-f7c472e4-51fd-489d-acbd-41c2fb61f57e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 15:44:26.087223 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:26.087223 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:26.087223 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:26.087223 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:26.087223 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:26.087223 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:26.087223 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:26.087223 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:26.087223 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:26.087223 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:26.087223 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:26.087223 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:44:26.087223 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:44:26.087223 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:44:26.087223 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:44:26.088802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:26.088802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:26.088802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:44:26.088802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:26.088802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:44:26.088802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:26.088802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:26.088802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:26.088802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:26.088802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:26.088802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:26.088802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:26.088802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:26.088802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:26.088802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:26.088802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:26.088802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:26.088802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:26.090163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:26.090163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:26.090163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:44:26.090163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:44:26.090163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:44:26.090163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:44:26.090163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:44:26.090163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:44:26.090163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 15:44:26.090163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:26.090163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 297/578] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:44:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:26.090163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c472e4-51fd-489d-acbd-41c2fb61f57e None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:26.151071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f9fa1-326d-456b-9005-6e2a25a81bb6 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:26.187517 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbcfe2-95c4-40e0-ba97-3f6252f8b853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:26.188152 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbcfe2-95c4-40e0-ba97-3f6252f8b853 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:26.188433 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbcfe2-95c4-40e0-ba97-3f6252f8b853 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:26.188736 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbcfe2-95c4-40e0-ba97-3f6252f8b853 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:26.196180 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cbcfe2-95c4-40e0-ba97-3f6252f8b853 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:26.197653 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cbcfe2-95c4-40e0-ba97-3f6252f8b853 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:26.199503 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c472e4-51fd-489d-acbd-41c2fb61f57e None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:26.210133 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-f8cbcfe2-95c4-40e0-ba97-3f6252f8b853 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:26.210133 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:26.210133 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:26.210133 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:26.210133 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:26.210133 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:26.210133 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:26.210133 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:26.210133 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:26.210133 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:26.210133 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:26.210133 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:26.210133 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:44:26.210133 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:44:26.210133 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:44:26.211122 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:44:26.211122 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:26.211122 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:26.211122 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:26.211122 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:26.211122 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:26.211122 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:26.211122 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:26.211122 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:26.211122 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:26.211122 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:26.211122 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:26.211122 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:26.211122 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:26.211122 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:26.211122 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:26.211122 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:26.212886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:44:26.212886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:44:26.212886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:44:26.212886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:44:26.212886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:44:26.212886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:44:26.212886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:26.212886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:26.212886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 282/579] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:44:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:26.212886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbcfe2-95c4-40e0-ba97-3f6252f8b853 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:26.243279 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f2ca3-f71b-401f-8c14-d9638a207bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:26.243901 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f2ca3-f71b-401f-8c14-d9638a207bab None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:26.244185 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f2ca3-f71b-401f-8c14-d9638a207bab None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:26.244464 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f2ca3-f71b-401f-8c14-d9638a207bab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:26.245247 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f2ca3-f71b-401f-8c14-d9638a207bab None admin] RBAC: Adding query filter params (role.id=a74cbb295dd8432985940aa21806f970, scope.project.id=9b25a7c01ab540ceae16dd618b848f2d, user.id=b3a0a84e4c4e47fc930881109fc07039) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:26.245559 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f2ca3-f71b-401f-8c14-d9638a207bab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:26.247038 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f2ca3-f71b-401f-8c14-d9638a207bab None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:26.252902 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 298/580] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:44:26 2022] GET /identity/v3/role_assignments?user.id=b3a0a84e4c4e47fc930881109fc07039&scope.project.id=9b25a7c01ab540ceae16dd618b848f2d&role.id=a74cbb295dd8432985940aa21806f970 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:26.253937 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f2ca3-f71b-401f-8c14-d9638a207bab None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:26.304376 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:26.333523 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:26.341311 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbcfe2-95c4-40e0-ba97-3f6252f8b853 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:26.389121 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2de41-18fc-492e-9643-d29e804fb9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:26.389771 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2de41-18fc-492e-9643-d29e804fb9b0 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:26.390053 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2de41-18fc-492e-9643-d29e804fb9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:26.390330 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2de41-18fc-492e-9643-d29e804fb9b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:26.398145 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f2ca3-f71b-401f-8c14-d9638a207bab None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:26.402832 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2de41-18fc-492e-9643-d29e804fb9b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:26.404317 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2de41-18fc-492e-9643-d29e804fb9b0 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:26.427170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-75e2de41-18fc-492e-9643-d29e804fb9b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:26.427170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:26.427170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:26.427170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:26.427170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:26.427170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:26.427170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:26.427170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:26.427170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:26.427170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:26.427170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:26.427170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:26.427170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:26.427170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:26.427170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:26.427170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:26.428241 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:26.428241 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:26.428241 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:26.428241 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:26.428241 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:26.428241 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:26.428241 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:26.428241 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:26.428241 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:26.428241 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:26.428241 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:26.428241 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:26.428241 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:26.428241 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:26.428241 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:26.428241 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:26.428241 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:26.429181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:26.429181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:26.429181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:26.429181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 283/581] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:26.430416 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2de41-18fc-492e-9643-d29e804fb9b0 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:26.450110 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b1a75-b04e-4891-87b1-823168f3cc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:26.450813 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b1a75-b04e-4891-87b1-823168f3cc2e None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:26.451173 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b1a75-b04e-4891-87b1-823168f3cc2e None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:26.451510 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b1a75-b04e-4891-87b1-823168f3cc2e None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:26.452248 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b1a75-b04e-4891-87b1-823168f3cc2e None admin] RBAC: Adding query filter params (name=service) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:26.452658 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b1a75-b04e-4891-87b1-823168f3cc2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:26.454114 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b1a75-b04e-4891-87b1-823168f3cc2e None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:26.463589 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 299/582] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 24 15:44:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:26.463589 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b1a75-b04e-4891-87b1-823168f3cc2e None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:26.558184 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2de41-18fc-492e-9643-d29e804fb9b0 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:26.566953 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:26.574463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b1a75-b04e-4891-87b1-823168f3cc2e None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:26.603245 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084ac61-12a3-4bb7-90ec-12e780121e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:26.603876 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084ac61-12a3-4bb7-90ec-12e780121e47 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:26.604152 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084ac61-12a3-4bb7-90ec-12e780121e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:26.604421 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084ac61-12a3-4bb7-90ec-12e780121e47 None admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:26.605190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084ac61-12a3-4bb7-90ec-12e780121e47 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:26.605494 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084ac61-12a3-4bb7-90ec-12e780121e47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:26.606936 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084ac61-12a3-4bb7-90ec-12e780121e47 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:26.614802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1479f2f-9bf9-4a93-b4f2-6ebe198c05fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:26.615421 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1479f2f-9bf9-4a93-b4f2-6ebe198c05fc None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:26.615703 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1479f2f-9bf9-4a93-b4f2-6ebe198c05fc None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:26.615979 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1479f2f-9bf9-4a93-b4f2-6ebe198c05fc None admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:26.616706 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1479f2f-9bf9-4a93-b4f2-6ebe198c05fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:26.617015 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1479f2f-9bf9-4a93-b4f2-6ebe198c05fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:26.618449 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1479f2f-9bf9-4a93-b4f2-6ebe198c05fc None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:26.627470 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 284/583] 10.222.0.64 () {56 vars in 1137 bytes} [Wed Aug 24 15:44:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:26.628693 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084ac61-12a3-4bb7-90ec-12e780121e47 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:26.633066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:26.636522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 300/584] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:44:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:26.637629 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1479f2f-9bf9-4a93-b4f2-6ebe198c05fc None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:26.753460 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084ac61-12a3-4bb7-90ec-12e780121e47 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:26.757099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1479f2f-9bf9-4a93-b4f2-6ebe198c05fc None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:26.791490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c91e7b-c42b-4b81-9f17-1fe4b8efdb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:26.791490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c91e7b-c42b-4b81-9f17-1fe4b8efdb1a None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:26.791490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c91e7b-c42b-4b81-9f17-1fe4b8efdb1a None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:26.791490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c91e7b-c42b-4b81-9f17-1fe4b8efdb1a None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:26.793291 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c91e7b-c42b-4b81-9f17-1fe4b8efdb1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:26.793583 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c91e7b-c42b-4b81-9f17-1fe4b8efdb1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:26.795181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c91e7b-c42b-4b81-9f17-1fe4b8efdb1a None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:26.800493 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d9c2d-65ac-4522-bcb0-f311ef6d3fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:26.801254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d9c2d-65ac-4522-bcb0-f311ef6d3fbb None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:26.801630 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d9c2d-65ac-4522-bcb0-f311ef6d3fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:26.801911 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d9c2d-65ac-4522-bcb0-f311ef6d3fbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:26.813614 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 285/585] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:26.813614 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c91e7b-c42b-4b81-9f17-1fe4b8efdb1a None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:26.819422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d9c2d-65ac-4522-bcb0-f311ef6d3fbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:26.820994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d9c2d-65ac-4522-bcb0-f311ef6d3fbb None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:26.837265 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-3e8d9c2d-65ac-4522-bcb0-f311ef6d3fbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:26.837265 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:26.837265 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:26.837265 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:26.837265 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:26.837265 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:26.837265 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:26.837265 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:26.837265 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:26.837265 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:26.837265 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:26.837265 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:26.837265 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:26.837265 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:26.837265 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:26.837265 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:26.838269 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:26.838269 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:26.838269 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:26.838269 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:26.838269 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:26.838269 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:26.838269 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:26.838269 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:26.838269 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:26.838269 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:26.838269 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:26.838269 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:26.838269 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:26.838269 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:26.838269 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:26.838269 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:26.838269 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:26.844004 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:26.844004 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:26.844004 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:26.844004 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 301/586] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:26.844004 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d9c2d-65ac-4522-bcb0-f311ef6d3fbb None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:26.851975 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:26.896212 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:26.938743 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c91e7b-c42b-4b81-9f17-1fe4b8efdb1a None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:26.961862 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d9c2d-65ac-4522-bcb0-f311ef6d3fbb None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:26.984552 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83f55f-74ca-4153-ade6-2c43e7e0406b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:26.985218 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83f55f-74ca-4153-ade6-2c43e7e0406b None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:26.985496 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83f55f-74ca-4153-ade6-2c43e7e0406b None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:26.985766 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83f55f-74ca-4153-ade6-2c43e7e0406b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:27.003618 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf83f55f-74ca-4153-ade6-2c43e7e0406b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:27.004471 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b343d-6a23-48b5-99fc-5b4f1b1ea691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:27.005080 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b343d-6a23-48b5-99fc-5b4f1b1ea691 None admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:27.005327 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b343d-6a23-48b5-99fc-5b4f1b1ea691 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:27.005517 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf83f55f-74ca-4153-ade6-2c43e7e0406b None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:27.005656 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b343d-6a23-48b5-99fc-5b4f1b1ea691 None admin] PATH_INFO: `/v3/projects/9b25a7c01ab540ceae16dd618b848f2d/users/e5f0d8fe42e74d68bfa9a0e365bab4b6/roles/a74cbb295dd8432985940aa21806f970` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:27.023530 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b343d-6a23-48b5-99fc-5b4f1b1ea691 None admin] RBAC: Authorizing `identity:create_grant(project_id=9b25a7c01ab540ceae16dd618b848f2d, user_id=e5f0d8fe42e74d68bfa9a0e365bab4b6, role_id=a74cbb295dd8432985940aa21806f970)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:27.025044 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b343d-6a23-48b5-99fc-5b4f1b1ea691 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:27.028364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-cf83f55f-74ca-4153-ade6-2c43e7e0406b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:27.028364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:27.028364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:27.028364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:27.028364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:27.028364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:27.028364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:27.028364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:27.028364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:27.028364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:27.028364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:27.028364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:27.028364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:27.028364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:27.028364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:27.028364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:27.029876 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:27.029876 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:27.029876 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:27.029876 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:27.029876 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:27.029876 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:27.029876 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:27.029876 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:27.029876 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:27.029876 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:27.029876 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:27.029876 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:27.029876 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:27.029876 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:27.029876 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:27.029876 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:27.029876 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:27.030915 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:27.030915 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:27.030915 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:27.030915 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 286/587] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:27.030915 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83f55f-74ca-4153-ade6-2c43e7e0406b None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:27.113003 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 302/588] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 24 15:44:26 2022] PUT /identity/v3/projects/9b25a7c01ab540ceae16dd618b848f2d/users/e5f0d8fe42e74d68bfa9a0e365bab4b6/roles/a74cbb295dd8432985940aa21806f970 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:44:27.114314 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b343d-6a23-48b5-99fc-5b4f1b1ea691 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:27.141261 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83f55f-74ca-4153-ade6-2c43e7e0406b None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:27.163986 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:27.187300 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ec649-7823-4ceb-b5af-8ee4cabc4da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:27.187948 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ec649-7823-4ceb-b5af-8ee4cabc4da7 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:27.188222 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ec649-7823-4ceb-b5af-8ee4cabc4da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:27.188495 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ec649-7823-4ceb-b5af-8ee4cabc4da7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:27.199464 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ec649-7823-4ceb-b5af-8ee4cabc4da7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:27.201026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ec649-7823-4ceb-b5af-8ee4cabc4da7 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:27.215032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-835ec649-7823-4ceb-b5af-8ee4cabc4da7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 15:44:27.215032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:27.215032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:27.215032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:27.215032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:27.215032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:27.215032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:27.215032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:27.215032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:27.215032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:27.215032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:27.215032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:27.215032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:44:27.215032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:44:27.215032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:44:27.215032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:44:27.216186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:27.216186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:27.216186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:44:27.216186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:27.216186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:44:27.216186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:27.216186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:27.216186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:27.216186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:27.216186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:27.216186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:27.216186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:27.216186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:27.216186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:27.216186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:27.216186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:27.216186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:27.216186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:27.217139 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:27.217139 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:27.217139 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:44:27.217139 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:44:27.217139 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:44:27.217139 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:44:27.217139 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:44:27.217139 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:44:27.217139 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 15:44:27.217139 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:27.221371 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 287/589] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 24 15:44:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:27.222384 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ec649-7823-4ceb-b5af-8ee4cabc4da7 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:27.226091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:27.295858 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b343d-6a23-48b5-99fc-5b4f1b1ea691 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:27.342435 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2cb64-529b-4240-8190-72103dce6a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:27.343103 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2cb64-529b-4240-8190-72103dce6a5b None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:27.343729 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2cb64-529b-4240-8190-72103dce6a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:27.343729 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2cb64-529b-4240-8190-72103dce6a5b None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:27.344332 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2cb64-529b-4240-8190-72103dce6a5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:27.344654 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2cb64-529b-4240-8190-72103dce6a5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:27.346051 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2cb64-529b-4240-8190-72103dce6a5b None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:27.359168 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 303/590] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:27.359662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ec649-7823-4ceb-b5af-8ee4cabc4da7 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:27.360147 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2cb64-529b-4240-8190-72103dce6a5b None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:27.407640 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226cbba-7405-4697-9151-b988c7e0e5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:27.408069 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226cbba-7405-4697-9151-b988c7e0e5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:27.408351 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226cbba-7405-4697-9151-b988c7e0e5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:27.408639 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226cbba-7405-4697-9151-b988c7e0e5a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:27.409446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226cbba-7405-4697-9151-b988c7e0e5a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:27.409911 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226cbba-7405-4697-9151-b988c7e0e5a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:27.411282 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226cbba-7405-4697-9151-b988c7e0e5a1 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:27.429274 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 288/591] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:27.430434 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226cbba-7405-4697-9151-b988c7e0e5a1 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:27.480784 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:27.497842 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2cb64-529b-4240-8190-72103dce6a5b None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:27.522043 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:27.544052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf01fd-c878-4b68-823d-f0f78d5aa64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:27.544702 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf01fd-c878-4b68-823d-f0f78d5aa64f None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:27.544989 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf01fd-c878-4b68-823d-f0f78d5aa64f None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:27.545260 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf01fd-c878-4b68-823d-f0f78d5aa64f None admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:27.545999 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf01fd-c878-4b68-823d-f0f78d5aa64f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:27.546299 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf01fd-c878-4b68-823d-f0f78d5aa64f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:27.547741 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf01fd-c878-4b68-823d-f0f78d5aa64f None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:27.570650 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226cbba-7405-4697-9151-b988c7e0e5a1 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:27.571192 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 304/592] 10.222.0.64 () {56 vars in 1139 bytes} [Wed Aug 24 15:44:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:27.572047 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf01fd-c878-4b68-823d-f0f78d5aa64f None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:27.619301 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d8601-ec83-4479-9751-4f5718ef877c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:27.620203 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d8601-ec83-4479-9751-4f5718ef877c None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:27.620683 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d8601-ec83-4479-9751-4f5718ef877c None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:27.621106 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d8601-ec83-4479-9751-4f5718ef877c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:27.632637 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d8601-ec83-4479-9751-4f5718ef877c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:27.634337 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d8601-ec83-4479-9751-4f5718ef877c None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:27.650176 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-806d8601-ec83-4479-9751-4f5718ef877c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 15:44:27.650176 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:27.650176 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:27.650176 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:27.650176 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:27.650176 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:27.650176 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:27.650176 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:27.650176 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:27.650176 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:27.650176 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:27.650176 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:27.650176 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:44:27.650176 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:44:27.650176 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:44:27.650176 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:44:27.651390 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:27.651390 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:27.651390 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:44:27.651390 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:27.651390 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:44:27.651390 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:27.651390 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:27.651390 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:27.651390 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:27.651390 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:27.651390 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:27.651390 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:27.651390 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:27.651390 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:27.651390 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:27.651390 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:27.651390 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:27.651390 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:27.652442 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:27.652442 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:27.652442 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:44:27.652442 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:44:27.652442 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:44:27.652442 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:44:27.652442 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:44:27.652442 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:44:27.652442 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 15:44:27.652442 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:27.652442 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 289/593] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:44:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:27.653072 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d8601-ec83-4479-9751-4f5718ef877c None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:27.714317 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf01fd-c878-4b68-823d-f0f78d5aa64f None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:27.766148 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb6b86-407a-4662-b905-40b178fbf4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:27.766819 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb6b86-407a-4662-b905-40b178fbf4a6 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:27.767104 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb6b86-407a-4662-b905-40b178fbf4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:27.767379 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb6b86-407a-4662-b905-40b178fbf4a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:27.776923 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:27.801185 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb6b86-407a-4662-b905-40b178fbf4a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:27.801185 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb6b86-407a-4662-b905-40b178fbf4a6 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:27.801539 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d8601-ec83-4479-9751-4f5718ef877c None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:27.801800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-fdfb6b86-407a-4662-b905-40b178fbf4a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:27.801800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:27.801800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:27.801800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:27.801800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:27.801800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:27.801800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:27.801800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:27.801800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:27.801800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:27.801800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:27.801800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:27.801800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:44:27.801800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:44:27.801800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:44:27.802671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:44:27.802671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:27.802671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:27.802671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:27.802671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:27.802671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:27.802671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:27.802671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:27.802671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:27.802671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:27.802671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:27.802671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:27.802671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:27.802671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:27.802671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:27.802671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:27.802671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:27.804141 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:44:27.804141 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:44:27.804141 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:44:27.804141 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:44:27.804141 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:44:27.804141 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:44:27.804141 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:27.804141 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:27.804141 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 305/594] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:44:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:27.804947 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb6b86-407a-4662-b905-40b178fbf4a6 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:27.845117 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2afa9-dbbe-467c-afcd-f5b60c76b592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:27.845754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2afa9-dbbe-467c-afcd-f5b60c76b592 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:27.846035 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2afa9-dbbe-467c-afcd-f5b60c76b592 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:27.846305 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2afa9-dbbe-467c-afcd-f5b60c76b592 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:27.852405 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:27.859476 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2afa9-dbbe-467c-afcd-f5b60c76b592 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:27.864359 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2afa9-dbbe-467c-afcd-f5b60c76b592 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:27.879561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-3fd2afa9-dbbe-467c-afcd-f5b60c76b592 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:27.879561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:27.879561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:27.879561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:27.879561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:27.879561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:27.879561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:27.879561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:27.879561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:27.879561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:27.879561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:27.879561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:27.879561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:27.879561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:27.879561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:27.879561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:27.880566 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:27.880566 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:27.880566 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:27.880566 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:27.880566 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:27.880566 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:27.880566 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:27.880566 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:27.880566 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:27.880566 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:27.880566 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:27.880566 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:27.880566 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:27.880566 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:27.880566 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:27.880566 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:27.880566 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:27.881490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:27.881490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:27.881490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:27.884787 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 290/595] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:27.885987 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2afa9-dbbe-467c-afcd-f5b60c76b592 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:27.950130 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb6b86-407a-4662-b905-40b178fbf4a6 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:27.996133 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8897a-0ca2-4345-9087-59c6bc0065b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:27.996821 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8897a-0ca2-4345-9087-59c6bc0065b5 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:27.997174 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8897a-0ca2-4345-9087-59c6bc0065b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:27.997514 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8897a-0ca2-4345-9087-59c6bc0065b5 None admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:27.998371 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2afa9-dbbe-467c-afcd-f5b60c76b592 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:27.998510 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae8897a-0ca2-4345-9087-59c6bc0065b5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:27.998747 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae8897a-0ca2-4345-9087-59c6bc0065b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:28.000332 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae8897a-0ca2-4345-9087-59c6bc0065b5 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:28.026270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 306/596] 10.222.0.64 () {56 vars in 1137 bytes} [Wed Aug 24 15:44:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:28.027437 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8897a-0ca2-4345-9087-59c6bc0065b5 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:28.038371 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82ac3b-9995-49e9-984f-2e07a6425c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:28.039406 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82ac3b-9995-49e9-984f-2e07a6425c3f None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:28.039875 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82ac3b-9995-49e9-984f-2e07a6425c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:28.040379 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82ac3b-9995-49e9-984f-2e07a6425c3f None admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:28.041302 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82ac3b-9995-49e9-984f-2e07a6425c3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:28.041800 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82ac3b-9995-49e9-984f-2e07a6425c3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:28.043434 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82ac3b-9995-49e9-984f-2e07a6425c3f None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:28.057721 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 291/597] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:44:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:28.058938 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82ac3b-9995-49e9-984f-2e07a6425c3f None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:28.076325 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:28.155930 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:28.166374 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8897a-0ca2-4345-9087-59c6bc0065b5 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:28.195315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82ac3b-9995-49e9-984f-2e07a6425c3f None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:28.205759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3a941-fdb4-492b-a2c9-75b0e44a979d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:28.207461 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3a941-fdb4-492b-a2c9-75b0e44a979d None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:28.207976 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3a941-fdb4-492b-a2c9-75b0e44a979d None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:28.208443 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3a941-fdb4-492b-a2c9-75b0e44a979d None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:28.209296 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3a941-fdb4-492b-a2c9-75b0e44a979d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:28.209830 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3a941-fdb4-492b-a2c9-75b0e44a979d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:28.211515 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3a941-fdb4-492b-a2c9-75b0e44a979d None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:28.225226 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 307/598] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:28.227657 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3a941-fdb4-492b-a2c9-75b0e44a979d None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:28.241452 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb8b42-e489-40cd-9f7e-d96653e19dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:28.241963 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb8b42-e489-40cd-9f7e-d96653e19dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:28.242297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb8b42-e489-40cd-9f7e-d96653e19dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:28.242582 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb8b42-e489-40cd-9f7e-d96653e19dd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:28.254629 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb8b42-e489-40cd-9f7e-d96653e19dd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:28.256349 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb8b42-e489-40cd-9f7e-d96653e19dd1 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:28.272743 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-8bdb8b42-e489-40cd-9f7e-d96653e19dd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:28.272743 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:28.272743 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:28.272743 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:28.272743 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:28.272743 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:28.272743 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:28.272743 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:28.272743 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:28.272743 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:28.272743 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:28.272743 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:28.272743 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:28.272743 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:28.272743 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:28.272743 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:28.273763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:28.273763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:28.273763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:28.273763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:28.273763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:28.273763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:28.273763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:28.273763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:28.273763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:28.273763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:28.273763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:28.273763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:28.273763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:28.273763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:28.273763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:28.273763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:28.273763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:28.274662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:28.274662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:28.274662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:28.274662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 292/599] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:28.274662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb8b42-e489-40cd-9f7e-d96653e19dd1 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:28.342314 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:28.355897 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3a941-fdb4-492b-a2c9-75b0e44a979d None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:28.385939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb8b42-e489-40cd-9f7e-d96653e19dd1 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:28.399661 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54717c6f-8ca6-48d1-a37d-f4e897dbbc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:28.400373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54717c6f-8ca6-48d1-a37d-f4e897dbbc95 None admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:28.400658 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54717c6f-8ca6-48d1-a37d-f4e897dbbc95 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:28.400895 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54717c6f-8ca6-48d1-a37d-f4e897dbbc95 None admin] PATH_INFO: `/v3/projects/9b25a7c01ab540ceae16dd618b848f2d/users/f21fda517a384dc5a6a9f36d68ac1a2d/roles/a74cbb295dd8432985940aa21806f970` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:28.426367 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9194fb-e727-40cb-8054-f2c817b39493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:28.427292 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9194fb-e727-40cb-8054-f2c817b39493 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:28.427714 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9194fb-e727-40cb-8054-f2c817b39493 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:28.428131 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9194fb-e727-40cb-8054-f2c817b39493 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:28.430266 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54717c6f-8ca6-48d1-a37d-f4e897dbbc95 None admin] RBAC: Authorizing `identity:create_grant(project_id=9b25a7c01ab540ceae16dd618b848f2d, user_id=f21fda517a384dc5a6a9f36d68ac1a2d, role_id=a74cbb295dd8432985940aa21806f970)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:28.433151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54717c6f-8ca6-48d1-a37d-f4e897dbbc95 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:28.436575 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9194fb-e727-40cb-8054-f2c817b39493 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:28.438102 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9194fb-e727-40cb-8054-f2c817b39493 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:28.451900 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-ac9194fb-e727-40cb-8054-f2c817b39493 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:28.451900 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:28.451900 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:28.451900 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:28.451900 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:28.451900 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:28.451900 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:28.451900 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:28.451900 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:28.451900 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:28.451900 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:28.451900 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:28.451900 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:44:28.451900 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:44:28.451900 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:44:28.460173 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:44:28.460173 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:28.460173 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:28.460173 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:28.460173 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:28.460173 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:28.460173 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:28.460173 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:28.460173 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:28.460173 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:28.460173 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:28.460173 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:28.460173 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:28.460173 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:28.460173 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:28.460173 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:28.460173 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:28.461660 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:44:28.461660 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:44:28.461660 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:44:28.461660 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:44:28.461660 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:44:28.461660 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:44:28.461660 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:28.461660 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:28.461660 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 293/600] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:44:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:28.461660 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9194fb-e727-40cb-8054-f2c817b39493 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:28.514038 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 308/601] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 24 15:44:28 2022] PUT /identity/v3/projects/9b25a7c01ab540ceae16dd618b848f2d/users/f21fda517a384dc5a6a9f36d68ac1a2d/roles/a74cbb295dd8432985940aa21806f970 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:44:28.515524 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174a978-b573-4695-a357-9b1ed51f3960 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:28.515811 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174a978-b573-4695-a357-9b1ed51f3960 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:28.516087 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174a978-b573-4695-a357-9b1ed51f3960 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:28.517657 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 309/602] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:28.518274 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174a978-b573-4695-a357-9b1ed51f3960 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:28.522197 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:28.610577 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9194fb-e727-40cb-8054-f2c817b39493 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:28.642583 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:28.664699 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698ceab-d531-4d55-b459-5c9dd037af0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:28.665378 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698ceab-d531-4d55-b459-5c9dd037af0b None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:28.665659 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698ceab-d531-4d55-b459-5c9dd037af0b None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:28.665944 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698ceab-d531-4d55-b459-5c9dd037af0b None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:28.666622 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698ceab-d531-4d55-b459-5c9dd037af0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:28.668521 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698ceab-d531-4d55-b459-5c9dd037af0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:28.669463 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698ceab-d531-4d55-b459-5c9dd037af0b None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:28.693242 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 294/603] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:28.694697 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d335b6a-35e1-4d1e-aaf1-9da6e42c52b8 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:28.694922 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d335b6a-35e1-4d1e-aaf1-9da6e42c52b8 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:28.695200 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d335b6a-35e1-4d1e-aaf1-9da6e42c52b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:28.704075 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174a978-b573-4695-a357-9b1ed51f3960 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:28.717897 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-2d335b6a-35e1-4d1e-aaf1-9da6e42c52b8 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:28.719580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-2d335b6a-35e1-4d1e-aaf1-9da6e42c52b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:28.746571 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df64bf-f15c-4583-b430-4517a27919b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:28.747200 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df64bf-f15c-4583-b430-4517a27919b4 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:28.747482 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df64bf-f15c-4583-b430-4517a27919b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:28.747759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df64bf-f15c-4583-b430-4517a27919b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:28.748471 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df64bf-f15c-4583-b430-4517a27919b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:28.748923 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df64bf-f15c-4583-b430-4517a27919b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:28.750486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df64bf-f15c-4583-b430-4517a27919b4 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:28.765536 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 310/604] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:44:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:28.766343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df64bf-f15c-4583-b430-4517a27919b4 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:28.798565 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 295/605] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:28.799420 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d335b6a-35e1-4d1e-aaf1-9da6e42c52b8 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:28.838166 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:28.882293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df64bf-f15c-4583-b430-4517a27919b4 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:28.920161 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef2f2b-a61e-41d4-bfec-76771790ecd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:28.920951 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef2f2b-a61e-41d4-bfec-76771790ecd9 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:28.921239 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef2f2b-a61e-41d4-bfec-76771790ecd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:28.921512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef2f2b-a61e-41d4-bfec-76771790ecd9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:28.930247 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef2f2b-a61e-41d4-bfec-76771790ecd9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:28.931821 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef2f2b-a61e-41d4-bfec-76771790ecd9 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:28.942352 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d335b6a-35e1-4d1e-aaf1-9da6e42c52b8 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:28.945387 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-eeef2f2b-a61e-41d4-bfec-76771790ecd9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:28.945387 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:28.945387 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:28.945387 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:28.945387 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:28.945387 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:28.945387 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:28.945387 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:28.945387 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:28.945387 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:28.945387 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:28.945387 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:28.945387 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:44:28.945387 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:44:28.945387 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:44:28.946293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:44:28.946293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:28.946293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:28.946293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:28.946293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:28.946293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:28.946293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:28.946293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:28.946293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:28.946293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:28.946293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:28.946293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:28.946293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:28.946293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:28.946293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:28.946293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:28.946293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:28.947146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:44:28.947146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:44:28.947146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:44:28.947146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:44:28.947146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:44:28.947146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:44:28.947146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:28.947146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:28.951286 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 311/606] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:44:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:28.952706 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef2f2b-a61e-41d4-bfec-76771790ecd9 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:28.954281 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:28.979263 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865445e-06a2-415b-b1dd-f6eb7d6cbbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:28.980116 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865445e-06a2-415b-b1dd-f6eb7d6cbbf7 None admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:28.980518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865445e-06a2-415b-b1dd-f6eb7d6cbbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:28.980922 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865445e-06a2-415b-b1dd-f6eb7d6cbbf7 None admin] PATH_INFO: `/v3/projects/9b25a7c01ab540ceae16dd618b848f2d/users/80f7e6f1af76404096d4c717cbcf20f3/roles/a74cbb295dd8432985940aa21806f970` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:28.997659 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865445e-06a2-415b-b1dd-f6eb7d6cbbf7 None admin] RBAC: Authorizing `identity:create_grant(project_id=9b25a7c01ab540ceae16dd618b848f2d, user_id=80f7e6f1af76404096d4c717cbcf20f3, role_id=a74cbb295dd8432985940aa21806f970)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:28.999261 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865445e-06a2-415b-b1dd-f6eb7d6cbbf7 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:29.069270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef2f2b-a61e-41d4-bfec-76771790ecd9 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:29.093973 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:29.107211 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d3843-4b21-4ea9-afc9-67f7754e9fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:29.107886 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d3843-4b21-4ea9-afc9-67f7754e9fda None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:29.108197 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d3843-4b21-4ea9-afc9-67f7754e9fda None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:29.108440 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d3843-4b21-4ea9-afc9-67f7754e9fda None admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:29.109169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d3843-4b21-4ea9-afc9-67f7754e9fda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:29.109485 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d3843-4b21-4ea9-afc9-67f7754e9fda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:29.119662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 296/607] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 24 15:44:28 2022] PUT /identity/v3/projects/9b25a7c01ab540ceae16dd618b848f2d/users/80f7e6f1af76404096d4c717cbcf20f3/roles/a74cbb295dd8432985940aa21806f970 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:44:29.119837 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d3843-4b21-4ea9-afc9-67f7754e9fda None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:29.131710 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 312/608] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:44:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:44:29.133236 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865445e-06a2-415b-b1dd-f6eb7d6cbbf7 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:29.190169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d3843-4b21-4ea9-afc9-67f7754e9fda None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:29.323550 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865445e-06a2-415b-b1dd-f6eb7d6cbbf7 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:29.368235 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b57bc-cd68-4183-8365-fb42964bea3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:29.368934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b57bc-cd68-4183-8365-fb42964bea3b None admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:29.369218 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b57bc-cd68-4183-8365-fb42964bea3b None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:29.369496 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b57bc-cd68-4183-8365-fb42964bea3b None admin] PATH_INFO: `/v3/projects/9b25a7c01ab540ceae16dd618b848f2d/users/89d937fedccb484a8a494cd686361fac/roles/a74cbb295dd8432985940aa21806f970` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:29.375927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d3843-4b21-4ea9-afc9-67f7754e9fda None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:29.395735 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b57bc-cd68-4183-8365-fb42964bea3b None admin] RBAC: Authorizing `identity:create_grant(project_id=9b25a7c01ab540ceae16dd618b848f2d, user_id=89d937fedccb484a8a494cd686361fac, role_id=a74cbb295dd8432985940aa21806f970)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:29.397750 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b57bc-cd68-4183-8365-fb42964bea3b None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:29.421013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd197a-a6e1-4c13-97a0-80aabe0eb86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:29.421981 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd197a-a6e1-4c13-97a0-80aabe0eb86f None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:29.422406 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd197a-a6e1-4c13-97a0-80aabe0eb86f None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:29.422924 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd197a-a6e1-4c13-97a0-80aabe0eb86f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:29.434486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd197a-a6e1-4c13-97a0-80aabe0eb86f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:29.439824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-96cd197a-a6e1-4c13-97a0-80aabe0eb86f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:29.439824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:29.439824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:29.439824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:29.439824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:29.439824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:29.439824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:29.439824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:29.439824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:29.439824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:29.439824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:29.439824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:29.439824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:29.439824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:29.439824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:29.439824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:29.441792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:29.441792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:29.441792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:29.441792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:29.441792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:29.441792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:29.441792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:29.441792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:29.441792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:29.441792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:29.441792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:29.441792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:29.441792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:29.441792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:29.441792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:29.441792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:29.442823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:29.442823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:29.442823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:29.442823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:29.442823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:29.442823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:29.442823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:29.442823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:29.442823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:29.442823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:29.442823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:29.442823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:29.444874 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 313/609] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 24 15:44:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:44:29.446402 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911509d-1684-43ed-93a9-63897864a760 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:29.447290 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911509d-1684-43ed-93a9-63897864a760 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:29.447696 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911509d-1684-43ed-93a9-63897864a760 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:29.449372 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 314/610] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:29.454366 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911509d-1684-43ed-93a9-63897864a760 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:29.472990 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 297/611] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 24 15:44:29 2022] PUT /identity/v3/projects/9b25a7c01ab540ceae16dd618b848f2d/users/89d937fedccb484a8a494cd686361fac/roles/a74cbb295dd8432985940aa21806f970 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:44:29.474777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb30bb-9fa0-444c-b09a-a15f4b2e4b9a None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:29.475165 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb30bb-9fa0-444c-b09a-a15f4b2e4b9a None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:29.475541 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb30bb-9fa0-444c-b09a-a15f4b2e4b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:29.521688 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-9beb30bb-9fa0-444c-b09a-a15f4b2e4b9a None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:29.522920 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-9beb30bb-9fa0-444c-b09a-a15f4b2e4b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:29.530535 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:29.556760 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:29.641610 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911509d-1684-43ed-93a9-63897864a760 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:29.665148 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 298/612] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:29.687560 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e68bd-0b59-4fb2-bc45-e76edcf2a75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:29.688179 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e68bd-0b59-4fb2-bc45-e76edcf2a75d None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:29.688460 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e68bd-0b59-4fb2-bc45-e76edcf2a75d None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:29.688865 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e68bd-0b59-4fb2-bc45-e76edcf2a75d None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:29.689600 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e68bd-0b59-4fb2-bc45-e76edcf2a75d None admin] RBAC: Adding query filter params (name=service) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:29.689903 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e68bd-0b59-4fb2-bc45-e76edcf2a75d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:29.692313 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e68bd-0b59-4fb2-bc45-e76edcf2a75d None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:29.702066 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 315/613] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 24 15:44:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:29.707968 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb30bb-9fa0-444c-b09a-a15f4b2e4b9a None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:29.826653 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb30bb-9fa0-444c-b09a-a15f4b2e4b9a None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:29.881201 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ab695-7c88-4d41-99cb-99addba62e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:29.882234 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ab695-7c88-4d41-99cb-99addba62e97 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:29.882716 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ab695-7c88-4d41-99cb-99addba62e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:29.883188 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ab695-7c88-4d41-99cb-99addba62e97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:29.900114 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ab695-7c88-4d41-99cb-99addba62e97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:29.901941 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ab695-7c88-4d41-99cb-99addba62e97 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:29.904819 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:29.924232 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-234ab695-7c88-4d41-99cb-99addba62e97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:29.924232 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:29.924232 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:29.924232 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:29.924232 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:29.924232 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:29.924232 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:29.924232 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:29.924232 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:29.924232 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:29.924232 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:29.924232 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:29.924232 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:29.924232 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:29.924232 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:29.924232 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:29.926908 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:29.926908 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:29.926908 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:29.926908 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:29.926908 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:29.926908 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:29.926908 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:29.926908 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:29.926908 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:29.926908 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:29.926908 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:29.926908 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:29.926908 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:29.926908 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:29.926908 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:29.926908 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:29.926908 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:29.927778 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:29.927778 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:29.927778 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:29.933944 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 299/614] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:29.942009 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e68bd-0b59-4fb2-bc45-e76edcf2a75d None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:29.999418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ab695-7c88-4d41-99cb-99addba62e97 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:30.090172 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e68bd-0b59-4fb2-bc45-e76edcf2a75d None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:30.093385 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:30.140810 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0421f-584f-4381-8d00-f35655daf50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:30.141822 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0421f-584f-4381-8d00-f35655daf50c None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:30.142307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0421f-584f-4381-8d00-f35655daf50c None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:30.142796 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0421f-584f-4381-8d00-f35655daf50c None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:30.143765 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0421f-584f-4381-8d00-f35655daf50c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:30.144301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0421f-584f-4381-8d00-f35655daf50c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:30.146420 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0421f-584f-4381-8d00-f35655daf50c None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:30.165733 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ab695-7c88-4d41-99cb-99addba62e97 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:30.173853 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 316/615] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:30.181604 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0421f-584f-4381-8d00-f35655daf50c None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:30.214473 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac9926-efbe-4695-bf62-caf229ec18bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:30.215179 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac9926-efbe-4695-bf62-caf229ec18bb None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:30.215461 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac9926-efbe-4695-bf62-caf229ec18bb None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:30.215733 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac9926-efbe-4695-bf62-caf229ec18bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:30.230293 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac9926-efbe-4695-bf62-caf229ec18bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:30.240336 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-52ac9926-efbe-4695-bf62-caf229ec18bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:30.240336 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:30.240336 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:30.240336 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:30.240336 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:30.240336 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:30.240336 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:30.240336 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:30.240336 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:30.240336 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:30.240336 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:30.240336 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:30.240336 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:30.240336 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:30.240336 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:30.240336 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:30.241576 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:30.241576 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:30.241576 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:30.241576 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:30.241576 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:30.241576 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:30.241576 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:30.241576 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:30.241576 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:30.241576 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:30.241576 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:30.241576 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:30.241576 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:30.241576 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:30.241576 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:30.241576 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:30.242610 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:30.242610 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:30.242610 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:30.242610 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:30.242610 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:30.242610 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:30.242610 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:30.242610 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:30.242610 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:30.242610 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:30.242610 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:30.242610 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:30.242610 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 300/616] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 24 15:44:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:30.253008 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac9926-efbe-4695-bf62-caf229ec18bb None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:30.323956 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0421f-584f-4381-8d00-f35655daf50c None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:30.372929 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:30.373993 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e2114-3c9e-4209-8b8f-ce1ee6bb807e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:30.376368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e2114-3c9e-4209-8b8f-ce1ee6bb807e None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:30.376368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e2114-3c9e-4209-8b8f-ce1ee6bb807e None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:30.376368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e2114-3c9e-4209-8b8f-ce1ee6bb807e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:30.388131 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e2114-3c9e-4209-8b8f-ce1ee6bb807e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:30.389641 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e2114-3c9e-4209-8b8f-ce1ee6bb807e None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:30.411442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-345e2114-3c9e-4209-8b8f-ce1ee6bb807e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 15:44:30.411442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:30.411442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:30.411442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:30.411442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:30.411442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:30.411442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:30.411442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:30.411442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:30.411442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:30.411442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:30.411442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:30.411442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:44:30.411442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:44:30.411442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:44:30.411442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:44:30.414050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:30.414050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:30.414050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:44:30.414050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:30.414050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:44:30.414050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:30.414050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:30.414050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:30.414050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:30.414050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:30.414050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:30.414050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:30.414050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:30.414050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:30.414050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:30.414050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:30.414050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:30.414050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:30.414977 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:30.414977 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:30.414977 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:44:30.414977 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:44:30.414977 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:44:30.414977 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:44:30.414977 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:44:30.414977 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:44:30.414977 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 15:44:30.414977 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:30.414977 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 317/617] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:44:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:44:30.421774 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e2114-3c9e-4209-8b8f-ce1ee6bb807e None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:30.451341 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac9926-efbe-4695-bf62-caf229ec18bb None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:30.479457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:30.548729 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e7f7d-a318-4607-bf9a-abdc3be55c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:30.549923 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e7f7d-a318-4607-bf9a-abdc3be55c64 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:30.550643 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e7f7d-a318-4607-bf9a-abdc3be55c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:30.551399 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e7f7d-a318-4607-bf9a-abdc3be55c64 None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:30.552346 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e7f7d-a318-4607-bf9a-abdc3be55c64 None admin] RBAC: Adding query filter params (name=service) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:30.552894 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e7f7d-a318-4607-bf9a-abdc3be55c64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:30.554497 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e7f7d-a318-4607-bf9a-abdc3be55c64 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:30.573827 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 301/618] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 24 15:44:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:30.576336 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e7f7d-a318-4607-bf9a-abdc3be55c64 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:30.656886 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e2114-3c9e-4209-8b8f-ce1ee6bb807e None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:30.758871 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e7f7d-a318-4607-bf9a-abdc3be55c64 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:30.776972 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:30.800369 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5e644-b6b2-45f6-8226-a66ff8488e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:30.801685 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5e644-b6b2-45f6-8226-a66ff8488e12 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:30.802187 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5e644-b6b2-45f6-8226-a66ff8488e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:30.802888 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5e644-b6b2-45f6-8226-a66ff8488e12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:30.817948 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a6419-b80b-4010-931e-a11b6d79ce77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:30.818951 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a6419-b80b-4010-931e-a11b6d79ce77 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:30.819609 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a6419-b80b-4010-931e-a11b6d79ce77 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:30.820841 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5e644-b6b2-45f6-8226-a66ff8488e12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:30.821740 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a6419-b80b-4010-931e-a11b6d79ce77 None admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:30.824378 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5e644-b6b2-45f6-8226-a66ff8488e12 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:30.825473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a6419-b80b-4010-931e-a11b6d79ce77 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:30.826015 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a6419-b80b-4010-931e-a11b6d79ce77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:30.827687 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a6419-b80b-4010-931e-a11b6d79ce77 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:30.860860 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 318/619] 10.222.0.64 () {56 vars in 1135 bytes} [Wed Aug 24 15:44:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:30.861847 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-38a5e644-b6b2-45f6-8226-a66ff8488e12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:30.861847 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:30.861847 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:30.861847 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:30.861847 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:30.861847 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:30.861847 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:30.861847 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:30.861847 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:30.861847 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:30.861847 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:30.861847 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:30.861847 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:30.861847 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:30.861847 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:30.861847 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:30.863120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:30.863120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:30.863120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:30.863120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:30.863120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:30.863120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:30.863120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:30.863120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:30.863120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:30.863120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:30.863120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:30.863120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:30.863120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:30.863120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:30.863120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:30.863120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:30.863120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:30.864000 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:30.864000 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:30.864000 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:30.864000 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 302/620] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:30.864230 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82eb76-f1fd-4cae-ace5-5703d7084553 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:30.867456 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5e644-b6b2-45f6-8226-a66ff8488e12 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:30.867604 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82eb76-f1fd-4cae-ace5-5703d7084553 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:30.867604 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82eb76-f1fd-4cae-ace5-5703d7084553 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:30.868894 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 319/621] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:30.870038 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82eb76-f1fd-4cae-ace5-5703d7084553 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:31.031667 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5e644-b6b2-45f6-8226-a66ff8488e12 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:31.062088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:31.083435 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab81f9-ffcb-4578-89ef-a523f4118876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:31.084147 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab81f9-ffcb-4578-89ef-a523f4118876 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:31.084452 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab81f9-ffcb-4578-89ef-a523f4118876 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:31.084754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab81f9-ffcb-4578-89ef-a523f4118876 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:31.091580 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82eb76-f1fd-4cae-ace5-5703d7084553 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:31.097016 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab81f9-ffcb-4578-89ef-a523f4118876 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:31.098659 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab81f9-ffcb-4578-89ef-a523f4118876 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:31.115073 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-42ab81f9-ffcb-4578-89ef-a523f4118876 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:31.115073 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:31.115073 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:31.115073 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:31.115073 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:31.115073 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:31.115073 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:31.115073 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:31.115073 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:31.115073 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:31.115073 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:31.115073 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:31.115073 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:31.115073 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:31.115073 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:31.115073 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:31.116145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:31.116145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:31.116145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:31.116145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:31.116145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:31.116145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:31.116145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:31.116145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:31.116145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:31.116145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:31.116145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:31.116145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:31.116145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:31.116145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:31.116145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:31.116145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:31.116145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:31.117083 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:31.117083 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:31.117083 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:31.117083 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 303/622] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:31.117862 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795937d6-80e5-46b2-b207-99a4d9605349 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:31.118146 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795937d6-80e5-46b2-b207-99a4d9605349 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:31.118473 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795937d6-80e5-46b2-b207-99a4d9605349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:31.136793 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a0fbb-bfb6-4e9d-82f9-14bff81cfe9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:31.137819 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a0fbb-bfb6-4e9d-82f9-14bff81cfe9f None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:31.138010 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-795937d6-80e5-46b2-b207-99a4d9605349 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:31.138486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a0fbb-bfb6-4e9d-82f9-14bff81cfe9f None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:31.138963 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a0fbb-bfb6-4e9d-82f9-14bff81cfe9f None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:31.139246 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-795937d6-80e5-46b2-b207-99a4d9605349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:31.140057 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a0fbb-bfb6-4e9d-82f9-14bff81cfe9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:31.140563 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a0fbb-bfb6-4e9d-82f9-14bff81cfe9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:31.142165 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a0fbb-bfb6-4e9d-82f9-14bff81cfe9f None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:31.154195 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:31.156308 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 320/623] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:31.157389 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a0fbb-bfb6-4e9d-82f9-14bff81cfe9f None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:31.224611 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 304/624] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:31.225635 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795937d6-80e5-46b2-b207-99a4d9605349 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:31.271810 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a0fbb-bfb6-4e9d-82f9-14bff81cfe9f None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:31.313973 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3836b0b-fd79-4e3b-91fc-bd9c8293eb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:31.314943 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3836b0b-fd79-4e3b-91fc-bd9c8293eb72 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:31.315976 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3836b0b-fd79-4e3b-91fc-bd9c8293eb72 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:31.316488 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3836b0b-fd79-4e3b-91fc-bd9c8293eb72 None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:31.317384 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3836b0b-fd79-4e3b-91fc-bd9c8293eb72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:31.317944 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3836b0b-fd79-4e3b-91fc-bd9c8293eb72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:31.319576 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3836b0b-fd79-4e3b-91fc-bd9c8293eb72 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:31.333412 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 321/625] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:31.339054 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3836b0b-fd79-4e3b-91fc-bd9c8293eb72 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:31.345595 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:31.422889 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795937d6-80e5-46b2-b207-99a4d9605349 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:31.463944 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2c19a-d551-4330-b5fb-f016241223b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:31.465200 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2c19a-d551-4330-b5fb-f016241223b6 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:31.465690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2c19a-d551-4330-b5fb-f016241223b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:31.466168 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2c19a-d551-4330-b5fb-f016241223b6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:31.476306 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c2c19a-d551-4330-b5fb-f016241223b6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:31.478337 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c2c19a-d551-4330-b5fb-f016241223b6 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:31.492791 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-06c2c19a-d551-4330-b5fb-f016241223b6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:44:31.492791 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:31.492791 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:31.492791 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:31.492791 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:31.492791 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:31.492791 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:31.492791 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:31.492791 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:31.492791 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:31.492791 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:31.492791 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:31.492791 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:44:31.492791 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:44:31.492791 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:44:31.492791 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:44:31.493807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:31.493807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:31.493807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:44:31.493807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:31.493807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:44:31.493807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:31.493807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:31.493807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:31.493807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:31.493807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:31.493807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:31.493807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:31.493807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:31.493807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:31.493807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:31.493807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:31.493807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:31.493807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:31.494802 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:31.494802 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:31.494802 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:44:31.494802 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:44:31.494802 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:44:31.494802 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:44:31.494802 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:44:31.494802 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:44:31.494802 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:44:31.494802 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:31.498140 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 305/626] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 24 15:44:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:31.511541 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2c19a-d551-4330-b5fb-f016241223b6 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:31.541038 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:31.553585 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3836b0b-fd79-4e3b-91fc-bd9c8293eb72 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:31.593154 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d38fca-c48d-4ca4-ae9e-b416419561e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:31.593154 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d38fca-c48d-4ca4-ae9e-b416419561e7 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:31.593154 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d38fca-c48d-4ca4-ae9e-b416419561e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:31.593154 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d38fca-c48d-4ca4-ae9e-b416419561e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:31.601944 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d38fca-c48d-4ca4-ae9e-b416419561e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:31.603439 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d38fca-c48d-4ca4-ae9e-b416419561e7 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:31.615770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-71d38fca-c48d-4ca4-ae9e-b416419561e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:31.615770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:31.615770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:31.615770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:31.615770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:31.615770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:31.615770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:31.615770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:31.615770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:31.615770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:31.615770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:31.615770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:31.615770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:44:31.615770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:44:31.615770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:44:31.616784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:44:31.616784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:31.616784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:31.616784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:31.616784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:31.616784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:31.616784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:31.616784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:31.616784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:31.616784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:31.616784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:31.616784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:31.616784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:31.616784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:31.616784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:31.616784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:31.616784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:31.617641 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:44:31.617641 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:44:31.617641 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:44:31.617641 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:44:31.617641 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:44:31.617641 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:44:31.617641 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:31.617641 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:31.621590 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 322/627] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:44:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:31.622855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b19a9f-0e29-490e-8ca5-ee19a5ad7bd4 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:31.623147 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b19a9f-0e29-490e-8ca5-ee19a5ad7bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:31.623429 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b19a9f-0e29-490e-8ca5-ee19a5ad7bd4 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:31.625124 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 323/628] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:31.625488 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b19a9f-0e29-490e-8ca5-ee19a5ad7bd4 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:31.662780 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2c19a-d551-4330-b5fb-f016241223b6 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:31.698018 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:31.699520 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883aaa8-2daa-448c-bc88-d49a5e941149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:31.700132 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883aaa8-2daa-448c-bc88-d49a5e941149 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:31.700410 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883aaa8-2daa-448c-bc88-d49a5e941149 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:31.700714 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883aaa8-2daa-448c-bc88-d49a5e941149 None admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:31.701447 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883aaa8-2daa-448c-bc88-d49a5e941149 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:31.701757 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883aaa8-2daa-448c-bc88-d49a5e941149 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:31.703188 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883aaa8-2daa-448c-bc88-d49a5e941149 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:31.727538 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 306/629] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 24 15:44:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:31.727538 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883aaa8-2daa-448c-bc88-d49a5e941149 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:31.753802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b19a9f-0e29-490e-8ca5-ee19a5ad7bd4 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:31.795736 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99426eb2-8713-4182-827d-f68ce76b7166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:31.796377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99426eb2-8713-4182-827d-f68ce76b7166 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:31.796675 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99426eb2-8713-4182-827d-f68ce76b7166 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:31.796956 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99426eb2-8713-4182-827d-f68ce76b7166 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:31.804984 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:31.809875 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99426eb2-8713-4182-827d-f68ce76b7166 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:31.814794 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-99426eb2-8713-4182-827d-f68ce76b7166 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:31.814794 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:31.814794 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:31.814794 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:31.814794 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:31.814794 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:31.814794 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:31.814794 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:31.814794 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:31.814794 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:31.814794 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:31.814794 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:31.814794 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:31.814794 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:31.814794 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:31.814794 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:31.822868 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:31.822868 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:31.822868 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:31.822868 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:31.822868 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:31.822868 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:31.822868 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:31.822868 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:31.822868 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:31.822868 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:31.822868 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:31.822868 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:31.822868 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:31.822868 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:31.822868 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:31.822868 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:31.823914 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:31.823914 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:31.823914 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:31.823914 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:31.823914 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:31.823914 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:31.823914 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:31.823914 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:31.823914 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:31.823914 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:31.823914 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:31.823914 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:31.823914 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 324/630] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 24 15:44:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:31.823914 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f9a3c-7fd8-4ffd-96ef-343fab4bcc81 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:31.825683 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f9a3c-7fd8-4ffd-96ef-343fab4bcc81 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:31.825683 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f9a3c-7fd8-4ffd-96ef-343fab4bcc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:31.845242 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-868f9a3c-7fd8-4ffd-96ef-343fab4bcc81 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:31.845242 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-868f9a3c-7fd8-4ffd-96ef-343fab4bcc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:31.852776 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883aaa8-2daa-448c-bc88-d49a5e941149 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:31.894594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae8684-e70b-4b25-9a72-989e2839e6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:31.894594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae8684-e70b-4b25-9a72-989e2839e6e4 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:31.894594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae8684-e70b-4b25-9a72-989e2839e6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:31.894594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae8684-e70b-4b25-9a72-989e2839e6e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:31.895809 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae8684-e70b-4b25-9a72-989e2839e6e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:31.895809 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae8684-e70b-4b25-9a72-989e2839e6e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:31.895809 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae8684-e70b-4b25-9a72-989e2839e6e4 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:31.907040 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 307/631] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:44:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:31.908274 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae8684-e70b-4b25-9a72-989e2839e6e4 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:31.935647 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 325/632] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:31.936953 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f9a3c-7fd8-4ffd-96ef-343fab4bcc81 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:32.010402 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:32.035424 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae8684-e70b-4b25-9a72-989e2839e6e4 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:32.069094 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:32.069393 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f9a3c-7fd8-4ffd-96ef-343fab4bcc81 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:32.078918 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc832e-b349-41e2-a240-8f47f4873d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:32.079538 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc832e-b349-41e2-a240-8f47f4873d9f None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:32.079868 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc832e-b349-41e2-a240-8f47f4873d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:32.080348 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc832e-b349-41e2-a240-8f47f4873d9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:32.108729 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ae68e-07a3-4493-a05d-5ce8372807f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:32.109371 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ae68e-07a3-4493-a05d-5ce8372807f3 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:32.109719 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ae68e-07a3-4493-a05d-5ce8372807f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:32.110135 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ae68e-07a3-4493-a05d-5ce8372807f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:32.110805 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ae68e-07a3-4493-a05d-5ce8372807f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:32.111142 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ae68e-07a3-4493-a05d-5ce8372807f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:32.113428 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ae68e-07a3-4493-a05d-5ce8372807f3 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:32.124323 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 326/633] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 24 15:44:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:32.129675 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ae68e-07a3-4493-a05d-5ce8372807f3 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:32.165088 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc832e-b349-41e2-a240-8f47f4873d9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:32.167640 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc832e-b349-41e2-a240-8f47f4873d9f None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:32.243373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ae68e-07a3-4493-a05d-5ce8372807f3 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:32.257613 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:32.275527 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 308/634] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:44:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:32.277028 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829c29d-ef37-407f-9945-c64918c8ece1 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:32.280298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829c29d-ef37-407f-9945-c64918c8ece1 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:32.280298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829c29d-ef37-407f-9945-c64918c8ece1 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:32.280298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 309/635] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:32.280800 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829c29d-ef37-407f-9945-c64918c8ece1 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:32.285815 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aaf5ed-a003-479e-a7f0-5d09d84c21cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:32.286509 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aaf5ed-a003-479e-a7f0-5d09d84c21cc None admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:32.286790 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aaf5ed-a003-479e-a7f0-5d09d84c21cc None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:32.287066 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aaf5ed-a003-479e-a7f0-5d09d84c21cc None admin] PATH_INFO: `/v3/projects/9b25a7c01ab540ceae16dd618b848f2d/users/b3a0a84e4c4e47fc930881109fc07039/roles/a74cbb295dd8432985940aa21806f970` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:32.304574 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aaf5ed-a003-479e-a7f0-5d09d84c21cc None admin] RBAC: Authorizing `identity:create_grant(project_id=9b25a7c01ab540ceae16dd618b848f2d, user_id=b3a0a84e4c4e47fc930881109fc07039, role_id=a74cbb295dd8432985940aa21806f970)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:32.306078 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aaf5ed-a003-479e-a7f0-5d09d84c21cc None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:32.314816 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:32.380335 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 327/636] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 24 15:44:32 2022] PUT /identity/v3/projects/9b25a7c01ab540ceae16dd618b848f2d/users/b3a0a84e4c4e47fc930881109fc07039/roles/a74cbb295dd8432985940aa21806f970 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:44:32.381126 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aaf5ed-a003-479e-a7f0-5d09d84c21cc None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:32.392896 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829c29d-ef37-407f-9945-c64918c8ece1 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:32.438686 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0ed09-4f1f-4f6f-b304-a1c5be894715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:32.439333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0ed09-4f1f-4f6f-b304-a1c5be894715 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:32.439611 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0ed09-4f1f-4f6f-b304-a1c5be894715 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:32.439877 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0ed09-4f1f-4f6f-b304-a1c5be894715 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:32.451699 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0ed09-4f1f-4f6f-b304-a1c5be894715 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:32.453219 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0ed09-4f1f-4f6f-b304-a1c5be894715 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:32.469689 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-31c0ed09-4f1f-4f6f-b304-a1c5be894715 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:32.469689 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:32.469689 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:32.469689 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:32.469689 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:32.469689 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:32.469689 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:32.469689 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:32.469689 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:32.469689 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:32.469689 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:32.469689 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:32.469689 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:32.469689 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:32.469689 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:32.469689 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:32.470727 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:32.470727 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:32.470727 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:32.470727 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:32.470727 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:32.470727 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:32.470727 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:32.470727 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:32.470727 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:32.470727 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:32.470727 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:32.470727 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:32.470727 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:32.470727 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:32.470727 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:32.470727 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:32.470727 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:32.472195 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:32.472195 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:32.472195 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:32.472195 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 310/637] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:32.473161 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0ed09-4f1f-4f6f-b304-a1c5be894715 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:32.513563 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aaf5ed-a003-479e-a7f0-5d09d84c21cc None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:32.562279 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654d788-5564-4ef2-a1b3-966511ab6fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:32.563041 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654d788-5564-4ef2-a1b3-966511ab6fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:32.563322 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654d788-5564-4ef2-a1b3-966511ab6fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:32.564664 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654d788-5564-4ef2-a1b3-966511ab6fb0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:32.575126 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0654d788-5564-4ef2-a1b3-966511ab6fb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:32.580077 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-0654d788-5564-4ef2-a1b3-966511ab6fb0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:32.580077 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:32.580077 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:32.580077 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:32.580077 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:32.580077 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:32.580077 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:32.580077 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:32.580077 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:32.580077 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:32.580077 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:32.580077 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:32.580077 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:32.580077 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:32.580077 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:32.580077 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:32.581590 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:32.581590 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:32.581590 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:32.581590 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:32.581590 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:32.581590 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:32.581590 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:32.581590 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:32.581590 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:32.581590 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:32.581590 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:32.581590 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:32.581590 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:32.581590 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:32.581590 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:32.581590 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:32.582628 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:32.582628 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:32.582628 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:32.582628 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:32.582628 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:32.582628 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:32.582628 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:32.582628 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:32.582628 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:32.582628 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:32.582628 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:32.582628 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:32.583244 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:32.583318 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 328/638] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 24 15:44:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:32.584668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2d550-3658-43af-b27f-adf45448069e None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:32.584816 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2d550-3658-43af-b27f-adf45448069e None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:32.585253 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2d550-3658-43af-b27f-adf45448069e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:32.607596 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-a9e2d550-3658-43af-b27f-adf45448069e None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:32.608831 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-a9e2d550-3658-43af-b27f-adf45448069e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:32.608948 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0ed09-4f1f-4f6f-b304-a1c5be894715 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:32.636087 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:32.650811 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ea35e-37b3-46bf-bd79-c6f340d98e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:32.651443 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ea35e-37b3-46bf-bd79-c6f340d98e76 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:32.651711 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ea35e-37b3-46bf-bd79-c6f340d98e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:32.652011 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ea35e-37b3-46bf-bd79-c6f340d98e76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:32.664739 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ea35e-37b3-46bf-bd79-c6f340d98e76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:32.666237 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ea35e-37b3-46bf-bd79-c6f340d98e76 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:32.682644 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-e84ea35e-37b3-46bf-bd79-c6f340d98e76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:32.682644 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:32.682644 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:32.682644 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:32.682644 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:32.682644 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:32.682644 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:32.682644 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:32.682644 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:32.682644 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:32.682644 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:32.682644 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:32.682644 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:32.682644 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:32.682644 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:32.682644 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:32.683646 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:32.683646 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:32.683646 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:32.683646 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:32.683646 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:32.683646 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:32.683646 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:32.683646 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:32.683646 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:32.683646 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:32.683646 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:32.683646 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:32.683646 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:32.683646 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:32.683646 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:32.683646 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:32.683646 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:32.684511 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:32.684511 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:32.684511 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:32.684511 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 311/639] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:32.684788 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ea35e-37b3-46bf-bd79-c6f340d98e76 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:32.706204 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 329/640] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:32.707075 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2d550-3658-43af-b27f-adf45448069e None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:32.822838 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ea35e-37b3-46bf-bd79-c6f340d98e76 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:32.850634 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2d550-3658-43af-b27f-adf45448069e None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:32.866332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:32.873185 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3c2b7-de0c-4b50-8c7a-c1f455bf85ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:32.873814 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3c2b7-de0c-4b50-8c7a-c1f455bf85ba None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:32.874096 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3c2b7-de0c-4b50-8c7a-c1f455bf85ba None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:32.874370 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3c2b7-de0c-4b50-8c7a-c1f455bf85ba None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:32.875304 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3c2b7-de0c-4b50-8c7a-c1f455bf85ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:32.875713 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3c2b7-de0c-4b50-8c7a-c1f455bf85ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:32.877412 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3c2b7-de0c-4b50-8c7a-c1f455bf85ba None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:32.892534 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 312/641] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:32.894898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3c2b7-de0c-4b50-8c7a-c1f455bf85ba None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:32.895603 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f44162-638f-42c4-a08e-ad64ec581926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:32.896218 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f44162-638f-42c4-a08e-ad64ec581926 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:32.896501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f44162-638f-42c4-a08e-ad64ec581926 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:32.896856 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f44162-638f-42c4-a08e-ad64ec581926 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:32.897545 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f44162-638f-42c4-a08e-ad64ec581926 None admin] RBAC: Adding query filter params (name=service) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:32.897902 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f44162-638f-42c4-a08e-ad64ec581926 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:32.899376 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f44162-638f-42c4-a08e-ad64ec581926 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:32.913505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 330/642] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 24 15:44:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:32.914918 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f44162-638f-42c4-a08e-ad64ec581926 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:32.948228 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:33.013842 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3c2b7-de0c-4b50-8c7a-c1f455bf85ba None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:33.054848 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f44162-638f-42c4-a08e-ad64ec581926 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:33.056854 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088361b-6848-4857-b0fd-87af7185b356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:33.058323 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088361b-6848-4857-b0fd-87af7185b356 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:33.058669 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088361b-6848-4857-b0fd-87af7185b356 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:33.058942 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088361b-6848-4857-b0fd-87af7185b356 None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:33.059672 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088361b-6848-4857-b0fd-87af7185b356 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:33.059979 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088361b-6848-4857-b0fd-87af7185b356 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:33.061396 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088361b-6848-4857-b0fd-87af7185b356 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:33.079954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 313/643] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:33.081818 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088361b-6848-4857-b0fd-87af7185b356 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:33.092515 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1e6f1-e019-42d7-bac2-87237471cd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:33.093184 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1e6f1-e019-42d7-bac2-87237471cd8c None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:33.093469 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1e6f1-e019-42d7-bac2-87237471cd8c None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:33.093744 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1e6f1-e019-42d7-bac2-87237471cd8c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:33.103177 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1e6f1-e019-42d7-bac2-87237471cd8c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:33.104710 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1e6f1-e019-42d7-bac2-87237471cd8c None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:33.116659 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-3ef1e6f1-e019-42d7-bac2-87237471cd8c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 15:44:33.116659 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:33.116659 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:33.116659 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:33.116659 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:33.116659 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:33.116659 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:33.116659 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:33.116659 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:33.116659 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:33.116659 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:33.116659 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:33.116659 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:44:33.116659 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:44:33.116659 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:44:33.116659 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:44:33.118138 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:33.118138 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:33.118138 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:44:33.118138 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:33.118138 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:44:33.118138 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:33.118138 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:33.118138 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:33.118138 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:33.118138 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:33.118138 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:33.118138 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:33.118138 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:33.118138 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:33.118138 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:33.118138 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:33.118138 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:33.118138 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:33.119069 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:33.119069 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:33.119069 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:44:33.119069 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:44:33.119069 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:44:33.119069 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:44:33.119069 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:44:33.119069 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:44:33.119069 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 15:44:33.119069 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:33.119069 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 331/644] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:44:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:33.119069 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1e6f1-e019-42d7-bac2-87237471cd8c None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:33.147171 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:33.199075 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088361b-6848-4857-b0fd-87af7185b356 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:33.217876 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:33.240329 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50763265-a42a-4058-9601-9a383586459e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:33.241009 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50763265-a42a-4058-9601-9a383586459e None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:33.241293 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50763265-a42a-4058-9601-9a383586459e None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:33.241640 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50763265-a42a-4058-9601-9a383586459e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:33.247380 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1e6f1-e019-42d7-bac2-87237471cd8c None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:33.253731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50763265-a42a-4058-9601-9a383586459e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:33.255628 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50763265-a42a-4058-9601-9a383586459e None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:33.271048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-50763265-a42a-4058-9601-9a383586459e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:33.271048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:33.271048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:33.271048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:33.271048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:33.271048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:33.271048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:33.271048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:33.271048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:33.271048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:33.271048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:33.271048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:33.271048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:33.271048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:33.271048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:33.271048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:33.272043 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:33.272043 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:33.272043 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:33.272043 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:33.272043 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:33.272043 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:33.272043 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:33.272043 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:33.272043 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:33.272043 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:33.272043 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:33.272043 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:33.272043 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:33.272043 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:33.272043 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:33.272043 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:33.272043 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:33.278416 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:33.278416 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:33.278416 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:33.278416 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 314/645] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:33.278416 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50763265-a42a-4058-9601-9a383586459e None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:33.301352 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30798e0d-409b-4022-8b72-a2ed4006941a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:33.302306 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30798e0d-409b-4022-8b72-a2ed4006941a None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:33.302306 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30798e0d-409b-4022-8b72-a2ed4006941a None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:33.302568 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30798e0d-409b-4022-8b72-a2ed4006941a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:33.313645 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30798e0d-409b-4022-8b72-a2ed4006941a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:33.319526 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-30798e0d-409b-4022-8b72-a2ed4006941a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:33.319526 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:33.319526 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:33.319526 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:33.319526 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:33.319526 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:33.319526 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:33.319526 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:33.319526 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:33.319526 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:33.319526 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:33.319526 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:33.319526 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:33.319526 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:33.319526 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:33.319526 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:33.320512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:33.320512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:33.320512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:33.320512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:33.320512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:33.320512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:33.320512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:33.320512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:33.320512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:33.320512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:33.320512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:33.320512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:33.320512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:33.320512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:33.320512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:33.320512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:33.322090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:33.322090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:33.322090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:33.322090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:33.322090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:33.322090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:33.322090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:33.322090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:33.322090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:33.322090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:33.322090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:33.322090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:33.322090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 332/646] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 24 15:44:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:33.322090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30798e0d-409b-4022-8b72-a2ed4006941a None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:33.433179 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50763265-a42a-4058-9601-9a383586459e None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:33.435395 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:33.455294 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30798e0d-409b-4022-8b72-a2ed4006941a None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:33.476357 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1241bca-22da-40bd-af52-0981a931a150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:33.477008 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1241bca-22da-40bd-af52-0981a931a150 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:33.477289 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1241bca-22da-40bd-af52-0981a931a150 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:33.478008 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1241bca-22da-40bd-af52-0981a931a150 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:33.486296 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1241bca-22da-40bd-af52-0981a931a150 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:33.488941 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1241bca-22da-40bd-af52-0981a931a150 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:33.493802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb04924-7602-4906-a2f6-f9874dd99e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:33.494517 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb04924-7602-4906-a2f6-f9874dd99e65 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:33.494878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb04924-7602-4906-a2f6-f9874dd99e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:33.495303 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb04924-7602-4906-a2f6-f9874dd99e65 None admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:33.496318 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb04924-7602-4906-a2f6-f9874dd99e65 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:33.496652 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb04924-7602-4906-a2f6-f9874dd99e65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:33.498148 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb04924-7602-4906-a2f6-f9874dd99e65 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:33.501316 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-d1241bca-22da-40bd-af52-0981a931a150 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:33.501316 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:33.501316 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:33.501316 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:33.501316 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:33.501316 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:33.501316 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:33.501316 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:33.501316 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:33.501316 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:33.501316 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:33.501316 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:33.501316 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:44:33.501316 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:44:33.501316 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:44:33.502403 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:44:33.502403 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:33.502403 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:33.502403 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:33.502403 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:33.502403 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:33.502403 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:33.502403 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:33.502403 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:33.502403 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:33.502403 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:33.502403 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:33.502403 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:33.502403 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:33.502403 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:33.502403 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:33.502403 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:33.504189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:44:33.504189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:44:33.504189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:44:33.504189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:44:33.504189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:44:33.504189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:44:33.504189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:33.504189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:33.506827 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:33.506979 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 315/647] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:44:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:33.506979 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1241bca-22da-40bd-af52-0981a931a150 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:33.523778 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 333/648] 10.222.0.64 () {56 vars in 1137 bytes} [Wed Aug 24 15:44:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:33.524729 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb04924-7602-4906-a2f6-f9874dd99e65 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:33.631822 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1241bca-22da-40bd-af52-0981a931a150 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:33.649493 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb04924-7602-4906-a2f6-f9874dd99e65 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:33.677207 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4b401-81e1-4149-a8ca-3461c637c3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:33.678039 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4b401-81e1-4149-a8ca-3461c637c3ea None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:33.678439 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4b401-81e1-4149-a8ca-3461c637c3ea None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:33.678857 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4b401-81e1-4149-a8ca-3461c637c3ea None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:33.679718 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4b401-81e1-4149-a8ca-3461c637c3ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:33.680227 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4b401-81e1-4149-a8ca-3461c637c3ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:33.682032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4b401-81e1-4149-a8ca-3461c637c3ea None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:33.694215 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eafa6f-f77a-471f-9199-11e958036595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:33.694848 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eafa6f-f77a-471f-9199-11e958036595 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:33.695135 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eafa6f-f77a-471f-9199-11e958036595 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:33.695410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eafa6f-f77a-471f-9199-11e958036595 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:33.696091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eafa6f-f77a-471f-9199-11e958036595 None admin] RBAC: Adding query filter params (name=service) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:33.696421 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eafa6f-f77a-471f-9199-11e958036595 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:33.704259 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 316/649] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:33.704478 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eafa6f-f77a-471f-9199-11e958036595 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:33.704616 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4b401-81e1-4149-a8ca-3461c637c3ea None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:33.712601 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 334/650] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 24 15:44:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:33.718463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eafa6f-f77a-471f-9199-11e958036595 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:33.734148 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:33.789256 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:33.834009 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4b401-81e1-4149-a8ca-3461c637c3ea None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:33.839219 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eafa6f-f77a-471f-9199-11e958036595 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:33.876609 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0011af-2e40-4455-a9ff-45d937256bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:33.877508 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0011af-2e40-4455-a9ff-45d937256bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:33.877785 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0011af-2e40-4455-a9ff-45d937256bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:33.878056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0011af-2e40-4455-a9ff-45d937256bc8 None admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:33.878754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0011af-2e40-4455-a9ff-45d937256bc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:33.879054 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0011af-2e40-4455-a9ff-45d937256bc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:33.879925 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971a41d-d487-479a-a380-de6fa14cb23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:33.880482 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0011af-2e40-4455-a9ff-45d937256bc8 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:33.880902 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971a41d-d487-479a-a380-de6fa14cb23e None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:33.881358 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971a41d-d487-479a-a380-de6fa14cb23e None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:33.881810 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971a41d-d487-479a-a380-de6fa14cb23e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:33.898612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 317/651] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:44:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:33.898612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0011af-2e40-4455-a9ff-45d937256bc8 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:33.968219 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971a41d-d487-479a-a380-de6fa14cb23e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:33.969748 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971a41d-d487-479a-a380-de6fa14cb23e None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:33.999916 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:34.019703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0011af-2e40-4455-a9ff-45d937256bc8 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:34.036948 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:34.058662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2291e5-aaa7-4e66-ab8d-8d0de9cb5a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:34.059298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2291e5-aaa7-4e66-ab8d-8d0de9cb5a62 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:34.059572 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2291e5-aaa7-4e66-ab8d-8d0de9cb5a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:34.059846 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2291e5-aaa7-4e66-ab8d-8d0de9cb5a62 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:34.068161 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2291e5-aaa7-4e66-ab8d-8d0de9cb5a62 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:34.069675 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2291e5-aaa7-4e66-ab8d-8d0de9cb5a62 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:34.082998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-2d2291e5-aaa7-4e66-ab8d-8d0de9cb5a62 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 15:44:34.082998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:34.082998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:34.082998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:34.082998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:34.082998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:34.082998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:34.082998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:34.082998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:34.082998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:34.082998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:34.082998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:34.082998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:44:34.082998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:44:34.082998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:44:34.082998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:44:34.084020 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:34.084020 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:34.084020 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:44:34.084020 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:34.084020 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:44:34.084020 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:34.084020 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:34.084020 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:34.084020 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:34.084020 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:34.084020 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:34.084020 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:34.084020 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:34.084020 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:34.084020 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:34.084020 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:34.084020 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:34.084020 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:34.085041 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:34.085041 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:34.085041 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:44:34.085041 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:44:34.085041 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:44:34.085041 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:44:34.085041 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:44:34.085041 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:44:34.085041 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 15:44:34.085041 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:34.085041 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 318/652] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 24 15:44:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:34.085041 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2291e5-aaa7-4e66-ab8d-8d0de9cb5a62 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:34.114717 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 335/653] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:44:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:34.114717 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971a41d-d487-479a-a380-de6fa14cb23e None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:34.224140 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2291e5-aaa7-4e66-ab8d-8d0de9cb5a62 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:34.227584 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971a41d-d487-479a-a380-de6fa14cb23e None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:34.262582 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c9349-c768-49e3-8978-f3c95d39335c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:34.263246 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c9349-c768-49e3-8978-f3c95d39335c None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:34.263516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c9349-c768-49e3-8978-f3c95d39335c None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:34.263783 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c9349-c768-49e3-8978-f3c95d39335c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:34.269476 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cf095-047d-4113-8f24-a765934cbb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:34.270078 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cf095-047d-4113-8f24-a765934cbb0a None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:34.270355 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cf095-047d-4113-8f24-a765934cbb0a None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:34.270633 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cf095-047d-4113-8f24-a765934cbb0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:34.271860 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cf095-047d-4113-8f24-a765934cbb0a None admin] RBAC: Adding query filter params (role.id=a74cbb295dd8432985940aa21806f970, scope.project.id=9b25a7c01ab540ceae16dd618b848f2d, user.id=e5f0d8fe42e74d68bfa9a0e365bab4b6) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:34.272172 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cf095-047d-4113-8f24-a765934cbb0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:34.274037 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cf095-047d-4113-8f24-a765934cbb0a None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:34.275258 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c9349-c768-49e3-8978-f3c95d39335c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:34.276765 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c9349-c768-49e3-8978-f3c95d39335c None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:34.292660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 336/654] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:44:34 2022] GET /identity/v3/role_assignments?user.id=e5f0d8fe42e74d68bfa9a0e365bab4b6&scope.project.id=9b25a7c01ab540ceae16dd618b848f2d&role.id=a74cbb295dd8432985940aa21806f970 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:34.292660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cf095-047d-4113-8f24-a765934cbb0a None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:34.303047 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:34.317749 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-371c9349-c768-49e3-8978-f3c95d39335c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:34.317749 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:34.317749 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:34.317749 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:34.317749 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:34.317749 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:34.317749 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:34.317749 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:34.317749 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:34.317749 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:34.317749 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:34.317749 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:34.317749 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:34.317749 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:34.317749 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:34.317749 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:34.318782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:34.318782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:34.318782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:34.318782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:34.318782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:34.318782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:34.318782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:34.318782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:34.318782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:34.318782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:34.318782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:34.318782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:34.318782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:34.318782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:34.318782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:34.318782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:34.318782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:34.319673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:34.319673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:34.319673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:34.323983 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:34.324691 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 319/655] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:34.325691 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c9349-c768-49e3-8978-f3c95d39335c None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:34.426549 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cf095-047d-4113-8f24-a765934cbb0a None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:34.468547 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c9349-c768-49e3-8978-f3c95d39335c None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:34.476706 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428b945-a247-4ff9-a517-77b72cecd7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:34.477709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428b945-a247-4ff9-a517-77b72cecd7ae None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:34.478007 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428b945-a247-4ff9-a517-77b72cecd7ae None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:34.478285 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428b945-a247-4ff9-a517-77b72cecd7ae None admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:34.479063 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428b945-a247-4ff9-a517-77b72cecd7ae None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:34.479731 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428b945-a247-4ff9-a517-77b72cecd7ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:34.482323 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428b945-a247-4ff9-a517-77b72cecd7ae None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:34.504483 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 337/656] 10.222.0.64 () {56 vars in 1139 bytes} [Wed Aug 24 15:44:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:34.506301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428b945-a247-4ff9-a517-77b72cecd7ae None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:34.509195 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f818b-3186-4a1f-8083-e319c276fd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:34.509849 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f818b-3186-4a1f-8083-e319c276fd96 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:34.510129 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f818b-3186-4a1f-8083-e319c276fd96 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:34.510407 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f818b-3186-4a1f-8083-e319c276fd96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:34.523335 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f818b-3186-4a1f-8083-e319c276fd96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:34.524986 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f818b-3186-4a1f-8083-e319c276fd96 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:34.541408 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-c49f818b-3186-4a1f-8083-e319c276fd96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:34.541408 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:34.541408 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:34.541408 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:34.541408 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:34.541408 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:34.541408 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:34.541408 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:34.541408 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:34.541408 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:34.541408 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:34.541408 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:34.541408 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:34.541408 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:34.541408 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:34.541408 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:34.542446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:34.542446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:34.542446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:34.542446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:34.542446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:34.542446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:34.542446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:34.542446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:34.542446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:34.542446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:34.542446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:34.542446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:34.542446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:34.542446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:34.542446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:34.542446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:34.542446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:34.543577 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:34.543577 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:34.543577 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:34.543577 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 320/657] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:34.544203 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83604c40-cf43-4b5c-af42-adca9bd538ba None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:34.544304 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83604c40-cf43-4b5c-af42-adca9bd538ba None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:34.544560 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83604c40-cf43-4b5c-af42-adca9bd538ba None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:34.545942 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 321/658] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:34.546507 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83604c40-cf43-4b5c-af42-adca9bd538ba None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:34.617033 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:34.618723 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:34.648369 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428b945-a247-4ff9-a517-77b72cecd7ae None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:34.689078 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299c2c1-0d0c-4468-acd6-4a6a225d4176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:34.689295 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83604c40-cf43-4b5c-af42-adca9bd538ba None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:34.689692 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299c2c1-0d0c-4468-acd6-4a6a225d4176 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:34.690026 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299c2c1-0d0c-4468-acd6-4a6a225d4176 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:34.690297 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299c2c1-0d0c-4468-acd6-4a6a225d4176 None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:34.690951 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299c2c1-0d0c-4468-acd6-4a6a225d4176 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:34.691255 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299c2c1-0d0c-4468-acd6-4a6a225d4176 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:34.692662 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299c2c1-0d0c-4468-acd6-4a6a225d4176 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:34.712884 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 338/659] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:34.712884 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299c2c1-0d0c-4468-acd6-4a6a225d4176 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:34.743189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e233d8-1e42-4be5-a589-dd25b6631c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:34.743702 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e233d8-1e42-4be5-a589-dd25b6631c29 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:34.743973 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e233d8-1e42-4be5-a589-dd25b6631c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:34.744251 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e233d8-1e42-4be5-a589-dd25b6631c29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:34.828260 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e233d8-1e42-4be5-a589-dd25b6631c29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:34.829757 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e233d8-1e42-4be5-a589-dd25b6631c29 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:34.845414 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299c2c1-0d0c-4468-acd6-4a6a225d4176 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:34.883508 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:34.887093 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9fe80-fcc5-40be-a25f-a11259e08467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:34.887718 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9fe80-fcc5-40be-a25f-a11259e08467 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:34.888005 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9fe80-fcc5-40be-a25f-a11259e08467 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:34.888307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9fe80-fcc5-40be-a25f-a11259e08467 None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:34.889003 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9fe80-fcc5-40be-a25f-a11259e08467 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:34.889411 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9fe80-fcc5-40be-a25f-a11259e08467 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:34.891229 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9fe80-fcc5-40be-a25f-a11259e08467 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:34.900402 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:34.911187 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 339/660] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:34.911187 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9a3d8-0508-452b-8f11-7098f6aab742 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:34.911187 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9a3d8-0508-452b-8f11-7098f6aab742 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:34.911187 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9a3d8-0508-452b-8f11-7098f6aab742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:34.928066 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-98c9a3d8-0508-452b-8f11-7098f6aab742 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:34.929485 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-98c9a3d8-0508-452b-8f11-7098f6aab742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:34.965564 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 322/661] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:44:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:34.966260 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e233d8-1e42-4be5-a589-dd25b6631c29 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:35.012750 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 340/662] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:35.012750 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9a3d8-0508-452b-8f11-7098f6aab742 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:35.118749 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e233d8-1e42-4be5-a589-dd25b6631c29 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:35.147612 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9a3d8-0508-452b-8f11-7098f6aab742 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:35.170306 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d66e2-c6d1-4be2-ae3b-1bb4d01ac0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:35.170947 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d66e2-c6d1-4be2-ae3b-1bb4d01ac0af None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:35.171226 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d66e2-c6d1-4be2-ae3b-1bb4d01ac0af None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:35.171498 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d66e2-c6d1-4be2-ae3b-1bb4d01ac0af None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:35.179890 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d66e2-c6d1-4be2-ae3b-1bb4d01ac0af None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:35.181560 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d66e2-c6d1-4be2-ae3b-1bb4d01ac0af None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:35.186952 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:35.196002 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-081d66e2-c6d1-4be2-ae3b-1bb4d01ac0af None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 15:44:35.196002 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:35.196002 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:35.196002 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:35.196002 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:35.196002 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:35.196002 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:35.196002 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:35.196002 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:35.196002 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:35.196002 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:35.196002 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:35.196002 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:44:35.196002 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:44:35.196002 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:44:35.196002 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:44:35.204786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:35.204786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:35.204786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:44:35.204786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:35.204786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:44:35.204786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:35.204786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:35.204786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:35.204786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:35.204786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:35.204786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:35.204786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:35.204786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:35.204786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:35.204786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:35.204786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:35.204786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:35.204786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:35.206708 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:35.206708 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:35.206708 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:44:35.206708 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:44:35.206708 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:44:35.206708 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:44:35.206708 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:44:35.206708 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:44:35.206708 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 15:44:35.206708 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:35.207425 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d234e91-e6aa-4c30-9da5-dab0f819aa9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:35.207425 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d234e91-e6aa-4c30-9da5-dab0f819aa9d None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:35.207425 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d234e91-e6aa-4c30-9da5-dab0f819aa9d None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:35.207425 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d234e91-e6aa-4c30-9da5-dab0f819aa9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:35.207685 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 323/663] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:44:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:35.207685 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d66e2-c6d1-4be2-ae3b-1bb4d01ac0af None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:35.212035 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d234e91-e6aa-4c30-9da5-dab0f819aa9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:35.213795 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d234e91-e6aa-4c30-9da5-dab0f819aa9d None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:35.215812 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:35.230838 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-5d234e91-e6aa-4c30-9da5-dab0f819aa9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:35.230838 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:35.230838 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:35.230838 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:35.230838 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:35.230838 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:35.230838 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:35.230838 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:35.230838 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:35.230838 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:35.230838 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:35.230838 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:35.230838 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:44:35.230838 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:44:35.230838 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:44:35.232355 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:44:35.232355 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:35.232355 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:35.232355 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:35.232355 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:35.232355 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:35.232355 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:35.232355 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:35.232355 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:35.232355 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:35.232355 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:35.232355 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:35.232355 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:35.232355 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:35.232355 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:35.232355 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:35.232355 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:35.233480 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:44:35.233480 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:44:35.233480 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:44:35.233480 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:44:35.233480 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:44:35.233480 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:44:35.233480 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:35.233480 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:35.236070 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 341/664] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:44:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:35.238001 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d234e91-e6aa-4c30-9da5-dab0f819aa9d None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:35.327938 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d66e2-c6d1-4be2-ae3b-1bb4d01ac0af None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:35.373171 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771df99-8d08-4943-be53-bbecfb573e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:35.374055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771df99-8d08-4943-be53-bbecfb573e8e None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:35.374501 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771df99-8d08-4943-be53-bbecfb573e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:35.374931 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771df99-8d08-4943-be53-bbecfb573e8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:35.378310 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d234e91-e6aa-4c30-9da5-dab0f819aa9d None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:35.387204 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771df99-8d08-4943-be53-bbecfb573e8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:35.388699 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771df99-8d08-4943-be53-bbecfb573e8e None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:35.405640 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-d771df99-8d08-4943-be53-bbecfb573e8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:35.405640 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:35.405640 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:35.405640 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:35.405640 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:35.405640 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:35.405640 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:35.405640 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:35.405640 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:35.405640 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:35.405640 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:35.405640 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:35.405640 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:35.405640 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:35.405640 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:35.405640 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:35.406706 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:35.406706 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:35.406706 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:35.406706 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:35.406706 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:35.406706 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:35.406706 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:35.406706 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:35.406706 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:35.406706 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:35.406706 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:35.406706 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:35.406706 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:35.406706 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:35.406706 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:35.406706 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:35.406706 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:35.412689 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:35.412689 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:35.412689 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:35.412689 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 324/665] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:35.412689 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771df99-8d08-4943-be53-bbecfb573e8e None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:35.427606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39db327-0dcc-4295-9dc5-68af11f2bdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:35.428222 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39db327-0dcc-4295-9dc5-68af11f2bdfa None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:35.428506 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39db327-0dcc-4295-9dc5-68af11f2bdfa None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:35.428814 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39db327-0dcc-4295-9dc5-68af11f2bdfa None admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:35.429581 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39db327-0dcc-4295-9dc5-68af11f2bdfa None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:35.429895 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39db327-0dcc-4295-9dc5-68af11f2bdfa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:35.431343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39db327-0dcc-4295-9dc5-68af11f2bdfa None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:35.456890 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 342/666] 10.222.0.64 () {56 vars in 1137 bytes} [Wed Aug 24 15:44:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:35.456890 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39db327-0dcc-4295-9dc5-68af11f2bdfa None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:35.490885 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:35.509408 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:35.543863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771df99-8d08-4943-be53-bbecfb573e8e None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:35.572440 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39db327-0dcc-4295-9dc5-68af11f2bdfa None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:35.583268 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718f517-e823-4f6b-b98a-ba9ff185aac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:35.583913 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718f517-e823-4f6b-b98a-ba9ff185aac1 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:35.584201 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718f517-e823-4f6b-b98a-ba9ff185aac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:35.584478 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718f517-e823-4f6b-b98a-ba9ff185aac1 None admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:35.585235 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718f517-e823-4f6b-b98a-ba9ff185aac1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:35.585541 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718f517-e823-4f6b-b98a-ba9ff185aac1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:35.586974 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718f517-e823-4f6b-b98a-ba9ff185aac1 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:35.603623 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 325/667] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:44:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:35.603623 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718f517-e823-4f6b-b98a-ba9ff185aac1 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:35.619459 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354ecc5-a251-4b65-8332-1e3a955062f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:35.620231 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354ecc5-a251-4b65-8332-1e3a955062f3 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:35.620579 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354ecc5-a251-4b65-8332-1e3a955062f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:35.620999 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354ecc5-a251-4b65-8332-1e3a955062f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:35.633799 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a354ecc5-a251-4b65-8332-1e3a955062f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:35.640363 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-a354ecc5-a251-4b65-8332-1e3a955062f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:35.640363 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:35.640363 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:35.640363 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:35.640363 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:35.640363 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:35.640363 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:35.640363 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:35.640363 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:35.640363 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:35.640363 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:35.640363 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:35.640363 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:35.640363 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:35.640363 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:35.640363 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:35.641453 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:35.641453 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:35.641453 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:35.641453 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:35.641453 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:35.641453 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:35.641453 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:35.641453 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:35.641453 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:35.641453 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:35.641453 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:35.641453 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:35.641453 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:35.641453 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:35.641453 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:35.641453 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:35.642276 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:35.642276 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:35.642276 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:35.642276 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:35.642276 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:35.642276 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:35.642276 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:35.642276 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:35.642276 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:35.642276 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:35.642276 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:35.642276 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:35.642276 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 343/668] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 24 15:44:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:35.643577 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354ecc5-a251-4b65-8332-1e3a955062f3 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:35.726211 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718f517-e823-4f6b-b98a-ba9ff185aac1 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:35.748090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:35.765545 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354ecc5-a251-4b65-8332-1e3a955062f3 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:35.771750 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483417b-da19-44b4-9c8a-d9533a34586a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:35.772462 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483417b-da19-44b4-9c8a-d9533a34586a None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:35.772829 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483417b-da19-44b4-9c8a-d9533a34586a None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:35.773271 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483417b-da19-44b4-9c8a-d9533a34586a None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:35.774013 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483417b-da19-44b4-9c8a-d9533a34586a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:35.774387 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483417b-da19-44b4-9c8a-d9533a34586a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:35.775609 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:35.776915 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483417b-da19-44b4-9c8a-d9533a34586a None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:35.793014 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 326/669] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:35.793961 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483417b-da19-44b4-9c8a-d9533a34586a None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:35.810859 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c33cb1-e338-4c20-9a5f-242bccb30590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:35.811481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c33cb1-e338-4c20-9a5f-242bccb30590 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:35.811761 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c33cb1-e338-4c20-9a5f-242bccb30590 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:35.812354 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c33cb1-e338-4c20-9a5f-242bccb30590 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:35.906354 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c33cb1-e338-4c20-9a5f-242bccb30590 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:35.907734 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c33cb1-e338-4c20-9a5f-242bccb30590 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:35.917038 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483417b-da19-44b4-9c8a-d9533a34586a None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:35.954280 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d3909-23a2-42b0-bc7d-f0db5727e675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:35.954980 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d3909-23a2-42b0-bc7d-f0db5727e675 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:35.955325 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d3909-23a2-42b0-bc7d-f0db5727e675 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:35.955325 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d3909-23a2-42b0-bc7d-f0db5727e675 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:35.957353 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d3909-23a2-42b0-bc7d-f0db5727e675 None admin] RBAC: Adding query filter params (role.id=a74cbb295dd8432985940aa21806f970, scope.project.id=9b25a7c01ab540ceae16dd618b848f2d, user.id=f21fda517a384dc5a6a9f36d68ac1a2d) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:35.957728 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d3909-23a2-42b0-bc7d-f0db5727e675 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:35.959258 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d3909-23a2-42b0-bc7d-f0db5727e675 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:35.967106 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 327/670] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:44:35 2022] GET /identity/v3/role_assignments?user.id=f21fda517a384dc5a6a9f36d68ac1a2d&scope.project.id=9b25a7c01ab540ceae16dd618b848f2d&role.id=a74cbb295dd8432985940aa21806f970 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:35.967794 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d3909-23a2-42b0-bc7d-f0db5727e675 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:36.040346 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:36.058942 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 344/671] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:44:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:36.060062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c33cb1-e338-4c20-9a5f-242bccb30590 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:36.076537 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:36.121582 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d3909-23a2-42b0-bc7d-f0db5727e675 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:36.170469 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1560a5-d199-48d7-9c79-f39d5f44036a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:36.171322 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1560a5-d199-48d7-9c79-f39d5f44036a None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:36.171772 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1560a5-d199-48d7-9c79-f39d5f44036a None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:36.172207 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1560a5-d199-48d7-9c79-f39d5f44036a None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:36.173318 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1560a5-d199-48d7-9c79-f39d5f44036a None admin] RBAC: Adding query filter params (name=service) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:36.173632 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1560a5-d199-48d7-9c79-f39d5f44036a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:36.175647 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1560a5-d199-48d7-9c79-f39d5f44036a None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:36.195560 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 328/672] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 24 15:44:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:36.196688 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1560a5-d199-48d7-9c79-f39d5f44036a None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:36.227907 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c33cb1-e338-4c20-9a5f-242bccb30590 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:36.271849 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539abe0-88da-4329-8de5-82ae1c2d79fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:36.272676 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539abe0-88da-4329-8de5-82ae1c2d79fa None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:36.273061 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539abe0-88da-4329-8de5-82ae1c2d79fa None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:36.273441 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539abe0-88da-4329-8de5-82ae1c2d79fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:36.284726 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539abe0-88da-4329-8de5-82ae1c2d79fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:36.286346 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539abe0-88da-4329-8de5-82ae1c2d79fa None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:36.302570 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-d539abe0-88da-4329-8de5-82ae1c2d79fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:36.302570 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:36.302570 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:36.302570 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:36.302570 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:36.302570 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:36.302570 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:36.302570 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:36.302570 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:36.302570 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:36.302570 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:36.302570 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:36.302570 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:44:36.302570 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:44:36.302570 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:44:36.303417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:44:36.303417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:36.303417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:36.303417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:36.303417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:36.303417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:36.303417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:36.303417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:36.303417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:36.303417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:36.303417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:36.303417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:36.303417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:36.303417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:36.303417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:36.303417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:36.303417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:36.304381 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:44:36.304381 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:44:36.304381 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:44:36.304381 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:44:36.304381 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:44:36.304381 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:44:36.304381 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:36.304381 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:36.304381 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 345/673] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:44:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:36.305483 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539abe0-88da-4329-8de5-82ae1c2d79fa None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:36.341129 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1560a5-d199-48d7-9c79-f39d5f44036a None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:36.345073 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:36.400591 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287591eb-7c24-47e4-8750-dbaced2a3f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:36.401425 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287591eb-7c24-47e4-8750-dbaced2a3f63 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:36.401731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287591eb-7c24-47e4-8750-dbaced2a3f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:36.402005 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287591eb-7c24-47e4-8750-dbaced2a3f63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:36.405849 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:36.414168 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287591eb-7c24-47e4-8750-dbaced2a3f63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:36.419136 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287591eb-7c24-47e4-8750-dbaced2a3f63 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:36.438033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-287591eb-7c24-47e4-8750-dbaced2a3f63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:36.438033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:36.438033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:36.438033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:36.438033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:36.438033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:36.438033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:36.438033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:36.438033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:36.438033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:36.438033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:36.438033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:36.438033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:36.438033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:36.438033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:36.438033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:36.439030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:36.439030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:36.439030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:36.439030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:36.439030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:36.439030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:36.439030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:36.439030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:36.439030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:36.439030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:36.439030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:36.439030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:36.439030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:36.439030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:36.439030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:36.439030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:36.439030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:36.440022 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:36.440022 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:36.440022 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:36.440022 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 329/674] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:36.441487 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287591eb-7c24-47e4-8750-dbaced2a3f63 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:36.467952 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539abe0-88da-4329-8de5-82ae1c2d79fa None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:36.508878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e815ea-6984-486e-822a-388dc1bb6cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:36.509572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e815ea-6984-486e-822a-388dc1bb6cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:36.509857 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e815ea-6984-486e-822a-388dc1bb6cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:36.510132 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e815ea-6984-486e-822a-388dc1bb6cf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:36.521435 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e815ea-6984-486e-822a-388dc1bb6cf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:36.522992 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e815ea-6984-486e-822a-388dc1bb6cf1 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:36.539487 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-65e815ea-6984-486e-822a-388dc1bb6cf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:36.539487 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:36.539487 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:36.539487 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:36.539487 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:36.539487 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:36.539487 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:36.539487 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:36.539487 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:36.539487 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:36.539487 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:36.539487 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:36.539487 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:36.539487 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:36.539487 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:36.539487 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:36.540490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:36.540490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:36.540490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:36.540490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:36.540490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:36.540490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:36.540490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:36.540490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:36.540490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:36.540490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:36.540490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:36.540490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:36.540490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:36.540490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:36.540490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:36.540490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:36.540490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:36.541419 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:36.541419 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:36.541419 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:36.541419 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 346/675] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:36.542315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34665763-5661-42da-9d4d-ae127991ad94 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:36.542761 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34665763-5661-42da-9d4d-ae127991ad94 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:36.543056 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34665763-5661-42da-9d4d-ae127991ad94 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:36.544558 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 347/676] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:36.545217 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34665763-5661-42da-9d4d-ae127991ad94 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:36.579859 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287591eb-7c24-47e4-8750-dbaced2a3f63 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:36.619300 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de68ad9-a315-4069-9442-81d911f5e2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:36.620199 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de68ad9-a315-4069-9442-81d911f5e2fc None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:36.620655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de68ad9-a315-4069-9442-81d911f5e2fc None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:36.620929 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de68ad9-a315-4069-9442-81d911f5e2fc None admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:36.621627 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de68ad9-a315-4069-9442-81d911f5e2fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:36.621929 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de68ad9-a315-4069-9442-81d911f5e2fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:36.623355 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de68ad9-a315-4069-9442-81d911f5e2fc None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:36.637074 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 330/677] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:44:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:36.637928 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de68ad9-a315-4069-9442-81d911f5e2fc None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:36.662902 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:36.672143 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34665763-5661-42da-9d4d-ae127991ad94 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:36.693840 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:36.712360 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b2a1e-3b3e-428b-a43e-602b78d188d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:36.713005 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b2a1e-3b3e-428b-a43e-602b78d188d4 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:36.716330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b2a1e-3b3e-428b-a43e-602b78d188d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:36.716330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b2a1e-3b3e-428b-a43e-602b78d188d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:36.716330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b2a1e-3b3e-428b-a43e-602b78d188d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:36.716330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b2a1e-3b3e-428b-a43e-602b78d188d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:36.716330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b2a1e-3b3e-428b-a43e-602b78d188d4 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:36.735855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 348/678] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:36.735855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6a03d-7c8b-4496-8f5b-90432c1f6c1e None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:36.735855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6a03d-7c8b-4496-8f5b-90432c1f6c1e None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:36.735855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6a03d-7c8b-4496-8f5b-90432c1f6c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:36.753032 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-cde6a03d-7c8b-4496-8f5b-90432c1f6c1e None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:36.754238 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-cde6a03d-7c8b-4496-8f5b-90432c1f6c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:36.756924 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de68ad9-a315-4069-9442-81d911f5e2fc None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:36.800764 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682773b-c1d5-49f7-a06a-b58071fc3ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:36.801444 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682773b-c1d5-49f7-a06a-b58071fc3ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:36.801755 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682773b-c1d5-49f7-a06a-b58071fc3ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:36.802081 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682773b-c1d5-49f7-a06a-b58071fc3ca0 None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:36.802729 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682773b-c1d5-49f7-a06a-b58071fc3ca0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:36.803054 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682773b-c1d5-49f7-a06a-b58071fc3ca0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:36.804445 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682773b-c1d5-49f7-a06a-b58071fc3ca0 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:36.823905 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 331/679] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:36.825239 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682773b-c1d5-49f7-a06a-b58071fc3ca0 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:36.841803 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 349/680] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:36.844434 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6a03d-7c8b-4496-8f5b-90432c1f6c1e None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:36.927828 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:36.952352 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682773b-c1d5-49f7-a06a-b58071fc3ca0 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:36.963765 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6a03d-7c8b-4496-8f5b-90432c1f6c1e None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:36.976219 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:36.996388 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0872d-41a5-4ee2-b082-7359dc3e443f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:36.997274 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0872d-41a5-4ee2-b082-7359dc3e443f None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:36.997727 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0872d-41a5-4ee2-b082-7359dc3e443f None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:36.998152 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0872d-41a5-4ee2-b082-7359dc3e443f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:36.999048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0872d-41a5-4ee2-b082-7359dc3e443f None admin] RBAC: Adding query filter params (role.id=a74cbb295dd8432985940aa21806f970, scope.project.id=9b25a7c01ab540ceae16dd618b848f2d, user.id=80f7e6f1af76404096d4c717cbcf20f3) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:36.999507 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0872d-41a5-4ee2-b082-7359dc3e443f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:37.001193 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0872d-41a5-4ee2-b082-7359dc3e443f None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:37.007092 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b2985-a1e7-46b4-ba96-f2026afb83a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:37.007853 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b2985-a1e7-46b4-ba96-f2026afb83a9 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:37.008135 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b2985-a1e7-46b4-ba96-f2026afb83a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:37.008406 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b2985-a1e7-46b4-ba96-f2026afb83a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:37.009015 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 332/681] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:44:36 2022] GET /identity/v3/role_assignments?user.id=80f7e6f1af76404096d4c717cbcf20f3&scope.project.id=9b25a7c01ab540ceae16dd618b848f2d&role.id=a74cbb295dd8432985940aa21806f970 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:37.010126 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0872d-41a5-4ee2-b082-7359dc3e443f None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:37.034671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b2985-a1e7-46b4-ba96-f2026afb83a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:37.036539 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b2985-a1e7-46b4-ba96-f2026afb83a9 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:37.068001 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-810b2985-a1e7-46b4-ba96-f2026afb83a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:37.068001 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:37.068001 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:37.068001 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:37.068001 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:37.068001 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:37.068001 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:37.068001 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:37.068001 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:37.068001 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:37.068001 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:37.068001 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:37.068001 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:44:37.068001 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:44:37.068001 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:44:37.069210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:44:37.069210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:37.069210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:37.069210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:37.069210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:37.069210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:37.069210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:37.069210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:37.069210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:37.069210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:37.069210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:37.069210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:37.069210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:37.069210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:37.069210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:37.069210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:37.069210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:37.070263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:44:37.070263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:44:37.070263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:44:37.070263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:44:37.070263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:44:37.070263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:44:37.070263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:37.070263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:37.072143 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 350/682] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:44:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:37.077749 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b2985-a1e7-46b4-ba96-f2026afb83a9 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:37.209415 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0872d-41a5-4ee2-b082-7359dc3e443f None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:37.249436 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b2985-a1e7-46b4-ba96-f2026afb83a9 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:37.269880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa191e-2193-47eb-8109-db5ee452fe50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:37.269880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa191e-2193-47eb-8109-db5ee452fe50 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:37.269880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa191e-2193-47eb-8109-db5ee452fe50 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:37.269880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa191e-2193-47eb-8109-db5ee452fe50 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:37.280003 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa191e-2193-47eb-8109-db5ee452fe50 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:37.280003 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa191e-2193-47eb-8109-db5ee452fe50 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:37.291844 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:37.307716 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-e4fa191e-2193-47eb-8109-db5ee452fe50 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 15:44:37.307716 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:37.307716 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:37.307716 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:37.307716 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:37.307716 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:37.307716 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:37.307716 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:37.307716 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:37.307716 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:37.307716 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:37.307716 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:37.307716 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:44:37.307716 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:44:37.307716 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:44:37.307716 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:44:37.314754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:37.314754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:37.314754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:44:37.314754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:37.314754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:44:37.314754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:37.314754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:37.314754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:37.314754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:37.314754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:37.314754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:37.314754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:37.314754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:37.314754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:37.314754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:37.314754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:37.314754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:37.314754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:37.315695 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:37.315695 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:37.315695 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:44:37.315695 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:44:37.315695 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:44:37.315695 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:44:37.315695 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:44:37.315695 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:44:37.315695 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 15:44:37.315695 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:37.315695 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 333/683] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:44:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:37.315695 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa191e-2193-47eb-8109-db5ee452fe50 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:37.319665 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40adc485-ed69-4630-bdd3-0e3022c659f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:37.320883 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40adc485-ed69-4630-bdd3-0e3022c659f3 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:37.321332 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40adc485-ed69-4630-bdd3-0e3022c659f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:37.321757 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40adc485-ed69-4630-bdd3-0e3022c659f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:37.322616 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40adc485-ed69-4630-bdd3-0e3022c659f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:37.323091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40adc485-ed69-4630-bdd3-0e3022c659f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:37.324737 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40adc485-ed69-4630-bdd3-0e3022c659f3 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:37.340181 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 351/684] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:44:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:44:37.341308 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40adc485-ed69-4630-bdd3-0e3022c659f3 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:37.381472 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:37.446938 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa191e-2193-47eb-8109-db5ee452fe50 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:37.472580 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40adc485-ed69-4630-bdd3-0e3022c659f3 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:37.489965 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b91f09-9027-4eae-a244-b6c312c62390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:37.491132 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b91f09-9027-4eae-a244-b6c312c62390 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:37.491560 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b91f09-9027-4eae-a244-b6c312c62390 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:37.492158 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b91f09-9027-4eae-a244-b6c312c62390 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:37.507695 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b91f09-9027-4eae-a244-b6c312c62390 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:37.512113 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a78d75-a459-454c-82fa-ae63f446040a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:37.512772 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a78d75-a459-454c-82fa-ae63f446040a None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:37.513056 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a78d75-a459-454c-82fa-ae63f446040a None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:37.513328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a78d75-a459-454c-82fa-ae63f446040a None admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:37.514074 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a78d75-a459-454c-82fa-ae63f446040a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:37.514386 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a78d75-a459-454c-82fa-ae63f446040a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:37.514505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-07b91f09-9027-4eae-a244-b6c312c62390 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:44:37.514505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:37.514505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:37.514505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:37.514505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:37.514505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:37.514505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:37.514505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:37.514505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:37.514505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:37.514505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:37.514505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:37.514505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:37.514505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:37.514505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:37.514505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:37.515580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:37.515580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:37.515580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:37.515580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:37.515580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:37.515580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:37.515580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:37.515580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:37.515580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:37.515580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:37.515580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:37.515580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:37.515580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:37.515580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:37.515580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:37.515580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:37.516513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:37.516513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:37.516513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:37.516513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:37.516513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:37.516513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:37.516513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:37.516513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:37.516513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:37.516513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:37.516513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:44:37.516513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:37.517198 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a78d75-a459-454c-82fa-ae63f446040a None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:37.520444 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 334/685] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:44:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:37.521574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b91f09-9027-4eae-a244-b6c312c62390 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:37.542117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 352/686] 10.222.0.64 () {56 vars in 1135 bytes} [Wed Aug 24 15:44:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:37.542117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a78d75-a459-454c-82fa-ae63f446040a None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:37.617069 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:37.647542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:37.660282 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b91f09-9027-4eae-a244-b6c312c62390 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:37.672475 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a78d75-a459-454c-82fa-ae63f446040a None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:37.705006 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13415f-4587-44b3-9dfc-52f3fef34def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:37.706441 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13415f-4587-44b3-9dfc-52f3fef34def None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:37.707133 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13415f-4587-44b3-9dfc-52f3fef34def None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:37.707554 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13415f-4587-44b3-9dfc-52f3fef34def None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:37.708641 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c13415f-4587-44b3-9dfc-52f3fef34def None admin] RBAC: Adding query filter params (role.id=a74cbb295dd8432985940aa21806f970, scope.project.id=9b25a7c01ab540ceae16dd618b848f2d, user.id=89d937fedccb484a8a494cd686361fac) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:37.709417 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c13415f-4587-44b3-9dfc-52f3fef34def None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:37.711359 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c13415f-4587-44b3-9dfc-52f3fef34def None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:37.714664 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab7aa3-3e19-4d09-986b-774286f40f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:37.715475 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab7aa3-3e19-4d09-986b-774286f40f59 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:37.715856 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab7aa3-3e19-4d09-986b-774286f40f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:37.716228 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab7aa3-3e19-4d09-986b-774286f40f59 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:37.717117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab7aa3-3e19-4d09-986b-774286f40f59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:37.717523 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab7aa3-3e19-4d09-986b-774286f40f59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:37.719300 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab7aa3-3e19-4d09-986b-774286f40f59 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:37.719700 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 335/687] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:44:37 2022] GET /identity/v3/role_assignments?user.id=89d937fedccb484a8a494cd686361fac&scope.project.id=9b25a7c01ab540ceae16dd618b848f2d&role.id=a74cbb295dd8432985940aa21806f970 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:37.720731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13415f-4587-44b3-9dfc-52f3fef34def None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:37.744913 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 353/688] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:44:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:37.750860 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab7aa3-3e19-4d09-986b-774286f40f59 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:37.918341 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab7aa3-3e19-4d09-986b-774286f40f59 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:37.963702 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13415f-4587-44b3-9dfc-52f3fef34def None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:37.966275 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d8c09-46cd-4d64-bdbf-5bb9bb4bc732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:37.967150 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d8c09-46cd-4d64-bdbf-5bb9bb4bc732 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:37.967993 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d8c09-46cd-4d64-bdbf-5bb9bb4bc732 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:37.968473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d8c09-46cd-4d64-bdbf-5bb9bb4bc732 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:37.988282 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d8c09-46cd-4d64-bdbf-5bb9bb4bc732 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:37.990365 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d8c09-46cd-4d64-bdbf-5bb9bb4bc732 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:37.990805 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:38.002882 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:38.006089 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ab972-adc9-4a39-9af4-6b8ba1bd2f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:38.006711 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ab972-adc9-4a39-9af4-6b8ba1bd2f4b None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:38.006990 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ab972-adc9-4a39-9af4-6b8ba1bd2f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:38.007260 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ab972-adc9-4a39-9af4-6b8ba1bd2f4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:38.011343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-070d8c09-46cd-4d64-bdbf-5bb9bb4bc732 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:38.011343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:38.011343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:38.011343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:38.011343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:38.011343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:38.011343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:38.011343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:38.011343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:38.011343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:38.011343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:38.011343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:38.011343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:38.011343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:38.011343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:38.011343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:38.012298 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:38.012298 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:38.012298 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:38.012298 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:38.012298 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:38.012298 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:38.012298 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:38.012298 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:38.012298 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:38.012298 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:38.012298 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:38.012298 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:38.012298 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:38.012298 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:38.012298 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:38.012298 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:38.012298 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:38.013795 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:38.013795 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:38.013795 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:38.015778 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 354/689] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:38.023182 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d8c09-46cd-4d64-bdbf-5bb9bb4bc732 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:38.099652 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ab972-adc9-4a39-9af4-6b8ba1bd2f4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:38.101688 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ab972-adc9-4a39-9af4-6b8ba1bd2f4b None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:38.173242 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d8c09-46cd-4d64-bdbf-5bb9bb4bc732 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:38.229424 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eabdeb-e1b7-462a-853e-e9b020dd93ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:38.230056 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eabdeb-e1b7-462a-853e-e9b020dd93ea None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:38.230593 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eabdeb-e1b7-462a-853e-e9b020dd93ea None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:38.230870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eabdeb-e1b7-462a-853e-e9b020dd93ea None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:38.232130 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eabdeb-e1b7-462a-853e-e9b020dd93ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:38.232588 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eabdeb-e1b7-462a-853e-e9b020dd93ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:38.234696 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eabdeb-e1b7-462a-853e-e9b020dd93ea None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:38.241846 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 336/690] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:44:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:38.243141 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf58b8-6861-45e3-94e2-03c56cb8fbc8 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:38.243428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf58b8-6861-45e3-94e2-03c56cb8fbc8 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:38.243702 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf58b8-6861-45e3-94e2-03c56cb8fbc8 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:38.249924 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 337/691] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:38.250752 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf58b8-6861-45e3-94e2-03c56cb8fbc8 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:38.255220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 355/692] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:44:38.262364 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe1df5-b647-4d1d-881f-bfeeb5ab7d00 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:38.263274 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe1df5-b647-4d1d-881f-bfeeb5ab7d00 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:38.263559 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe1df5-b647-4d1d-881f-bfeeb5ab7d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:38.287584 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:38.292173 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-17fe1df5-b647-4d1d-881f-bfeeb5ab7d00 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:38.293835 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-17fe1df5-b647-4d1d-881f-bfeeb5ab7d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:38.372069 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:38.390772 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 356/693] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:38.390772 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe1df5-b647-4d1d-881f-bfeeb5ab7d00 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:38.555070 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe1df5-b647-4d1d-881f-bfeeb5ab7d00 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:38.600804 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef073cb-cdd6-40d1-9ace-69b51238b769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:38.601613 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef073cb-cdd6-40d1-9ace-69b51238b769 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:38.601894 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef073cb-cdd6-40d1-9ace-69b51238b769 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:38.602165 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef073cb-cdd6-40d1-9ace-69b51238b769 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:38.610814 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef073cb-cdd6-40d1-9ace-69b51238b769 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:38.612436 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef073cb-cdd6-40d1-9ace-69b51238b769 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:38.626373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-4ef073cb-cdd6-40d1-9ace-69b51238b769 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:44:38.626373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:38.626373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:38.626373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:38.626373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:38.626373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:38.626373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:38.626373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:38.626373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:38.626373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:38.626373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:38.626373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:38.626373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:44:38.626373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:44:38.626373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:44:38.626373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:44:38.627669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:38.627669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:38.627669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:44:38.627669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:38.627669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:44:38.627669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:38.627669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:38.627669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:38.627669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:38.627669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:38.627669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:38.627669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:38.627669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:38.627669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:38.627669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:38.627669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:38.627669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:38.627669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:38.629132 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:38.629132 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:38.629132 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:44:38.629132 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:44:38.629132 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:44:38.629132 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:44:38.629132 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:44:38.629132 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:44:38.629132 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:44:38.629132 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:38.629132 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 357/694] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 24 15:44:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:38.638197 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef073cb-cdd6-40d1-9ace-69b51238b769 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:38.649740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf58b8-6861-45e3-94e2-03c56cb8fbc8 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:38.719489 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce904dd6-50ac-4414-996c-350ccd246236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:38.720236 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce904dd6-50ac-4414-996c-350ccd246236 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:38.720587 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce904dd6-50ac-4414-996c-350ccd246236 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:38.721057 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce904dd6-50ac-4414-996c-350ccd246236 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:38.728316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:38.734722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce904dd6-50ac-4414-996c-350ccd246236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:38.736294 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce904dd6-50ac-4414-996c-350ccd246236 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:38.756499 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-ce904dd6-50ac-4414-996c-350ccd246236 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:38.756499 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:38.756499 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:38.756499 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:38.756499 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:38.756499 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:38.756499 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:38.756499 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:38.756499 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:38.756499 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:38.756499 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:38.756499 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:38.756499 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:38.756499 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:38.756499 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:38.756499 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:38.757548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:38.757548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:38.757548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:38.757548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:38.757548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:38.757548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:38.757548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:38.757548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:38.757548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:38.757548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:38.757548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:38.757548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:38.757548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:38.757548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:38.757548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:38.757548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:38.757548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:38.758472 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:38.758472 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:38.758472 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:38.758472 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 338/695] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 508 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:38.759193 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce904dd6-50ac-4414-996c-350ccd246236 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:38.791620 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef073cb-cdd6-40d1-9ace-69b51238b769 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:38.828173 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d9eaa-cd2e-4f77-8af3-edb95c12002c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:38.828725 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d9eaa-cd2e-4f77-8af3-edb95c12002c None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:38.829010 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d9eaa-cd2e-4f77-8af3-edb95c12002c None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:38.829282 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d9eaa-cd2e-4f77-8af3-edb95c12002c None admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:38.830023 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d9eaa-cd2e-4f77-8af3-edb95c12002c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:38.830869 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d9eaa-cd2e-4f77-8af3-edb95c12002c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:38.836694 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d9eaa-cd2e-4f77-8af3-edb95c12002c None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:38.861105 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 358/696] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 24 15:44:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:38.862847 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d9eaa-cd2e-4f77-8af3-edb95c12002c None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:38.866883 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:38.890641 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce904dd6-50ac-4414-996c-350ccd246236 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:38.927906 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aadca1-36ed-45d8-af81-80e5f65e723f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:38.928667 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aadca1-36ed-45d8-af81-80e5f65e723f None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:38.929031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aadca1-36ed-45d8-af81-80e5f65e723f None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:38.929380 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aadca1-36ed-45d8-af81-80e5f65e723f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:38.940887 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aadca1-36ed-45d8-af81-80e5f65e723f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:38.942459 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aadca1-36ed-45d8-af81-80e5f65e723f None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:38.958449 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-d0aadca1-36ed-45d8-af81-80e5f65e723f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:38.958449 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:38.958449 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:38.958449 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:38.958449 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:38.958449 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:38.958449 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:38.958449 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:38.958449 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:38.958449 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:38.958449 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:38.958449 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:38.958449 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:38.958449 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:38.958449 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:38.958449 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:38.959398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:38.959398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:38.959398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:38.959398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:38.959398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:38.959398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:38.959398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:38.959398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:38.959398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:38.959398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:38.959398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:38.959398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:38.959398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:38.959398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:38.959398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:38.959398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:38.959398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:38.960263 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:38.960263 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:38.960263 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:38.964357 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 339/697] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:38.965720 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aadca1-36ed-45d8-af81-80e5f65e723f None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:38.984806 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d9eaa-cd2e-4f77-8af3-edb95c12002c None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:38.996984 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:39.027167 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ba23e-b915-4e04-bba6-7b9b48fdb5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:39.028094 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ba23e-b915-4e04-bba6-7b9b48fdb5d6 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:39.028711 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ba23e-b915-4e04-bba6-7b9b48fdb5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:39.030833 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ba23e-b915-4e04-bba6-7b9b48fdb5d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:39.030833 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ba23e-b915-4e04-bba6-7b9b48fdb5d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:39.030833 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ba23e-b915-4e04-bba6-7b9b48fdb5d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:39.032351 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ba23e-b915-4e04-bba6-7b9b48fdb5d6 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:39.045967 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 359/698] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:39.047455 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ba23e-b915-4e04-bba6-7b9b48fdb5d6 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:39.079548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aadca1-36ed-45d8-af81-80e5f65e723f None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:39.109258 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:39.118904 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167255e-888a-4d2c-8b9c-73b7d5ef9bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:39.119536 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167255e-888a-4d2c-8b9c-73b7d5ef9bf4 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:39.119815 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167255e-888a-4d2c-8b9c-73b7d5ef9bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:39.120092 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167255e-888a-4d2c-8b9c-73b7d5ef9bf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:39.180763 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ba23e-b915-4e04-bba6-7b9b48fdb5d6 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:39.206020 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167255e-888a-4d2c-8b9c-73b7d5ef9bf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:39.210156 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167255e-888a-4d2c-8b9c-73b7d5ef9bf4 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:39.225989 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241fa57-1580-4104-a163-c36f840b0a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:39.226911 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241fa57-1580-4104-a163-c36f840b0a79 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:39.227357 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241fa57-1580-4104-a163-c36f840b0a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:39.227633 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241fa57-1580-4104-a163-c36f840b0a79 None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:39.228289 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c241fa57-1580-4104-a163-c36f840b0a79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:39.228592 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c241fa57-1580-4104-a163-c36f840b0a79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:39.230242 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c241fa57-1580-4104-a163-c36f840b0a79 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:39.249927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 360/699] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:39.250947 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241fa57-1580-4104-a163-c36f840b0a79 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:39.295747 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:39.349933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 340/700] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:44:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:39.349933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba07d72-7c93-43d0-a3b2-6109127d07b8 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:39.349933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba07d72-7c93-43d0-a3b2-6109127d07b8 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:39.349933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba07d72-7c93-43d0-a3b2-6109127d07b8 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:39.349933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 341/701] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:39.349933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba07d72-7c93-43d0-a3b2-6109127d07b8 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:39.388883 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:39.401943 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241fa57-1580-4104-a163-c36f840b0a79 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:39.448319 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9916b-c58d-4eb9-8133-2c47f3b89c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:39.448998 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9916b-c58d-4eb9-8133-2c47f3b89c79 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:39.449277 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9916b-c58d-4eb9-8133-2c47f3b89c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:39.449546 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9916b-c58d-4eb9-8133-2c47f3b89c79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:39.458904 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9916b-c58d-4eb9-8133-2c47f3b89c79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:39.460392 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9916b-c58d-4eb9-8133-2c47f3b89c79 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:39.478852 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba07d72-7c93-43d0-a3b2-6109127d07b8 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:39.479151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-67a9916b-c58d-4eb9-8133-2c47f3b89c79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:39.479151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:39.479151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:39.479151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:39.479151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:39.479151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:39.479151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:39.479151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:39.479151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:39.479151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:39.479151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:39.479151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:39.479151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:44:39.479151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:44:39.479151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:44:39.480218 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:44:39.480218 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:39.480218 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:39.480218 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:39.480218 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:39.480218 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:39.480218 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:39.480218 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:39.480218 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:39.480218 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:39.480218 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:39.480218 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:39.480218 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:39.480218 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:39.480218 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:39.480218 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:39.480218 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:39.481169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:44:39.481169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:44:39.481169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:44:39.481169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:44:39.481169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:44:39.481169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:44:39.481169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:39.481169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:39.481169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 361/702] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:44:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:39.481639 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9916b-c58d-4eb9-8133-2c47f3b89c79 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:39.546764 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32446edc-3d63-4c5a-a353-4156205b1695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:39.547376 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32446edc-3d63-4c5a-a353-4156205b1695 None admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:39.547655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32446edc-3d63-4c5a-a353-4156205b1695 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:39.547925 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32446edc-3d63-4c5a-a353-4156205b1695 None admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:39.548560 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32446edc-3d63-4c5a-a353-4156205b1695 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:39.551289 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32446edc-3d63-4c5a-a353-4156205b1695 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:39.595482 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:39.608774 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9916b-c58d-4eb9-8133-2c47f3b89c79 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:39.645106 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3134d0-5eb6-430a-ba11-fcd19eb82850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:39.645754 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3134d0-5eb6-430a-ba11-fcd19eb82850 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:39.656079 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3134d0-5eb6-430a-ba11-fcd19eb82850 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:39.656079 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3134d0-5eb6-430a-ba11-fcd19eb82850 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:39.656352 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 342/703] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 24 15:44:39 2022] POST /identity/v3/users => generated 254 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:44:39.656352 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8761aa2-3a75-437e-ab2f-1e94dd86645d None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:39.656352 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8761aa2-3a75-437e-ab2f-1e94dd86645d None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:39.656352 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8761aa2-3a75-437e-ab2f-1e94dd86645d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:39.675820 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3134d0-5eb6-430a-ba11-fcd19eb82850 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:39.677460 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3134d0-5eb6-430a-ba11-fcd19eb82850 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:39.686372 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-d8761aa2-3a75-437e-ab2f-1e94dd86645d None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:39.688062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-d8761aa2-3a75-437e-ab2f-1e94dd86645d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:39.697646 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-2f3134d0-5eb6-430a-ba11-fcd19eb82850 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:39.697646 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:39.697646 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:39.697646 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:39.697646 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:39.697646 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:39.697646 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:39.697646 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:39.697646 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:39.697646 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:39.697646 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:39.697646 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:39.697646 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:39.697646 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:39.697646 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:39.697646 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:39.698668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:39.698668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:39.698668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:39.698668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:39.698668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:39.698668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:39.698668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:39.698668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:39.698668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:39.698668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:39.698668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:39.698668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:39.698668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:39.698668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:39.698668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:39.698668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:39.698668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:39.699575 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:39.699575 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:39.699575 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:39.703997 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 362/704] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:39.705437 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3134d0-5eb6-430a-ba11-fcd19eb82850 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:39.790374 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 343/705] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:39.791869 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8761aa2-3a75-437e-ab2f-1e94dd86645d None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:39.809666 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:39.831543 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3134d0-5eb6-430a-ba11-fcd19eb82850 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:39.871884 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b793f00-bd0b-4f29-813d-ba792bda2af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:39.872731 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b793f00-bd0b-4f29-813d-ba792bda2af6 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:39.872846 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b793f00-bd0b-4f29-813d-ba792bda2af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:39.873064 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b793f00-bd0b-4f29-813d-ba792bda2af6 None admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:39.873773 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b793f00-bd0b-4f29-813d-ba792bda2af6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:39.874080 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b793f00-bd0b-4f29-813d-ba792bda2af6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:39.875547 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b793f00-bd0b-4f29-813d-ba792bda2af6 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:39.886519 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:39.894887 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 363/706] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:44:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:39.898591 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b793f00-bd0b-4f29-813d-ba792bda2af6 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:39.943922 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8761aa2-3a75-437e-ab2f-1e94dd86645d None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:39.999035 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226a194-3233-463c-ae55-55cd8a42425a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:39.999936 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226a194-3233-463c-ae55-55cd8a42425a None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:40.000352 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226a194-3233-463c-ae55-55cd8a42425a None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:40.001571 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226a194-3233-463c-ae55-55cd8a42425a None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:40.003166 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226a194-3233-463c-ae55-55cd8a42425a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:40.003629 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226a194-3233-463c-ae55-55cd8a42425a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:40.006192 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226a194-3233-463c-ae55-55cd8a42425a None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:40.028648 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 344/707] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:40.031773 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226a194-3233-463c-ae55-55cd8a42425a None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:40.078460 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b793f00-bd0b-4f29-813d-ba792bda2af6 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:40.125380 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b599ed-a0c5-458e-9b04-279e13e18e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:40.125912 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b599ed-a0c5-458e-9b04-279e13e18e42 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:40.126187 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b599ed-a0c5-458e-9b04-279e13e18e42 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:40.126509 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b599ed-a0c5-458e-9b04-279e13e18e42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:40.127940 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b599ed-a0c5-458e-9b04-279e13e18e42 None admin] RBAC: Adding query filter params (role.id=a74cbb295dd8432985940aa21806f970, scope.project.id=9b25a7c01ab540ceae16dd618b848f2d, user.id=b3a0a84e4c4e47fc930881109fc07039) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:40.128542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b599ed-a0c5-458e-9b04-279e13e18e42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:40.130283 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b599ed-a0c5-458e-9b04-279e13e18e42 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:40.132036 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:40.142034 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 364/708] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:44:39 2022] GET /identity/v3/role_assignments?user.id=b3a0a84e4c4e47fc930881109fc07039&scope.project.id=9b25a7c01ab540ceae16dd618b848f2d&role.id=a74cbb295dd8432985940aa21806f970 => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:44:40.149281 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a77057-8f33-41a4-aa9a-5d85283dd5e2 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:40.149657 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a77057-8f33-41a4-aa9a-5d85283dd5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:40.150011 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a77057-8f33-41a4-aa9a-5d85283dd5e2 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:40.151820 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 365/709] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:40.159926 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6564bce-146e-4003-b162-360bba6aa427 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:40.160335 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6564bce-146e-4003-b162-360bba6aa427 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:40.160824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6564bce-146e-4003-b162-360bba6aa427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:40.178879 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226a194-3233-463c-ae55-55cd8a42425a None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:40.185759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-b6564bce-146e-4003-b162-360bba6aa427 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:40.187023 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-b6564bce-146e-4003-b162-360bba6aa427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:40.241758 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c5c11-dd35-4b12-aa61-4a8d4f5dd06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:40.242416 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c5c11-dd35-4b12-aa61-4a8d4f5dd06c None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:40.242698 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c5c11-dd35-4b12-aa61-4a8d4f5dd06c None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:40.242971 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c5c11-dd35-4b12-aa61-4a8d4f5dd06c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:40.256295 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c5c11-dd35-4b12-aa61-4a8d4f5dd06c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:40.256735 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c5c11-dd35-4b12-aa61-4a8d4f5dd06c None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:40.271678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-ed3c5c11-dd35-4b12-aa61-4a8d4f5dd06c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:40.271678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:40.271678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:40.271678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:40.271678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:40.271678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:40.271678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:40.271678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:40.271678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:40.271678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:40.271678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:40.271678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:40.271678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:44:40.271678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:44:40.271678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:44:40.272651 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:44:40.272651 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:40.272651 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:40.272651 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:40.272651 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:40.272651 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:40.272651 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:40.272651 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:40.272651 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:40.272651 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:40.272651 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:40.272651 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:40.272651 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:40.272651 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:40.272651 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:40.272651 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:40.272651 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:40.273539 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:44:40.273539 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:44:40.273539 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:44:40.273539 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:44:40.273539 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:44:40.273539 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:44:40.273539 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:40.273539 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:40.273539 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 345/710] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:44:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:40.274100 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c5c11-dd35-4b12-aa61-4a8d4f5dd06c None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:40.308415 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:40.321415 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 366/711] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:40.330057 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6564bce-146e-4003-b162-360bba6aa427 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:40.390140 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c5c11-dd35-4b12-aa61-4a8d4f5dd06c None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:40.433392 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c748dd-8c6f-4f84-9b7f-defdbc9c3a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:40.434046 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c748dd-8c6f-4f84-9b7f-defdbc9c3a16 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:40.434325 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c748dd-8c6f-4f84-9b7f-defdbc9c3a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:40.434596 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c748dd-8c6f-4f84-9b7f-defdbc9c3a16 None admin] PATH_INFO: `/v3/services/network` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:40.435181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c748dd-8c6f-4f84-9b7f-defdbc9c3a16 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:40.436558 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c748dd-8c6f-4f84-9b7f-defdbc9c3a16 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:40.438795 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:40.456095 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6564bce-146e-4003-b162-360bba6aa427 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:40.458934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-a1c748dd-8c6f-4f84-9b7f-defdbc9c3a16 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 15:44:40.458934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:40.458934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:44:40.458934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:44:40.458934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:44:40.458934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:44:40.458934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:44:40.458934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:44:40.458934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 15:44:40.458934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:40.458934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:44:40.458934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:40.458934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:40.458934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:40.458934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:40.458934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:40.458934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:40.459952 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:40.459952 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:40.459952 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:40.459952 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:40.459952 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:40.459952 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:40.459952 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:44:40.459952 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:44:40.459952 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:44:40.459952 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:44:40.459952 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:40.459952 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:40.459952 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:40.459952 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:40.459952 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:40.459952 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:40.461428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:40.461428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:40.461428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:40.461428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:40.461428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:40.461428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:40.461428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:40.461428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:40.461428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:40.461428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:40.461428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:44:40.461428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:44:40.461428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 15:44:40.461428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:40.461428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 346/712] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:44:40 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:40.465645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c748dd-8c6f-4f84-9b7f-defdbc9c3a16 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:40.506354 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bb29f-12cc-4f23-9137-8dcb1acc6723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:40.506982 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bb29f-12cc-4f23-9137-8dcb1acc6723 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:40.507250 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bb29f-12cc-4f23-9137-8dcb1acc6723 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:40.507524 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bb29f-12cc-4f23-9137-8dcb1acc6723 None admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:40.508230 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516bb29f-12cc-4f23-9137-8dcb1acc6723 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:40.508522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516bb29f-12cc-4f23-9137-8dcb1acc6723 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:40.510039 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516bb29f-12cc-4f23-9137-8dcb1acc6723 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:40.529014 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 367/713] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:44:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:40.530963 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bb29f-12cc-4f23-9137-8dcb1acc6723 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:40.592895 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:40.602607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c748dd-8c6f-4f84-9b7f-defdbc9c3a16 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:40.651077 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee96788f-ee5f-4c71-8b9d-b608dc5558ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:40.651619 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96788f-ee5f-4c71-8b9d-b608dc5558ff None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:40.651896 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96788f-ee5f-4c71-8b9d-b608dc5558ff None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:40.652171 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96788f-ee5f-4c71-8b9d-b608dc5558ff None admin] PATH_INFO: `/v3/services` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:40.652854 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee96788f-ee5f-4c71-8b9d-b608dc5558ff None admin] RBAC: Adding query filter params (name=network) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:40.653142 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee96788f-ee5f-4c71-8b9d-b608dc5558ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:40.654793 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee96788f-ee5f-4c71-8b9d-b608dc5558ff None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:40.661452 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 347/714] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 24 15:44:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:40.662287 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bb29f-12cc-4f23-9137-8dcb1acc6723 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:40.662419 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee96788f-ee5f-4c71-8b9d-b608dc5558ff None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:40.708759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526c8a4-0624-4f4d-bdce-a351c473ce7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:40.709816 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526c8a4-0624-4f4d-bdce-a351c473ce7e None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:40.710365 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526c8a4-0624-4f4d-bdce-a351c473ce7e None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:40.710865 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526c8a4-0624-4f4d-bdce-a351c473ce7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:40.711847 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2526c8a4-0624-4f4d-bdce-a351c473ce7e None admin] RBAC: Adding query filter params (role.id=c6745e08f9da4a2bae8510c9983635c3, scope.project.id=9b25a7c01ab540ceae16dd618b848f2d, user.id=e5f0d8fe42e74d68bfa9a0e365bab4b6) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:40.712374 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2526c8a4-0624-4f4d-bdce-a351c473ce7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:40.714207 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2526c8a4-0624-4f4d-bdce-a351c473ce7e None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:40.723301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 368/715] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:44:40 2022] GET /identity/v3/role_assignments?user.id=e5f0d8fe42e74d68bfa9a0e365bab4b6&scope.project.id=9b25a7c01ab540ceae16dd618b848f2d&role.id=c6745e08f9da4a2bae8510c9983635c3 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:40.724651 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526c8a4-0624-4f4d-bdce-a351c473ce7e None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:40.753780 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:40.822611 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee96788f-ee5f-4c71-8b9d-b608dc5558ff None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:40.872982 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9268277-8a7e-4da5-b9e9-7516065b2569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:40.874071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9268277-8a7e-4da5-b9e9-7516065b2569 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:40.874561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9268277-8a7e-4da5-b9e9-7516065b2569 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:40.875368 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9268277-8a7e-4da5-b9e9-7516065b2569 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:40.877553 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9268277-8a7e-4da5-b9e9-7516065b2569 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:40.879254 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9268277-8a7e-4da5-b9e9-7516065b2569 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:40.897023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-d9268277-8a7e-4da5-b9e9-7516065b2569 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 15:44:40.897023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:40.897023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:44:40.897023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:44:40.897023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:44:40.897023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:44:40.897023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:44:40.897023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:44:40.897023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 15:44:40.897023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:40.897023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:44:40.897023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:40.897023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:40.897023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:40.897023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:40.897023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:40.897023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:40.898081 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:40.898081 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:40.898081 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:40.898081 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:40.898081 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:40.898081 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:40.898081 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:44:40.898081 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:44:40.898081 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:44:40.898081 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:44:40.898081 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:40.898081 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:40.898081 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:40.898081 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:40.898081 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:40.898081 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:40.898912 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:40.898912 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:40.898912 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:40.898912 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:40.898912 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:40.898912 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:40.898912 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:40.898912 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:40.898912 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:40.898912 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:40.898912 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:44:40.898912 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:44:40.898912 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 15:44:40.898912 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:40.906447 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 348/716] 10.222.0.64 () {56 vars in 1129 bytes} [Wed Aug 24 15:44:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:40.917707 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9268277-8a7e-4da5-b9e9-7516065b2569 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:40.964288 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526c8a4-0624-4f4d-bdce-a351c473ce7e None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:40.987754 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:41.013562 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52886bc8-aaf7-4958-8673-43c80969bbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:41.014584 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52886bc8-aaf7-4958-8673-43c80969bbd6 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:41.015037 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52886bc8-aaf7-4958-8673-43c80969bbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:41.015477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52886bc8-aaf7-4958-8673-43c80969bbd6 None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:41.016303 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52886bc8-aaf7-4958-8673-43c80969bbd6 None admin] RBAC: Adding query filter params (type=network) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:41.016811 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52886bc8-aaf7-4958-8673-43c80969bbd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:41.018941 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52886bc8-aaf7-4958-8673-43c80969bbd6 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:41.026385 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 369/717] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 24 15:44:40 2022] GET /identity/v3/services?type=network => generated 124 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:41.072146 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9268277-8a7e-4da5-b9e9-7516065b2569 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:41.104190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:41.113681 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86febcd3-2ca7-4c6a-8e16-e00444c5cd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:41.114344 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86febcd3-2ca7-4c6a-8e16-e00444c5cd6f None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:41.114625 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86febcd3-2ca7-4c6a-8e16-e00444c5cd6f None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:41.114898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86febcd3-2ca7-4c6a-8e16-e00444c5cd6f None admin] PATH_INFO: `/v3/services` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:41.115830 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86febcd3-2ca7-4c6a-8e16-e00444c5cd6f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:41.116136 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86febcd3-2ca7-4c6a-8e16-e00444c5cd6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:41.117586 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86febcd3-2ca7-4c6a-8e16-e00444c5cd6f None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:41.123265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 349/718] 10.222.0.64 () {56 vars in 1124 bytes} [Wed Aug 24 15:44:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:41.128936 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52886bc8-aaf7-4958-8673-43c80969bbd6 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:41.290944 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52886bc8-aaf7-4958-8673-43c80969bbd6 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:41.327627 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c84d6-ea99-4cc0-8aaa-da77de1d51e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:41.328334 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c84d6-ea99-4cc0-8aaa-da77de1d51e6 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:41.328614 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c84d6-ea99-4cc0-8aaa-da77de1d51e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:41.328910 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c84d6-ea99-4cc0-8aaa-da77de1d51e6 None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:41.329560 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c84d6-ea99-4cc0-8aaa-da77de1d51e6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:41.329864 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c84d6-ea99-4cc0-8aaa-da77de1d51e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:41.332027 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c84d6-ea99-4cc0-8aaa-da77de1d51e6 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:41.339037 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 370/719] 10.222.0.64 () {56 vars in 1124 bytes} [Wed Aug 24 15:44:41 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:42.336653 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5509389-6a18-4b16-8023-b38271a4c9c2 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:42.337631 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5509389-6a18-4b16-8023-b38271a4c9c2 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:42.338140 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5509389-6a18-4b16-8023-b38271a4c9c2 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:42.339697 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 350/720] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:42.346435 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1b6a8-cedd-432e-81df-7f66a606e1fb None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:42.346933 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1b6a8-cedd-432e-81df-7f66a606e1fb None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:42.347414 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1b6a8-cedd-432e-81df-7f66a606e1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:42.372254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-7fb1b6a8-cedd-432e-81df-7f66a606e1fb None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:42.373908 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-7fb1b6a8-cedd-432e-81df-7f66a606e1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:42.437522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:42.463278 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 371/721] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:42.797837 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5509389-6a18-4b16-8023-b38271a4c9c2 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:42.904660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6960ff6-1d37-4d67-a49c-f530d7388870 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:42.904660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6960ff6-1d37-4d67-a49c-f530d7388870 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:42.904660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6960ff6-1d37-4d67-a49c-f530d7388870 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:42.906413 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 372/722] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:42.913866 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826f489-5a17-4a0e-97f1-5e6dc3b5d0ce None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:42.914293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826f489-5a17-4a0e-97f1-5e6dc3b5d0ce None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:42.914665 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826f489-5a17-4a0e-97f1-5e6dc3b5d0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:42.938911 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5509389-6a18-4b16-8023-b38271a4c9c2 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:42.944529 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-a826f489-5a17-4a0e-97f1-5e6dc3b5d0ce None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:42.945750 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-a826f489-5a17-4a0e-97f1-5e6dc3b5d0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:43.025789 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d3eca-39da-4a3e-83c6-7af433200146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:43.026440 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d3eca-39da-4a3e-83c6-7af433200146 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:43.026714 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d3eca-39da-4a3e-83c6-7af433200146 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:43.026981 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d3eca-39da-4a3e-83c6-7af433200146 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:43.049698 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d3eca-39da-4a3e-83c6-7af433200146 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:43.054833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-383d3eca-39da-4a3e-83c6-7af433200146 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:43.054833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:43.054833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:43.054833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:43.054833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:43.054833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:43.054833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:43.054833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:43.054833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:43.054833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:43.054833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:43.054833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:43.054833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:43.054833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:43.054833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:43.054833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:43.056741 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:43.056741 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:43.056741 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:43.056741 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:43.056741 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:43.056741 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:43.056741 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:43.056741 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:43.056741 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:43.056741 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:43.056741 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:43.056741 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:43.056741 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:43.056741 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:43.056741 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:43.056741 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:43.057769 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:43.057769 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:43.057769 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:43.057769 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:43.057769 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:43.057769 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:43.057769 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:43.057769 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:43.057769 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:43.057769 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:43.057769 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:43.057769 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:43.057769 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 351/723] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 24 15:44:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:43.069704 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d3eca-39da-4a3e-83c6-7af433200146 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:43.081054 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 373/724] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:43.140245 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:43.208004 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d3eca-39da-4a3e-83c6-7af433200146 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:43.247004 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38958b-6fd6-460f-9ab3-5a5332d75995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:43.247864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38958b-6fd6-460f-9ab3-5a5332d75995 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:43.248295 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38958b-6fd6-460f-9ab3-5a5332d75995 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:43.248761 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38958b-6fd6-460f-9ab3-5a5332d75995 None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:43.249583 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38958b-6fd6-460f-9ab3-5a5332d75995 None admin] RBAC: Adding query filter params (name=service) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:43.250094 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38958b-6fd6-460f-9ab3-5a5332d75995 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:43.251740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38958b-6fd6-460f-9ab3-5a5332d75995 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:43.261507 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 352/725] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 24 15:44:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:43.268667 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826f489-5a17-4a0e-97f1-5e6dc3b5d0ce None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:43.401434 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38958b-6fd6-460f-9ab3-5a5332d75995 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:43.448479 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826f489-5a17-4a0e-97f1-5e6dc3b5d0ce None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:43.469037 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:43.493412 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beab882-2d44-41c5-81d4-48afc315de57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:43.494421 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beab882-2d44-41c5-81d4-48afc315de57 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:43.495034 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beab882-2d44-41c5-81d4-48afc315de57 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:43.495543 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beab882-2d44-41c5-81d4-48afc315de57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:43.510126 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beab882-2d44-41c5-81d4-48afc315de57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:43.512404 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beab882-2d44-41c5-81d4-48afc315de57 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:43.530656 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-2beab882-2d44-41c5-81d4-48afc315de57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:43.530656 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:43.530656 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:43.530656 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:43.530656 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:43.530656 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:43.530656 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:43.530656 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:43.530656 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:43.530656 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:43.530656 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:43.530656 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:43.530656 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:43.530656 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:43.530656 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:43.530656 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:43.531748 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:43.531748 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:43.531748 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:43.531748 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:43.531748 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:43.531748 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:43.531748 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:43.531748 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:43.531748 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:43.531748 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:43.531748 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:43.531748 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:43.531748 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:43.531748 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:43.531748 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:43.531748 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:43.531748 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:43.532645 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:43.532645 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:43.532645 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:43.534932 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 374/726] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:43.536613 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7ecc0-17c9-4acb-bfd7-414ef6c04710 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:43.537214 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7ecc0-17c9-4acb-bfd7-414ef6c04710 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:43.537692 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7ecc0-17c9-4acb-bfd7-414ef6c04710 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:43.543609 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 375/727] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:43.544855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7ecc0-17c9-4acb-bfd7-414ef6c04710 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:43.553658 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38958b-6fd6-460f-9ab3-5a5332d75995 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:43.577081 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:43.608930 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef67b4a-a7be-43c2-aef7-43eb1ccbc0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:43.609994 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef67b4a-a7be-43c2-aef7-43eb1ccbc0bf None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:43.610288 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef67b4a-a7be-43c2-aef7-43eb1ccbc0bf None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:43.610565 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef67b4a-a7be-43c2-aef7-43eb1ccbc0bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:43.623214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef67b4a-a7be-43c2-aef7-43eb1ccbc0bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:43.630051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-5ef67b4a-a7be-43c2-aef7-43eb1ccbc0bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:44:43.630051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:43.630051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:43.630051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:43.630051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:43.630051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:43.630051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:43.630051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:43.630051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:43.630051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:43.630051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:43.630051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:43.630051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:43.630051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:43.630051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:43.630051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:43.631046 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:43.631046 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:43.631046 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:43.631046 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:43.631046 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:43.631046 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:43.631046 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:43.631046 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:43.631046 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:43.631046 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:43.631046 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:43.631046 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:43.631046 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:43.631046 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:43.631046 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:43.631046 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:43.631868 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:43.631868 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:43.631868 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:43.631868 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:43.631868 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:43.631868 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:43.631868 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:43.631868 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:43.631868 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:43.631868 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:43.631868 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:44:43.631868 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:43.631868 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 353/728] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:44:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:43.633096 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f39cac-8013-45f6-9b91-f579d5e066a8 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:43.633096 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f39cac-8013-45f6-9b91-f579d5e066a8 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:43.633265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f39cac-8013-45f6-9b91-f579d5e066a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:43.657734 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-53f39cac-8013-45f6-9b91-f579d5e066a8 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:43.659315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-53f39cac-8013-45f6-9b91-f579d5e066a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:43.684424 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7ecc0-17c9-4acb-bfd7-414ef6c04710 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:43.725527 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0dca8a-3520-4484-8141-cb62f1c482fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:43.726148 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0dca8a-3520-4484-8141-cb62f1c482fe None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:43.726427 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0dca8a-3520-4484-8141-cb62f1c482fe None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:43.726699 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0dca8a-3520-4484-8141-cb62f1c482fe None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:43.727356 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0dca8a-3520-4484-8141-cb62f1c482fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:43.727661 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0dca8a-3520-4484-8141-cb62f1c482fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:43.729084 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0dca8a-3520-4484-8141-cb62f1c482fe None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:43.736846 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 354/729] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:43.736846 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f39cac-8013-45f6-9b91-f579d5e066a8 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:43.748367 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 376/730] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:43.750006 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b31cd-4dec-4258-9a54-accbb8d7551e None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:43.750424 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b31cd-4dec-4258-9a54-accbb8d7551e None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:43.750862 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b31cd-4dec-4258-9a54-accbb8d7551e None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:43.753144 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 377/731] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:43.757820 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b31cd-4dec-4258-9a54-accbb8d7551e None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:43.779180 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:43.874292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b31cd-4dec-4258-9a54-accbb8d7551e None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:43.898822 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f39cac-8013-45f6-9b91-f579d5e066a8 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:43.900836 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:43.912455 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b53982-53b5-4328-bc20-a8715f127f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:43.913137 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b53982-53b5-4328-bc20-a8715f127f7a None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:43.913423 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b53982-53b5-4328-bc20-a8715f127f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:43.913697 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b53982-53b5-4328-bc20-a8715f127f7a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:43.924991 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b53982-53b5-4328-bc20-a8715f127f7a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:43.924991 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b53982-53b5-4328-bc20-a8715f127f7a None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:43.936395 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-52b53982-53b5-4328-bc20-a8715f127f7a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 15:44:43.936395 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:43.936395 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:43.936395 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:43.936395 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:43.936395 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:43.936395 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:43.936395 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:43.936395 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:43.936395 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:43.936395 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:43.936395 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:43.936395 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:44:43.936395 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:44:43.936395 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:44:43.936395 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:44:43.937477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:43.937477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:43.937477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:44:43.937477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:43.937477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:44:43.937477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:43.937477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:43.937477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:43.937477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:43.937477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:43.937477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:43.937477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:43.937477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:43.937477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:43.937477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:43.937477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:43.937477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:43.937477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:43.938398 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:43.938398 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:43.938398 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:44:43.938398 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:44:43.938398 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:44:43.938398 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:44:43.938398 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:44:43.938398 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:44:43.938398 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 15:44:43.938398 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:43.942894 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 378/732] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 24 15:44:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:43.944115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ea5ab-c393-4bf1-9331-1d4e9841b2b0 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:43.944395 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ea5ab-c393-4bf1-9331-1d4e9841b2b0 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:43.944695 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ea5ab-c393-4bf1-9331-1d4e9841b2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:43.948584 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ddc34-a9af-4277-adbd-ff1843a94dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:43.949280 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ddc34-a9af-4277-adbd-ff1843a94dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:43.949505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ddc34-a9af-4277-adbd-ff1843a94dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:43.949830 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ddc34-a9af-4277-adbd-ff1843a94dd1 None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:43.950505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ddc34-a9af-4277-adbd-ff1843a94dd1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:43.950933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ddc34-a9af-4277-adbd-ff1843a94dd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:43.952311 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ddc34-a9af-4277-adbd-ff1843a94dd1 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:43.963474 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-196ea5ab-c393-4bf1-9331-1d4e9841b2b0 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:43.964386 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 355/733] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:44:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:43.965661 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb40bf-ab0c-4c56-a41e-7f11e99af2f7 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:43.965949 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb40bf-ab0c-4c56-a41e-7f11e99af2f7 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:43.966220 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb40bf-ab0c-4c56-a41e-7f11e99af2f7 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:43.967534 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 356/734] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:43.969109 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-196ea5ab-c393-4bf1-9331-1d4e9841b2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:43.972904 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb40bf-ab0c-4c56-a41e-7f11e99af2f7 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:44.042063 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 379/735] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:44.043086 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ea5ab-c393-4bf1-9331-1d4e9841b2b0 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:44.056591 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:44.092231 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb40bf-ab0c-4c56-a41e-7f11e99af2f7 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:44.130774 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ded27-d90e-454e-9953-b05cba7fd67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:44.131472 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ded27-d90e-454e-9953-b05cba7fd67c None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:44.131886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ded27-d90e-454e-9953-b05cba7fd67c None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:44.132279 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ded27-d90e-454e-9953-b05cba7fd67c None admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:44.133214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ded27-d90e-454e-9953-b05cba7fd67c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:44.133549 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ded27-d90e-454e-9953-b05cba7fd67c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:44.135051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ded27-d90e-454e-9953-b05cba7fd67c None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:44.157395 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 357/736] 10.222.0.64 () {56 vars in 1149 bytes} [Wed Aug 24 15:44:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:44.159118 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a6e65-9eae-4dde-b20d-dd4030c13fa9 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:44.159484 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a6e65-9eae-4dde-b20d-dd4030c13fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:44.159815 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a6e65-9eae-4dde-b20d-dd4030c13fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:44.171191 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ea5ab-c393-4bf1-9331-1d4e9841b2b0 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:44.183038 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-837a6e65-9eae-4dde-b20d-dd4030c13fa9 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:44.184346 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-837a6e65-9eae-4dde-b20d-dd4030c13fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:44.204218 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:44.211509 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3eb4c4-f7af-4edd-a626-e5c3558067ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:44.212186 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3eb4c4-f7af-4edd-a626-e5c3558067ef None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:44.212482 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3eb4c4-f7af-4edd-a626-e5c3558067ef None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:44.212791 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3eb4c4-f7af-4edd-a626-e5c3558067ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:44.224011 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3eb4c4-f7af-4edd-a626-e5c3558067ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:44.225685 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3eb4c4-f7af-4edd-a626-e5c3558067ef None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:44.247451 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-7e3eb4c4-f7af-4edd-a626-e5c3558067ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:44.247451 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:44.247451 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:44.247451 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:44.247451 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:44.247451 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:44.247451 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:44.247451 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:44.247451 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:44.247451 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:44.247451 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:44.247451 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:44.247451 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:44.247451 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:44.247451 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:44.247451 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:44.248455 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:44.248455 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:44.248455 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:44.248455 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:44.248455 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:44.248455 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:44.248455 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:44.248455 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:44.248455 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:44.248455 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:44.248455 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:44.248455 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:44.248455 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:44.248455 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:44.248455 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:44.248455 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:44.248455 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:44.249477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:44.249477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:44.249477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:44.249477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 380/737] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:44.249477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3eb4c4-f7af-4edd-a626-e5c3558067ef None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:44.269945 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 358/738] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:44.270831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a6e65-9eae-4dde-b20d-dd4030c13fa9 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:44.343623 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:44.396205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a6e65-9eae-4dde-b20d-dd4030c13fa9 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:44.397425 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3eb4c4-f7af-4edd-a626-e5c3558067ef None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:44.433157 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1858344-77a3-486a-90a4-0ec774a791ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:44.433861 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1858344-77a3-486a-90a4-0ec774a791ac None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:44.434127 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1858344-77a3-486a-90a4-0ec774a791ac None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:44.434322 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1858344-77a3-486a-90a4-0ec774a791ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:44.443151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4dbd3-77bd-4fd9-b0b3-4c6a9374375b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:44.443791 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4dbd3-77bd-4fd9-b0b3-4c6a9374375b None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:44.444062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4dbd3-77bd-4fd9-b0b3-4c6a9374375b None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:44.445107 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4dbd3-77bd-4fd9-b0b3-4c6a9374375b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:44.459128 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4dbd3-77bd-4fd9-b0b3-4c6a9374375b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:44.460756 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:44.463115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-61d4dbd3-77bd-4fd9-b0b3-4c6a9374375b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:44:44.463115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:44.463115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:44.463115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:44.463115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:44.463115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:44.463115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:44.463115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:44.463115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:44.463115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:44.463115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:44.463115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:44.463115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:44.463115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:44.463115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:44.463115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:44.464045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:44.464045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:44.464045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:44.464045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:44.464045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:44.464045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:44.464045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:44.464045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:44.464045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:44.464045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:44.464045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:44.464045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:44.464045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:44.464045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:44.464045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:44.464045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:44.465410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:44.465410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:44.465410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:44.465410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:44.465410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:44.465410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:44.465410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:44.465410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:44.465410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:44.465410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:44.465410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:44:44.465410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:44.465410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 381/739] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:44:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:44.465410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4dbd3-77bd-4fd9-b0b3-4c6a9374375b None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:44.519186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1858344-77a3-486a-90a4-0ec774a791ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:44.521085 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1858344-77a3-486a-90a4-0ec774a791ac None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:44.589673 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4dbd3-77bd-4fd9-b0b3-4c6a9374375b None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:44.614746 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:44.628737 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce84dd1-547b-43b9-b583-7208ed2fc54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:44.629345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce84dd1-547b-43b9-b583-7208ed2fc54b None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:44.629625 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce84dd1-547b-43b9-b583-7208ed2fc54b None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:44.629895 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce84dd1-547b-43b9-b583-7208ed2fc54b None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:44.630534 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce84dd1-547b-43b9-b583-7208ed2fc54b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:44.630837 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce84dd1-547b-43b9-b583-7208ed2fc54b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:44.631155 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 359/740] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:44:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:44.632052 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1858344-77a3-486a-90a4-0ec774a791ac None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:44.632424 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce84dd1-547b-43b9-b583-7208ed2fc54b None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:44.645627 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 382/741] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:44.646546 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce84dd1-547b-43b9-b583-7208ed2fc54b None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:44.692934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:44.744523 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1858344-77a3-486a-90a4-0ec774a791ac None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:44.760571 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce84dd1-547b-43b9-b583-7208ed2fc54b None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:44.781779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ed1b1-25e3-46a1-a834-7dcd3d917e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:44.782395 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ed1b1-25e3-46a1-a834-7dcd3d917e98 None admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:44.782678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ed1b1-25e3-46a1-a834-7dcd3d917e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:44.783614 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ed1b1-25e3-46a1-a834-7dcd3d917e98 None admin] PATH_INFO: `/v3/services` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:44.784273 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ed1b1-25e3-46a1-a834-7dcd3d917e98 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:44.785693 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ed1b1-25e3-46a1-a834-7dcd3d917e98 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:44.799243 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe2be1-fd77-4495-91e9-85dee4039ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:44.799853 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe2be1-fd77-4495-91e9-85dee4039ace None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:44.800135 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe2be1-fd77-4495-91e9-85dee4039ace None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:44.800407 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe2be1-fd77-4495-91e9-85dee4039ace None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:44.801134 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe2be1-fd77-4495-91e9-85dee4039ace None admin] RBAC: Adding query filter params (name=admin) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:44.801439 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe2be1-fd77-4495-91e9-85dee4039ace None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:44.802814 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe2be1-fd77-4495-91e9-85dee4039ace None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:44.811458 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 383/742] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:44:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:44.812267 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe2be1-fd77-4495-91e9-85dee4039ace None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:44.857732 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:44.889929 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 360/743] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 24 15:44:44 2022] POST /identity/v3/services => generated 240 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:44:44.890774 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ed1b1-25e3-46a1-a834-7dcd3d917e98 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:44.921615 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe2be1-fd77-4495-91e9-85dee4039ace None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:44.974875 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ec0cb-222a-4c3d-99d4-6697fb2ce26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:44.975496 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ec0cb-222a-4c3d-99d4-6697fb2ce26f None admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:44.975786 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ec0cb-222a-4c3d-99d4-6697fb2ce26f None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:44.976057 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ec0cb-222a-4c3d-99d4-6697fb2ce26f None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:44.976775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ec0cb-222a-4c3d-99d4-6697fb2ce26f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:44.978239 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ec0cb-222a-4c3d-99d4-6697fb2ce26f None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:45.016303 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ed1b1-25e3-46a1-a834-7dcd3d917e98 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:45.031934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:45.051313 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 384/744] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 24 15:44:44 2022] POST /identity/v3/services => generated 251 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:44:45.057394 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ec0cb-222a-4c3d-99d4-6697fb2ce26f None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:45.071414 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2f6c6-9b8f-4ad5-96fc-d16aed39f539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:45.072399 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2f6c6-9b8f-4ad5-96fc-d16aed39f539 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:45.072829 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2f6c6-9b8f-4ad5-96fc-d16aed39f539 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:45.073228 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2f6c6-9b8f-4ad5-96fc-d16aed39f539 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:45.089472 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f2f6c6-9b8f-4ad5-96fc-d16aed39f539 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:45.090878 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f2f6c6-9b8f-4ad5-96fc-d16aed39f539 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:45.107677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-35f2f6c6-9b8f-4ad5-96fc-d16aed39f539 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:45.107677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:45.107677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:45.107677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:45.107677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:45.107677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:45.107677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:45.107677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:45.107677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:45.107677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:45.107677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:45.107677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:45.107677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:45.107677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:45.107677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:45.107677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:45.109873 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:45.109873 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:45.109873 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:45.109873 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:45.109873 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:45.109873 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:45.109873 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:45.109873 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:45.109873 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:45.109873 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:45.109873 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:45.109873 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:45.109873 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:45.109873 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:45.109873 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:45.109873 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:45.109873 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:45.113343 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:45.113343 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:45.113343 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:45.113343 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 361/745] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:45.113343 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2f6c6-9b8f-4ad5-96fc-d16aed39f539 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:45.207264 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:45.212980 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ec0cb-222a-4c3d-99d4-6697fb2ce26f None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:45.260036 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d5d3b-5527-4b7a-a5b7-e499987d2793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:45.261060 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d5d3b-5527-4b7a-a5b7-e499987d2793 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:45.261536 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d5d3b-5527-4b7a-a5b7-e499987d2793 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:45.262558 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d5d3b-5527-4b7a-a5b7-e499987d2793 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:45.272087 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d5d3b-5527-4b7a-a5b7-e499987d2793 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:45.273603 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d5d3b-5527-4b7a-a5b7-e499987d2793 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:45.276675 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2f6c6-9b8f-4ad5-96fc-d16aed39f539 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:45.292137 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-323d5d3b-5527-4b7a-a5b7-e499987d2793 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 15:44:45.292137 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:45.292137 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:45.292137 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:45.292137 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:45.292137 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:45.292137 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:45.292137 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:45.292137 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:45.292137 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:45.292137 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:45.292137 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:45.292137 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:44:45.292137 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:44:45.292137 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:44:45.292137 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:44:45.293179 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:45.293179 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:45.293179 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:44:45.293179 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:45.293179 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:44:45.293179 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:45.293179 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:45.293179 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:45.293179 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:45.293179 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:45.293179 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:45.293179 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:45.293179 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:45.293179 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:45.293179 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:45.293179 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:45.293179 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:45.293179 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:45.294142 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:45.294142 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:45.294142 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:44:45.294142 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:44:45.294142 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:44:45.294142 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:44:45.294142 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:44:45.294142 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:44:45.294142 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 15:44:45.294142 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:45.294142 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 385/746] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:44:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:45.294853 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d5d3b-5527-4b7a-a5b7-e499987d2793 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:45.331879 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f742d2f-bb34-4dee-82a2-cedb09f70e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:45.333864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f742d2f-bb34-4dee-82a2-cedb09f70e1b None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:45.334342 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f742d2f-bb34-4dee-82a2-cedb09f70e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:45.334755 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f742d2f-bb34-4dee-82a2-cedb09f70e1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:45.353695 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f742d2f-bb34-4dee-82a2-cedb09f70e1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:45.356464 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f742d2f-bb34-4dee-82a2-cedb09f70e1b None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:45.378057 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-9f742d2f-bb34-4dee-82a2-cedb09f70e1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:45.378057 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:45.378057 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:45.378057 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:45.378057 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:45.378057 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:45.378057 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:45.378057 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:45.378057 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:45.378057 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:45.378057 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:45.378057 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:45.378057 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:45.378057 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:45.378057 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:45.378057 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:45.379422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:45.379422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:45.379422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:45.379422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:45.379422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:45.379422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:45.379422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:45.379422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:45.379422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:45.379422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:45.379422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:45.379422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:45.379422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:45.379422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:45.379422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:45.379422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:45.379422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:45.380440 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:45.380440 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:45.380440 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:45.381167 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 362/747] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:45.382073 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f742d2f-bb34-4dee-82a2-cedb09f70e1b None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:45.404446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:45.431530 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d5d3b-5527-4b7a-a5b7-e499987d2793 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:45.474777 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c65657-4177-4212-a203-9be85bd83a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:45.475445 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c65657-4177-4212-a203-9be85bd83a58 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:45.475758 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c65657-4177-4212-a203-9be85bd83a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:45.476104 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c65657-4177-4212-a203-9be85bd83a58 None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:45.476930 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c65657-4177-4212-a203-9be85bd83a58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:45.477475 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c65657-4177-4212-a203-9be85bd83a58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:45.478960 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c65657-4177-4212-a203-9be85bd83a58 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:45.492708 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 386/748] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:45.493856 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c65657-4177-4212-a203-9be85bd83a58 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:45.514835 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:45.532024 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f742d2f-bb34-4dee-82a2-cedb09f70e1b None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:45.580520 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00d20a-7b43-4b7f-ab78-301225efbb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:45.581436 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00d20a-7b43-4b7f-ab78-301225efbb18 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:45.581867 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00d20a-7b43-4b7f-ab78-301225efbb18 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:45.582287 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00d20a-7b43-4b7f-ab78-301225efbb18 None admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:45.583161 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e00d20a-7b43-4b7f-ab78-301225efbb18 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:45.583609 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e00d20a-7b43-4b7f-ab78-301225efbb18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:45.585237 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e00d20a-7b43-4b7f-ab78-301225efbb18 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:45.614831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 363/749] 10.222.0.64 () {56 vars in 1135 bytes} [Wed Aug 24 15:44:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:45.614831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00d20a-7b43-4b7f-ab78-301225efbb18 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:45.621427 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c65657-4177-4212-a203-9be85bd83a58 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:45.666299 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820d91d-9762-43ab-b0e8-ec73f41cb4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:45.666932 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820d91d-9762-43ab-b0e8-ec73f41cb4c7 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:45.667218 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820d91d-9762-43ab-b0e8-ec73f41cb4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:45.667494 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820d91d-9762-43ab-b0e8-ec73f41cb4c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:45.668152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820d91d-9762-43ab-b0e8-ec73f41cb4c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:45.668461 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820d91d-9762-43ab-b0e8-ec73f41cb4c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:45.669895 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820d91d-9762-43ab-b0e8-ec73f41cb4c7 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:45.682577 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 387/750] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:45.683522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820d91d-9762-43ab-b0e8-ec73f41cb4c7 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:45.719199 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:45.761549 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00d20a-7b43-4b7f-ab78-301225efbb18 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:45.818879 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:45.842259 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f07558-cbf7-45d2-b764-f058d14493c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:45.843056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f07558-cbf7-45d2-b764-f058d14493c0 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:45.843409 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f07558-cbf7-45d2-b764-f058d14493c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:45.843751 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f07558-cbf7-45d2-b764-f058d14493c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:45.848963 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820d91d-9762-43ab-b0e8-ec73f41cb4c7 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:45.851712 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f07558-cbf7-45d2-b764-f058d14493c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:45.853860 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f07558-cbf7-45d2-b764-f058d14493c0 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:45.867243 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-68f07558-cbf7-45d2-b764-f058d14493c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:45.867243 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:45.867243 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:45.867243 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:45.867243 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:45.867243 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:45.867243 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:45.867243 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:45.867243 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:45.867243 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:45.867243 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:45.867243 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:45.867243 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:44:45.867243 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:44:45.867243 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:44:45.868420 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:44:45.868420 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:45.868420 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:45.868420 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:45.868420 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:45.868420 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:45.868420 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:45.868420 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:45.868420 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:45.868420 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:45.868420 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:45.868420 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:45.868420 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:45.868420 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:45.868420 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:45.868420 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:45.868420 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:45.869557 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:44:45.869557 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:44:45.869557 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:44:45.869557 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:44:45.869557 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:44:45.869557 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:44:45.869557 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:45.869557 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:45.874927 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 364/751] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:44:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:45.875850 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f07558-cbf7-45d2-b764-f058d14493c0 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:45.896611 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf75fc8-2a2b-42f1-8610-4a9fe592f1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:45.897711 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf75fc8-2a2b-42f1-8610-4a9fe592f1d8 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:45.898426 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf75fc8-2a2b-42f1-8610-4a9fe592f1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:45.898857 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf75fc8-2a2b-42f1-8610-4a9fe592f1d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:45.991713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf75fc8-2a2b-42f1-8610-4a9fe592f1d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:45.993417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf75fc8-2a2b-42f1-8610-4a9fe592f1d8 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:45.995572 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f07558-cbf7-45d2-b764-f058d14493c0 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:46.041487 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:46.049749 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd1ca0-695f-4a45-84c4-0424c8296fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:46.051460 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd1ca0-695f-4a45-84c4-0424c8296fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:46.051943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd1ca0-695f-4a45-84c4-0424c8296fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:46.052434 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd1ca0-695f-4a45-84c4-0424c8296fe4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:46.065069 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd1ca0-695f-4a45-84c4-0424c8296fe4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:46.067651 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd1ca0-695f-4a45-84c4-0424c8296fe4 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:46.083304 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-51cd1ca0-695f-4a45-84c4-0424c8296fe4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:44:46.083304 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:46.083304 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:46.083304 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:46.083304 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:46.083304 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:46.083304 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:46.083304 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:46.083304 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:46.083304 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:46.083304 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:46.083304 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:46.083304 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:44:46.083304 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:44:46.083304 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:44:46.083304 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:44:46.084315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:46.084315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:46.084315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:44:46.084315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:46.084315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:44:46.084315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:46.084315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:46.084315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:46.084315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:46.084315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:46.084315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:46.084315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:46.084315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:46.084315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:46.084315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:46.084315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:46.084315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:46.084315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:46.085284 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:46.085284 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:46.085284 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:44:46.085284 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:44:46.085284 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:44:46.085284 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:44:46.085284 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:44:46.085284 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:44:46.085284 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:44:46.085284 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:46.091245 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 365/752] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 24 15:44:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:46.091245 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd1ca0-695f-4a45-84c4-0424c8296fe4 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:46.094024 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:46.118937 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 388/753] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:44:45 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:44:46.119903 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf75fc8-2a2b-42f1-8610-4a9fe592f1d8 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:46.235145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd1ca0-695f-4a45-84c4-0424c8296fe4 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:46.241541 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf75fc8-2a2b-42f1-8610-4a9fe592f1d8 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:46.284165 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5036d-84c3-4955-87c6-195d6c74d3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:46.284833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5036d-84c3-4955-87c6-195d6c74d3c6 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:46.285119 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5036d-84c3-4955-87c6-195d6c74d3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:46.285394 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5036d-84c3-4955-87c6-195d6c74d3c6 None admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:46.286105 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bded485-088a-4387-a9c4-26ac8a1b4a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:46.286227 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5036d-84c3-4955-87c6-195d6c74d3c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:46.286537 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5036d-84c3-4955-87c6-195d6c74d3c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:46.287259 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bded485-088a-4387-a9c4-26ac8a1b4a4b None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:46.287734 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bded485-088a-4387-a9c4-26ac8a1b4a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:46.288041 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5036d-84c3-4955-87c6-195d6c74d3c6 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:46.288419 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bded485-088a-4387-a9c4-26ac8a1b4a4b None admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:46.289409 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bded485-088a-4387-a9c4-26ac8a1b4a4b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:46.290224 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bded485-088a-4387-a9c4-26ac8a1b4a4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:46.292521 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bded485-088a-4387-a9c4-26ac8a1b4a4b None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:46.309235 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 366/754] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:44:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:46.310865 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5036d-84c3-4955-87c6-195d6c74d3c6 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:46.326926 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 389/755] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 24 15:44:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:46.327603 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bded485-088a-4387-a9c4-26ac8a1b4a4b None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:46.379703 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:46.382018 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:46.452378 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5036d-84c3-4955-87c6-195d6c74d3c6 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:46.473898 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bded485-088a-4387-a9c4-26ac8a1b4a4b None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:46.497003 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839b0d0-7577-4812-85ad-30c626d45f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:46.497905 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839b0d0-7577-4812-85ad-30c626d45f61 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:46.498046 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839b0d0-7577-4812-85ad-30c626d45f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:46.498330 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839b0d0-7577-4812-85ad-30c626d45f61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:46.512709 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839b0d0-7577-4812-85ad-30c626d45f61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:46.514281 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839b0d0-7577-4812-85ad-30c626d45f61 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:46.521766 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e42979-38f7-4544-9ae8-155fc3764277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:46.523637 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e42979-38f7-4544-9ae8-155fc3764277 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:46.524101 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e42979-38f7-4544-9ae8-155fc3764277 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:46.524924 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e42979-38f7-4544-9ae8-155fc3764277 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:46.525698 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e42979-38f7-4544-9ae8-155fc3764277 None admin] RBAC: Adding query filter params (role.id=a74cbb295dd8432985940aa21806f970, scope.project.id=9b25a7c01ab540ceae16dd618b848f2d, user.id=eaf3821dd57a4d8f9ca6385c202bb0ed) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:46.526008 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e42979-38f7-4544-9ae8-155fc3764277 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:46.528831 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e42979-38f7-4544-9ae8-155fc3764277 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:46.535365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-a839b0d0-7577-4812-85ad-30c626d45f61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:46.535365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:46.535365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:46.535365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:46.535365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:46.535365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:46.535365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:46.535365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:46.535365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:46.535365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:46.535365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:46.535365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:46.535365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:46.535365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:46.535365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:46.535365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:46.537153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:46.537153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:46.537153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:46.537153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:46.537153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:46.537153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:46.537153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:46.537153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:46.537153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:46.537153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:46.537153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:46.537153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:46.537153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:46.537153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:46.537153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:46.537153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:46.537153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:46.538087 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:46.538087 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:46.538087 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:46.538256 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 390/756] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:44:46 2022] GET /identity/v3/role_assignments?user.id=eaf3821dd57a4d8f9ca6385c202bb0ed&scope.project.id=9b25a7c01ab540ceae16dd618b848f2d&role.id=a74cbb295dd8432985940aa21806f970 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:46.538256 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e42979-38f7-4544-9ae8-155fc3764277 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:46.540436 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 367/757] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:46.548149 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839b0d0-7577-4812-85ad-30c626d45f61 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:46.721670 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:46.724937 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e42979-38f7-4544-9ae8-155fc3764277 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:46.764260 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839b0d0-7577-4812-85ad-30c626d45f61 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:46.765915 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:46.778062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d70893-6a67-4f8d-b974-24817335548a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:46.778920 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d70893-6a67-4f8d-b974-24817335548a None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:46.779208 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d70893-6a67-4f8d-b974-24817335548a None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:46.779488 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d70893-6a67-4f8d-b974-24817335548a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:46.794640 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d70893-6a67-4f8d-b974-24817335548a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:46.796101 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d70893-6a67-4f8d-b974-24817335548a None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:46.811297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3552f4e-b989-46b1-82c3-c73387bb28d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:46.811889 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3552f4e-b989-46b1-82c3-c73387bb28d7 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:46.812169 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3552f4e-b989-46b1-82c3-c73387bb28d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:46.812437 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3552f4e-b989-46b1-82c3-c73387bb28d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:46.812784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-d0d70893-6a67-4f8d-b974-24817335548a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:46.812784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:46.812784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:46.812784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:46.812784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:46.812784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:46.812784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:46.812784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:46.812784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:46.812784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:46.812784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:46.812784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:46.812784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:46.812784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:46.812784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:46.812784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:46.813684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:46.813684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:46.813684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:46.813684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:46.813684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:46.813684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:46.813684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:46.813684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:46.813684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:46.813684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:46.813684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:46.813684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:46.813684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:46.813684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:46.813684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:46.813684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:46.813684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:46.815799 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:46.815799 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:46.815799 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:46.816017 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3552f4e-b989-46b1-82c3-c73387bb28d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:46.816017 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3552f4e-b989-46b1-82c3-c73387bb28d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:46.816171 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 391/758] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:46.817413 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3552f4e-b989-46b1-82c3-c73387bb28d7 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:46.821994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d70893-6a67-4f8d-b974-24817335548a None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:46.836661 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 368/759] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:44:46.837733 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3552f4e-b989-46b1-82c3-c73387bb28d7 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:46.966252 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d70893-6a67-4f8d-b974-24817335548a None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:47.003438 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed3b0c-0d18-4496-9fea-35b816b224fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:47.004429 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed3b0c-0d18-4496-9fea-35b816b224fd None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:47.004969 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed3b0c-0d18-4496-9fea-35b816b224fd None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:47.005468 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed3b0c-0d18-4496-9fea-35b816b224fd None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:47.005865 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3552f4e-b989-46b1-82c3-c73387bb28d7 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:47.006545 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed3b0c-0d18-4496-9fea-35b816b224fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:47.007060 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed3b0c-0d18-4496-9fea-35b816b224fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:47.008719 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed3b0c-0d18-4496-9fea-35b816b224fd None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:47.023694 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 392/760] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:47.032678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed3b0c-0d18-4496-9fea-35b816b224fd None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:47.050068 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26644912-eee7-4595-880d-14a66f540fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:47.050710 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26644912-eee7-4595-880d-14a66f540fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:47.050991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26644912-eee7-4595-880d-14a66f540fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:47.051264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26644912-eee7-4595-880d-14a66f540fb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:47.059163 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26644912-eee7-4595-880d-14a66f540fb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:47.060654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26644912-eee7-4595-880d-14a66f540fb3 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:47.073402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-26644912-eee7-4595-880d-14a66f540fb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:47.073402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:47.073402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:47.073402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:47.073402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:47.073402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:47.073402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:47.073402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:47.073402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:47.073402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:47.073402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:47.073402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:47.073402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:44:47.073402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:44:47.073402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:44:47.074332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:44:47.074332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:47.074332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:47.074332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:47.074332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:47.074332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:47.074332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:47.074332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:47.074332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:47.074332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:47.074332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:47.074332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:47.074332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:47.074332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:47.074332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:47.074332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:47.074332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:47.075272 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:44:47.075272 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:44:47.075272 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:44:47.075272 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:44:47.075272 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:44:47.075272 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:44:47.075272 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:47.075272 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:47.075272 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 369/761] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:44:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:47.076751 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:47.085719 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26644912-eee7-4595-880d-14a66f540fb3 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:47.117790 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:47.196168 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed3b0c-0d18-4496-9fea-35b816b224fd None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:47.225271 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26644912-eee7-4595-880d-14a66f540fb3 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:47.238607 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f771821-08d2-4ff5-a6b4-4346aa7e7edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:47.239329 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f771821-08d2-4ff5-a6b4-4346aa7e7edb None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:47.239513 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f771821-08d2-4ff5-a6b4-4346aa7e7edb None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:47.239785 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f771821-08d2-4ff5-a6b4-4346aa7e7edb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:47.247229 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f771821-08d2-4ff5-a6b4-4346aa7e7edb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:47.248722 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f771821-08d2-4ff5-a6b4-4346aa7e7edb None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:47.261553 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-6f771821-08d2-4ff5-a6b4-4346aa7e7edb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:47.261553 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:47.261553 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:47.261553 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:47.261553 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:47.261553 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:47.261553 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:47.261553 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:47.261553 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:47.261553 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:47.261553 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:47.261553 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:47.261553 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:44:47.261553 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:44:47.261553 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:44:47.262502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:44:47.262502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:47.262502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:47.262502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:47.262502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:47.262502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:47.262502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:47.262502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:47.262502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:47.262502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:47.262502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:47.262502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:47.262502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:47.262502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:47.262502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:47.262502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:47.262502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:47.263410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:44:47.263410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:44:47.263410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:44:47.263410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:44:47.263410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:44:47.263410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:44:47.263410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:47.263410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:47.268154 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 393/762] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:44:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:47.269814 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d036b8-354e-4a89-a022-f4c377d28fc2 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:47.270100 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d036b8-354e-4a89-a022-f4c377d28fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:47.270375 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d036b8-354e-4a89-a022-f4c377d28fc2 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:47.276206 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 394/763] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:47.276206 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d036b8-354e-4a89-a022-f4c377d28fc2 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:47.277347 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbca421-1e80-4be3-b3a4-51f377a66cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:47.278532 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbca421-1e80-4be3-b3a4-51f377a66cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:47.279011 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbca421-1e80-4be3-b3a4-51f377a66cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:47.279477 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbca421-1e80-4be3-b3a4-51f377a66cb8 None admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:47.280456 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbca421-1e80-4be3-b3a4-51f377a66cb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:47.281221 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbca421-1e80-4be3-b3a4-51f377a66cb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:47.282930 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbca421-1e80-4be3-b3a4-51f377a66cb8 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:47.298112 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 370/764] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:44:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:47.299845 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07f807-4760-4829-9555-9f0d76cdf66d None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:47.300370 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07f807-4760-4829-9555-9f0d76cdf66d None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:47.300979 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07f807-4760-4829-9555-9f0d76cdf66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:47.320886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-7c07f807-4760-4829-9555-9f0d76cdf66d None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:47.322092 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-7c07f807-4760-4829-9555-9f0d76cdf66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:47.394065 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:47.402424 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 371/765] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:44:47.403960 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52535ce-e5db-48b8-a5db-e2012b692549 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:47.404247 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52535ce-e5db-48b8-a5db-e2012b692549 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:47.404523 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52535ce-e5db-48b8-a5db-e2012b692549 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:47.405894 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 372/766] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:47.411607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52535ce-e5db-48b8-a5db-e2012b692549 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:47.438494 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d036b8-354e-4a89-a022-f4c377d28fc2 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:47.439613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:47.481005 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f373a4-20a4-4e1b-a16e-fe7972503917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:47.481477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f373a4-20a4-4e1b-a16e-fe7972503917 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:47.481759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f373a4-20a4-4e1b-a16e-fe7972503917 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:47.482032 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f373a4-20a4-4e1b-a16e-fe7972503917 None admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:47.482797 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f373a4-20a4-4e1b-a16e-fe7972503917 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:47.483039 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f373a4-20a4-4e1b-a16e-fe7972503917 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:47.484489 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f373a4-20a4-4e1b-a16e-fe7972503917 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:47.502486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 395/767] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:44:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:47.502486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa822fe-78a3-4f8d-9431-28945faafd75 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:47.502486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa822fe-78a3-4f8d-9431-28945faafd75 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:47.502486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa822fe-78a3-4f8d-9431-28945faafd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:47.519526 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-8aa822fe-78a3-4f8d-9431-28945faafd75 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:47.521443 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-8aa822fe-78a3-4f8d-9431-28945faafd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:47.554801 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52535ce-e5db-48b8-a5db-e2012b692549 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:47.593221 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a65707-8337-423f-a231-c10b8841bfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:47.594284 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a65707-8337-423f-a231-c10b8841bfae None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:47.594759 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a65707-8337-423f-a231-c10b8841bfae None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:47.595382 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a65707-8337-423f-a231-c10b8841bfae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:47.597093 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 396/768] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:44:47.597736 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a65707-8337-423f-a231-c10b8841bfae None admin] RBAC: Adding query filter params (role.id=c6745e08f9da4a2bae8510c9983635c3, scope.project.id=9b25a7c01ab540ceae16dd618b848f2d, user.id=b3a0a84e4c4e47fc930881109fc07039) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:47.598012 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa822fe-78a3-4f8d-9431-28945faafd75 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:47.598448 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a65707-8337-423f-a231-c10b8841bfae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:47.600088 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a65707-8337-423f-a231-c10b8841bfae None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:47.606905 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 373/769] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:44:47 2022] GET /identity/v3/role_assignments?user.id=b3a0a84e4c4e47fc930881109fc07039&scope.project.id=9b25a7c01ab540ceae16dd618b848f2d&role.id=c6745e08f9da4a2bae8510c9983635c3 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:47.697269 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a65707-8337-423f-a231-c10b8841bfae None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:47.698644 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:47.760073 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa822fe-78a3-4f8d-9431-28945faafd75 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:47.831492 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29eb533-7a82-4884-92d0-acb02dd7c576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:47.832560 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29eb533-7a82-4884-92d0-acb02dd7c576 None admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:47.833033 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29eb533-7a82-4884-92d0-acb02dd7c576 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:47.833454 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29eb533-7a82-4884-92d0-acb02dd7c576 None admin] PATH_INFO: `/v3/projects/9b25a7c01ab540ceae16dd618b848f2d/users/e5f0d8fe42e74d68bfa9a0e365bab4b6/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:47.837251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29eb533-7a82-4884-92d0-acb02dd7c576 None admin] RBAC: Authorizing `identity:create_grant(project_id=9b25a7c01ab540ceae16dd618b848f2d, user_id=e5f0d8fe42e74d68bfa9a0e365bab4b6, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:47.838616 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:47.841899 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29eb533-7a82-4884-92d0-acb02dd7c576 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:47.882294 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a65707-8337-423f-a231-c10b8841bfae None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:47.934969 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d11f5-f87c-4d00-9187-bc473859b636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:47.936147 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d11f5-f87c-4d00-9187-bc473859b636 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:47.936783 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d11f5-f87c-4d00-9187-bc473859b636 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:47.937396 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d11f5-f87c-4d00-9187-bc473859b636 None admin] PATH_INFO: `/v3/services/network` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:47.955084 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 397/770] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 24 15:44:47 2022] PUT /identity/v3/projects/9b25a7c01ab540ceae16dd618b848f2d/users/e5f0d8fe42e74d68bfa9a0e365bab4b6/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:44:47.955299 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d11f5-f87c-4d00-9187-bc473859b636 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:47.955299 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d11f5-f87c-4d00-9187-bc473859b636 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:47.966726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-918d11f5-f87c-4d00-9187-bc473859b636 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 15:44:47.966726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:47.966726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:44:47.966726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:44:47.966726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:44:47.966726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:44:47.966726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:44:47.966726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:44:47.966726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 15:44:47.966726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:47.966726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:44:47.966726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:47.966726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:47.966726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:47.966726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:47.966726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:47.966726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:47.967804 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:47.967804 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:47.967804 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:47.967804 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:47.967804 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:47.967804 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:47.967804 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:44:47.967804 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:44:47.967804 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:44:47.967804 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:44:47.967804 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:47.967804 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:47.967804 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:47.967804 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:47.967804 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:47.967804 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:47.968677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:47.968677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:47.968677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:47.968677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:47.968677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:47.968677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:47.968677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:47.968677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:47.968677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:47.968677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:47.968677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:44:47.968677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:44:47.968677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 15:44:47.968677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:47.972414 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 374/771] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:44:47 2022] GET /identity/v3/services/network => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:44:47.978102 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29eb533-7a82-4884-92d0-acb02dd7c576 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:48.057771 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d11f5-f87c-4d00-9187-bc473859b636 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:48.194017 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29eb533-7a82-4884-92d0-acb02dd7c576 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:48.224525 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:48.229059 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d11f5-f87c-4d00-9187-bc473859b636 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:48.238051 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a25a4c-2b05-478f-89c2-0a9d73b43e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:48.238662 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a25a4c-2b05-478f-89c2-0a9d73b43e2b None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:48.242465 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a25a4c-2b05-478f-89c2-0a9d73b43e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:48.242465 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a25a4c-2b05-478f-89c2-0a9d73b43e2b None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:48.242465 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a25a4c-2b05-478f-89c2-0a9d73b43e2b None admin] RBAC: Adding query filter params (name=network) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:48.242465 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a25a4c-2b05-478f-89c2-0a9d73b43e2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:48.242465 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a25a4c-2b05-478f-89c2-0a9d73b43e2b None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:48.246927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 398/772] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 24 15:44:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:48.253375 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a25a4c-2b05-478f-89c2-0a9d73b43e2b None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:48.306293 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d9a5e-8618-4d9a-bbcc-66018f3bbb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:48.306951 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d9a5e-8618-4d9a-bbcc-66018f3bbb8f None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:48.307227 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d9a5e-8618-4d9a-bbcc-66018f3bbb8f None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:48.307497 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d9a5e-8618-4d9a-bbcc-66018f3bbb8f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:48.308081 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d9a5e-8618-4d9a-bbcc-66018f3bbb8f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:48.309476 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d9a5e-8618-4d9a-bbcc-66018f3bbb8f None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:48.323613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-487d9a5e-8618-4d9a-bbcc-66018f3bbb8f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 15:44:48.323613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:48.323613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:44:48.323613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:44:48.323613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:44:48.323613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:44:48.323613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:44:48.323613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:44:48.323613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 15:44:48.323613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:48.323613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:44:48.323613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:48.323613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:48.323613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:48.323613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:48.323613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:48.323613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:48.324703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:48.324703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:48.324703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:48.324703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:48.324703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:48.324703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:48.324703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:44:48.324703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:44:48.324703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:44:48.324703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:44:48.324703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:48.324703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:48.324703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:48.324703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:48.324703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:48.324703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:48.325569 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:48.325569 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:48.325569 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:48.325569 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:48.325569 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:48.325569 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:48.325569 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:48.325569 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:48.325569 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:48.325569 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:48.325569 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:44:48.325569 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:44:48.325569 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 15:44:48.325569 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:48.333340 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 375/773] 10.222.0.64 () {56 vars in 1129 bytes} [Wed Aug 24 15:44:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:48.339015 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d9a5e-8618-4d9a-bbcc-66018f3bbb8f None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:48.343596 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:48.396554 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a25a4c-2b05-478f-89c2-0a9d73b43e2b None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:48.437806 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294eedc-f1f9-47d1-a88d-b0114349eeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:48.438422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294eedc-f1f9-47d1-a88d-b0114349eeb9 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:48.438702 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294eedc-f1f9-47d1-a88d-b0114349eeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:48.439064 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294eedc-f1f9-47d1-a88d-b0114349eeb9 None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:48.439912 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294eedc-f1f9-47d1-a88d-b0114349eeb9 None admin] RBAC: Adding query filter params (type=network) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:48.440241 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294eedc-f1f9-47d1-a88d-b0114349eeb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:48.441842 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294eedc-f1f9-47d1-a88d-b0114349eeb9 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:48.447750 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 399/774] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 24 15:44:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:48.467881 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294eedc-f1f9-47d1-a88d-b0114349eeb9 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:48.509258 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d9a5e-8618-4d9a-bbcc-66018f3bbb8f None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:48.546464 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960c069-69c9-4a35-8e5e-a98011e6fcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:48.547181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960c069-69c9-4a35-8e5e-a98011e6fcb7 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:48.547462 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960c069-69c9-4a35-8e5e-a98011e6fcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:48.547736 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960c069-69c9-4a35-8e5e-a98011e6fcb7 None admin] PATH_INFO: `/v3/services` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:48.548665 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960c069-69c9-4a35-8e5e-a98011e6fcb7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:48.549170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960c069-69c9-4a35-8e5e-a98011e6fcb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:48.554271 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960c069-69c9-4a35-8e5e-a98011e6fcb7 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:48.559669 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 376/775] 10.222.0.64 () {56 vars in 1124 bytes} [Wed Aug 24 15:44:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:44:48.565513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960c069-69c9-4a35-8e5e-a98011e6fcb7 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:48.577387 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:48.689647 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294eedc-f1f9-47d1-a88d-b0114349eeb9 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:48.707106 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:48.732777 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab10305-e134-4359-a56c-4948ab874e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:48.733682 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab10305-e134-4359-a56c-4948ab874e93 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:48.733965 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab10305-e134-4359-a56c-4948ab874e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:48.734253 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab10305-e134-4359-a56c-4948ab874e93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:48.736785 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab10305-e134-4359-a56c-4948ab874e93 None admin] RBAC: Adding query filter params (interface=public, service_id=20564cab51394072b633d810222c62f1, region_id=RegionOne) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:48.737371 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab10305-e134-4359-a56c-4948ab874e93 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:48.739429 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab10305-e134-4359-a56c-4948ab874e93 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:48.745357 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960c069-69c9-4a35-8e5e-a98011e6fcb7 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:48.751863 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 400/776] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Aug 24 15:44:48 2022] GET /identity/v3/endpoints?service_id=20564cab51394072b633d810222c62f1&interface=public®ion_id=RegionOne => generated 194 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:48.751863 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a659f-51fc-429d-89ad-58fcf3b4d207 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:48.752476 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a659f-51fc-429d-89ad-58fcf3b4d207 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:48.753068 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a659f-51fc-429d-89ad-58fcf3b4d207 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:48.754426 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 401/777] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:48.759942 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a659f-51fc-429d-89ad-58fcf3b4d207 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:48.799699 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c67fdd-0b8b-43e7-bfe5-046911983c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:48.800316 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c67fdd-0b8b-43e7-bfe5-046911983c95 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:48.800594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c67fdd-0b8b-43e7-bfe5-046911983c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:48.802232 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c67fdd-0b8b-43e7-bfe5-046911983c95 None admin] PATH_INFO: `/v3/services` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:48.804307 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c67fdd-0b8b-43e7-bfe5-046911983c95 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:48.804307 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c67fdd-0b8b-43e7-bfe5-046911983c95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:48.804685 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c67fdd-0b8b-43e7-bfe5-046911983c95 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:48.813349 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 377/778] 10.222.0.64 () {56 vars in 1124 bytes} [Wed Aug 24 15:44:48 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:48.816144 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc36bd-214b-42dc-b6a8-d6011737564f None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:48.816426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc36bd-214b-42dc-b6a8-d6011737564f None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:48.816774 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc36bd-214b-42dc-b6a8-d6011737564f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:48.836499 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-01bc36bd-214b-42dc-b6a8-d6011737564f None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:48.837734 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-01bc36bd-214b-42dc-b6a8-d6011737564f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:48.897642 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a659f-51fc-429d-89ad-58fcf3b4d207 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:48.915315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:48.924953 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 378/779] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:44:48.926312 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc36bd-214b-42dc-b6a8-d6011737564f None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:48.942857 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e600d-f716-4348-bda2-2098ba01d1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:48.943614 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e600d-f716-4348-bda2-2098ba01d1b5 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:48.943953 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e600d-f716-4348-bda2-2098ba01d1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:48.944528 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e600d-f716-4348-bda2-2098ba01d1b5 None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:48.945016 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e600d-f716-4348-bda2-2098ba01d1b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:48.946651 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e600d-f716-4348-bda2-2098ba01d1b5 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:48.952706 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 402/780] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 24 15:44:48 2022] GET /identity/v3/services => generated 772 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:49.037176 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:49.094354 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc36bd-214b-42dc-b6a8-d6011737564f None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:49.144360 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23613f-1a72-4b68-9ed0-ae1df82dd913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:49.145004 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23613f-1a72-4b68-9ed0-ae1df82dd913 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:49.145282 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23613f-1a72-4b68-9ed0-ae1df82dd913 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:49.145551 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23613f-1a72-4b68-9ed0-ae1df82dd913 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:49.146255 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23613f-1a72-4b68-9ed0-ae1df82dd913 None admin] RBAC: Adding query filter params (interface=public, service_id=fc2a1da16d6e4c1a918e2e168303c43f, region_id=RegionOne) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:49.146562 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23613f-1a72-4b68-9ed0-ae1df82dd913 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:49.147934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23613f-1a72-4b68-9ed0-ae1df82dd913 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:49.157074 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 379/781] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Aug 24 15:44:48 2022] GET /identity/v3/endpoints?service_id=fc2a1da16d6e4c1a918e2e168303c43f&interface=public®ion_id=RegionOne => generated 194 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:49.162753 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e600d-f716-4348-bda2-2098ba01d1b5 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:49.271335 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23613f-1a72-4b68-9ed0-ae1df82dd913 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:49.346574 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e600d-f716-4348-bda2-2098ba01d1b5 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:49.395826 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23613f-1a72-4b68-9ed0-ae1df82dd913 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:49.401191 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678837c0-e568-4e8c-98cb-b211437bd5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:49.401814 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678837c0-e568-4e8c-98cb-b211437bd5a0 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:49.402099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678837c0-e568-4e8c-98cb-b211437bd5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:49.402375 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678837c0-e568-4e8c-98cb-b211437bd5a0 None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:49.403003 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678837c0-e568-4e8c-98cb-b211437bd5a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:49.408698 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678837c0-e568-4e8c-98cb-b211437bd5a0 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:49.417531 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 403/782] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 24 15:44:49 2022] GET /identity/v3/services => generated 772 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:49.428448 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:49.438522 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b60ea-8cd3-4b8c-8555-3437cf410c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:49.443438 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b60ea-8cd3-4b8c-8555-3437cf410c29 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:49.443438 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b60ea-8cd3-4b8c-8555-3437cf410c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:49.443438 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b60ea-8cd3-4b8c-8555-3437cf410c29 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:49.453949 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b60ea-8cd3-4b8c-8555-3437cf410c29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:49.461393 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-6e9b60ea-8cd3-4b8c-8555-3437cf410c29 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:49.461393 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:49.461393 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:49.461393 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:49.461393 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:49.461393 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:49.461393 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:49.461393 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:49.461393 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:49.461393 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:49.461393 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:49.461393 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:49.461393 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:49.461393 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:49.461393 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:49.461393 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:49.463110 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:49.463110 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:49.463110 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:49.463110 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:49.463110 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:49.463110 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:49.463110 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:49.463110 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:49.463110 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:49.463110 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:49.463110 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:49.463110 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:49.463110 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:49.463110 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:49.463110 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:49.463110 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:49.464592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:49.464592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:49.464592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:49.464592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:49.464592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:49.464592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:49.464592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:49.464592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:49.464592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:49.464592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:49.464592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:49.464592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:49.468270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 380/783] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 24 15:44:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:44:49.475315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678837c0-e568-4e8c-98cb-b211437bd5a0 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:49.540997 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:49.623912 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678837c0-e568-4e8c-98cb-b211437bd5a0 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:49.669182 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a1d15-5c34-4a67-bca3-b4b5bf7e6c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:49.670664 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a1d15-5c34-4a67-bca3-b4b5bf7e6c07 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:49.671167 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a1d15-5c34-4a67-bca3-b4b5bf7e6c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:49.671656 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a1d15-5c34-4a67-bca3-b4b5bf7e6c07 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:49.672537 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a1d15-5c34-4a67-bca3-b4b5bf7e6c07 None admin] RBAC: Adding query filter params (name=service) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:49.673025 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a1d15-5c34-4a67-bca3-b4b5bf7e6c07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:49.675119 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a1d15-5c34-4a67-bca3-b4b5bf7e6c07 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:49.686585 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 404/784] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 24 15:44:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:49.693359 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b60ea-8cd3-4b8c-8555-3437cf410c29 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:49.821129 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b60ea-8cd3-4b8c-8555-3437cf410c29 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:49.862477 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b8510-4cf6-48fc-b11b-52fc9c5b6bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:49.863377 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b8510-4cf6-48fc-b11b-52fc9c5b6bda None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:49.863806 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b8510-4cf6-48fc-b11b-52fc9c5b6bda None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:49.864253 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b8510-4cf6-48fc-b11b-52fc9c5b6bda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:49.876505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b8510-4cf6-48fc-b11b-52fc9c5b6bda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:49.878320 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b8510-4cf6-48fc-b11b-52fc9c5b6bda None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:49.894776 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-b33b8510-4cf6-48fc-b11b-52fc9c5b6bda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:49.894776 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:49.894776 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:49.894776 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:49.894776 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:49.894776 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:49.894776 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:49.894776 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:49.894776 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:49.894776 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:49.894776 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:49.894776 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:49.894776 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:49.894776 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:49.894776 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:49.894776 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:49.895989 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:49.895989 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:49.895989 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:49.895989 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:49.895989 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:49.895989 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:49.895989 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:49.895989 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:49.895989 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:49.895989 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:49.895989 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:49.895989 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:49.895989 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:49.895989 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:49.895989 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:49.895989 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:49.895989 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:49.897137 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:49.897137 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:49.897137 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:49.898945 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 381/785] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:49.905110 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a1d15-5c34-4a67-bca3-b4b5bf7e6c07 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:50.028678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4dd76c-417e-4b46-8b0d-0befd658ecc3 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:50.029400 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4dd76c-417e-4b46-8b0d-0befd658ecc3 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:50.030066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4dd76c-417e-4b46-8b0d-0befd658ecc3 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:50.033392 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 382/786] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:50.038793 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692c5c7-d736-4258-917e-7c870de0830b None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:50.039280 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692c5c7-d736-4258-917e-7c870de0830b None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:50.039716 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692c5c7-d736-4258-917e-7c870de0830b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:50.065237 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a1d15-5c34-4a67-bca3-b4b5bf7e6c07 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:50.076152 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-3692c5c7-d736-4258-917e-7c870de0830b None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:50.076703 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:50.077641 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-3692c5c7-d736-4258-917e-7c870de0830b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:50.122865 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:50.168329 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94675d-666f-45ec-8f3e-cdd0529f65d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:50.168917 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94675d-666f-45ec-8f3e-cdd0529f65d5 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:50.169410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94675d-666f-45ec-8f3e-cdd0529f65d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:50.169898 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94675d-666f-45ec-8f3e-cdd0529f65d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:50.171047 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94675d-666f-45ec-8f3e-cdd0529f65d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:50.171592 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94675d-666f-45ec-8f3e-cdd0529f65d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:50.173658 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94675d-666f-45ec-8f3e-cdd0529f65d5 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:50.176537 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 383/787] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:44:50.198660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 405/788] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:50.204029 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692c5c7-d736-4258-917e-7c870de0830b None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:50.357576 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692c5c7-d736-4258-917e-7c870de0830b None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:50.408764 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68baaa-ab4c-4270-963b-d8fc0e530e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:50.409710 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68baaa-ab4c-4270-963b-d8fc0e530e90 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:50.410141 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68baaa-ab4c-4270-963b-d8fc0e530e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:50.410641 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68baaa-ab4c-4270-963b-d8fc0e530e90 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:50.422180 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68baaa-ab4c-4270-963b-d8fc0e530e90 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:50.424660 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68baaa-ab4c-4270-963b-d8fc0e530e90 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:50.439673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-5e68baaa-ab4c-4270-963b-d8fc0e530e90 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 15:44:50.439673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:50.439673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:50.439673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:50.439673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:50.439673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:50.439673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:50.439673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:50.439673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:50.439673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:50.439673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:50.439673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:50.439673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:44:50.439673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:44:50.439673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:44:50.439673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:44:50.440864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:50.440864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:50.440864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:44:50.440864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:50.440864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:44:50.440864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:50.440864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:50.440864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:50.440864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:50.440864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:50.440864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:50.440864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:50.440864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:50.440864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:50.440864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:50.440864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:50.440864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:50.440864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:50.442066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:50.442066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:50.442066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:44:50.442066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:44:50.442066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:44:50.442066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:44:50.442066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:44:50.442066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:44:50.442066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 15:44:50.442066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:50.442066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 384/789] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 24 15:44:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:50.449898 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94675d-666f-45ec-8f3e-cdd0529f65d5 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:50.463018 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68baaa-ab4c-4270-963b-d8fc0e530e90 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:50.537722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:50.596998 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94675d-666f-45ec-8f3e-cdd0529f65d5 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:50.637417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fac00-46ae-4b41-a43a-3df9c54823d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:50.638829 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fac00-46ae-4b41-a43a-3df9c54823d9 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:50.639437 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fac00-46ae-4b41-a43a-3df9c54823d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:50.639869 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fac00-46ae-4b41-a43a-3df9c54823d9 None admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:50.640914 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fac00-46ae-4b41-a43a-3df9c54823d9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:50.641472 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fac00-46ae-4b41-a43a-3df9c54823d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:50.643191 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fac00-46ae-4b41-a43a-3df9c54823d9 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:50.648112 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68baaa-ab4c-4270-963b-d8fc0e530e90 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:50.663820 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 406/790] 10.222.0.64 () {56 vars in 1149 bytes} [Wed Aug 24 15:44:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:50.665493 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234fb86-1a97-49c8-94c6-7b7fb8c71293 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:50.665923 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234fb86-1a97-49c8-94c6-7b7fb8c71293 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:50.666440 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234fb86-1a97-49c8-94c6-7b7fb8c71293 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:50.668403 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 407/791] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:50.669328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234fb86-1a97-49c8-94c6-7b7fb8c71293 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:50.692022 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0623c-407c-42d3-9406-28436b741649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:50.692802 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0623c-407c-42d3-9406-28436b741649 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:50.693181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0623c-407c-42d3-9406-28436b741649 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:50.693506 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0623c-407c-42d3-9406-28436b741649 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:50.702842 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:50.705456 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0623c-407c-42d3-9406-28436b741649 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:50.710645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-6db0623c-407c-42d3-9406-28436b741649 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:44:50.710645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:50.710645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:50.710645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:50.710645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:50.710645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:50.710645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:50.710645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:50.710645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:50.710645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:50.710645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:50.710645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:50.710645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:50.710645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:50.710645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:50.710645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:50.711612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:50.711612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:50.711612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:50.711612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:50.711612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:50.711612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:50.711612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:50.711612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:50.711612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:50.711612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:50.711612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:50.711612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:50.711612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:50.711612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:50.711612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:50.711612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:50.717138 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:50.717138 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:50.717138 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:50.717138 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:50.717138 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:50.717138 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:50.717138 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:50.717138 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:50.717138 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:50.717138 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:50.717138 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:44:50.717138 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:50.717138 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 385/792] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:44:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:50.717138 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8c190-474e-41b3-a2ba-2a0625cfd605 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:50.717877 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8c190-474e-41b3-a2ba-2a0625cfd605 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:50.717877 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8c190-474e-41b3-a2ba-2a0625cfd605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:50.733595 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-a8f8c190-474e-41b3-a2ba-2a0625cfd605 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:50.735192 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-a8f8c190-474e-41b3-a2ba-2a0625cfd605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:50.809174 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234fb86-1a97-49c8-94c6-7b7fb8c71293 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:50.816995 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 386/793] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:44:50.818067 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8c190-474e-41b3-a2ba-2a0625cfd605 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:50.837942 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:50.864866 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42478153-6c6d-4a6d-b69e-7f265da9f53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:50.865926 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42478153-6c6d-4a6d-b69e-7f265da9f53d None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:50.866399 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42478153-6c6d-4a6d-b69e-7f265da9f53d None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:50.866878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42478153-6c6d-4a6d-b69e-7f265da9f53d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:50.883573 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42478153-6c6d-4a6d-b69e-7f265da9f53d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:50.885489 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42478153-6c6d-4a6d-b69e-7f265da9f53d None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:50.903388 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-42478153-6c6d-4a6d-b69e-7f265da9f53d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:50.903388 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:50.903388 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:50.903388 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:50.903388 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:50.903388 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:50.903388 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:50.903388 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:50.903388 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:50.903388 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:50.903388 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:50.903388 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:50.903388 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:50.903388 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:50.903388 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:50.903388 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:50.904474 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:50.904474 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:50.904474 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:50.904474 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:50.904474 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:50.904474 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:50.904474 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:50.904474 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:50.904474 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:50.904474 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:50.904474 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:50.904474 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:50.904474 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:50.904474 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:50.904474 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:50.904474 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:50.904474 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:50.905996 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:50.905996 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:50.905996 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:50.908668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 408/794] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:50.919826 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42478153-6c6d-4a6d-b69e-7f265da9f53d None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:50.987138 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8c190-474e-41b3-a2ba-2a0625cfd605 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:51.035766 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91513532-ab01-46c1-a826-59c04f81f948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:51.036384 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91513532-ab01-46c1-a826-59c04f81f948 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:51.036690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91513532-ab01-46c1-a826-59c04f81f948 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:51.037144 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91513532-ab01-46c1-a826-59c04f81f948 None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:51.037893 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91513532-ab01-46c1-a826-59c04f81f948 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:51.038203 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91513532-ab01-46c1-a826-59c04f81f948 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:51.039910 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91513532-ab01-46c1-a826-59c04f81f948 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:51.051550 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 387/795] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:44:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:51.062510 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91513532-ab01-46c1-a826-59c04f81f948 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:51.080987 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:51.109026 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42478153-6c6d-4a6d-b69e-7f265da9f53d None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:51.175896 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80bb3ff-184b-4e6c-a357-359fcfb15b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:51.176506 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80bb3ff-184b-4e6c-a357-359fcfb15b59 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:51.176807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80bb3ff-184b-4e6c-a357-359fcfb15b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:51.177077 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80bb3ff-184b-4e6c-a357-359fcfb15b59 None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:51.177733 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80bb3ff-184b-4e6c-a357-359fcfb15b59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:51.178034 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80bb3ff-184b-4e6c-a357-359fcfb15b59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:51.179435 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80bb3ff-184b-4e6c-a357-359fcfb15b59 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:51.193577 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 409/796] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:44:51.194628 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80bb3ff-184b-4e6c-a357-359fcfb15b59 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:51.206019 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:51.229438 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91513532-ab01-46c1-a826-59c04f81f948 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:51.269800 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de88994-6fd6-4000-a22a-d27e387fc4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:51.270347 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de88994-6fd6-4000-a22a-d27e387fc4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:51.270630 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de88994-6fd6-4000-a22a-d27e387fc4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:51.270902 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de88994-6fd6-4000-a22a-d27e387fc4a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:51.289187 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de88994-6fd6-4000-a22a-d27e387fc4a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:51.291015 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de88994-6fd6-4000-a22a-d27e387fc4a3 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:51.312574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-9de88994-6fd6-4000-a22a-d27e387fc4a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:51.312574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:51.312574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:51.312574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:51.312574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:51.312574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:51.312574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:51.312574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:51.312574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:51.312574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:51.312574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:51.312574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:51.312574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:51.312574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:51.312574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:51.312574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:51.313648 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:51.313648 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:51.313648 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:51.313648 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:51.313648 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:51.313648 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:51.313648 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:51.313648 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:51.313648 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:51.313648 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:51.313648 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:51.313648 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:51.313648 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:51.313648 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:51.313648 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:51.313648 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:51.313648 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:51.314521 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:51.314521 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:51.314521 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:51.314521 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 388/797] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:51.315309 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de88994-6fd6-4000-a22a-d27e387fc4a3 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:51.337341 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80bb3ff-184b-4e6c-a357-359fcfb15b59 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:51.375261 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2175e71-84f2-407f-8e4b-434703519154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:51.375900 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2175e71-84f2-407f-8e4b-434703519154 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:51.376220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2175e71-84f2-407f-8e4b-434703519154 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:51.376494 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2175e71-84f2-407f-8e4b-434703519154 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:51.378649 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:51.390323 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2175e71-84f2-407f-8e4b-434703519154 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:51.395941 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-d2175e71-84f2-407f-8e4b-434703519154 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:44:51.395941 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:51.395941 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:51.395941 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:51.395941 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:51.395941 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:51.395941 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:51.395941 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:51.395941 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:51.395941 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:51.395941 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:51.395941 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:51.395941 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:51.395941 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:51.395941 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:51.395941 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:51.397200 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:51.397200 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:51.397200 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:51.397200 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:51.397200 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:51.397200 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:51.397200 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:51.397200 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:51.397200 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:51.397200 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:51.397200 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:51.397200 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:51.397200 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:51.397200 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:51.397200 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:51.397200 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:51.398391 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:51.398391 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:51.398391 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:51.398391 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:51.398391 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:51.398391 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:51.398391 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:51.398391 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:51.398391 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:51.398391 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:51.398391 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:44:51.398391 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:51.398391 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 410/798] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:44:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:51.400133 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4332f-cc81-4cd8-af46-74fd283a7749 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:51.400420 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4332f-cc81-4cd8-af46-74fd283a7749 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:51.401004 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4332f-cc81-4cd8-af46-74fd283a7749 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:51.402162 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 411/799] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:51.402703 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4332f-cc81-4cd8-af46-74fd283a7749 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:51.448839 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de88994-6fd6-4000-a22a-d27e387fc4a3 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:51.494843 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:51.506990 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13838c2c-6694-4d24-b479-ebf90bd37fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:51.507896 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13838c2c-6694-4d24-b479-ebf90bd37fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:51.508315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13838c2c-6694-4d24-b479-ebf90bd37fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:51.508755 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13838c2c-6694-4d24-b479-ebf90bd37fe1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:51.518236 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13838c2c-6694-4d24-b479-ebf90bd37fe1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:51.521087 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13838c2c-6694-4d24-b479-ebf90bd37fe1 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:51.535673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-13838c2c-6694-4d24-b479-ebf90bd37fe1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:51.535673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:51.535673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:51.535673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:51.535673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:51.535673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:51.535673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:51.535673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:51.535673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:51.535673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:51.535673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:51.535673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:51.535673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:44:51.535673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:44:51.535673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:44:51.536891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:44:51.536891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:51.536891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:51.536891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:51.536891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:51.536891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:51.536891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:51.536891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:51.536891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:51.536891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:51.536891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:51.536891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:51.536891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:51.536891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:51.536891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:51.536891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:51.536891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:51.537777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:44:51.537777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:44:51.537777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:44:51.537777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:44:51.537777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:44:51.537777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:44:51.537777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:51.537777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:51.539820 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4332f-cc81-4cd8-af46-74fd283a7749 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:51.542203 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 389/800] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:44:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:51.542809 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13838c2c-6694-4d24-b479-ebf90bd37fe1 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:51.585373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224af43-60c7-4755-991f-967119d8b7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:51.585986 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224af43-60c7-4755-991f-967119d8b7c2 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:51.586264 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224af43-60c7-4755-991f-967119d8b7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:51.586538 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224af43-60c7-4755-991f-967119d8b7c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:51.587256 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224af43-60c7-4755-991f-967119d8b7c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:51.587567 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224af43-60c7-4755-991f-967119d8b7c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:51.588997 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224af43-60c7-4755-991f-967119d8b7c2 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:51.606563 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 412/801] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:51.607905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad621bc-4d39-4280-9277-5088c9b763c5 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:51.608194 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad621bc-4d39-4280-9277-5088c9b763c5 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:51.608470 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad621bc-4d39-4280-9277-5088c9b763c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:51.628156 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-fad621bc-4d39-4280-9277-5088c9b763c5 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:51.629429 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-fad621bc-4d39-4280-9277-5088c9b763c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:51.658374 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13838c2c-6694-4d24-b479-ebf90bd37fe1 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:51.688456 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:51.696529 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97622ac7-f33f-49cf-82c2-a5b2dc09cf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:51.718573 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97622ac7-f33f-49cf-82c2-a5b2dc09cf8f None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:51.718573 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97622ac7-f33f-49cf-82c2-a5b2dc09cf8f None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:51.718573 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97622ac7-f33f-49cf-82c2-a5b2dc09cf8f None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:51.718573 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97622ac7-f33f-49cf-82c2-a5b2dc09cf8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:51.718573 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97622ac7-f33f-49cf-82c2-a5b2dc09cf8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:51.718573 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97622ac7-f33f-49cf-82c2-a5b2dc09cf8f None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:51.719044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 390/802] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:44:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:51.719044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97622ac7-f33f-49cf-82c2-a5b2dc09cf8f None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:51.719171 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 413/803] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:44:51.719171 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad621bc-4d39-4280-9277-5088c9b763c5 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:51.786997 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:51.827993 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad621bc-4d39-4280-9277-5088c9b763c5 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:51.840286 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97622ac7-f33f-49cf-82c2-a5b2dc09cf8f None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:51.866034 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e2c81-4168-4552-9f38-132d547a983f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:51.866783 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e2c81-4168-4552-9f38-132d547a983f None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:51.867133 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e2c81-4168-4552-9f38-132d547a983f None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:51.867478 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e2c81-4168-4552-9f38-132d547a983f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:51.875661 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e2c81-4168-4552-9f38-132d547a983f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:51.878129 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e2c81-4168-4552-9f38-132d547a983f None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:51.881898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692bc96-6d5e-4266-9480-88a0c6995d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:51.882778 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692bc96-6d5e-4266-9480-88a0c6995d2e None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:51.883254 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692bc96-6d5e-4266-9480-88a0c6995d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:51.883710 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692bc96-6d5e-4266-9480-88a0c6995d2e None admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:51.884598 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692bc96-6d5e-4266-9480-88a0c6995d2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:51.885121 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692bc96-6d5e-4266-9480-88a0c6995d2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:51.886772 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692bc96-6d5e-4266-9480-88a0c6995d2e None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:51.892457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-e65e2c81-4168-4552-9f38-132d547a983f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 15:44:51.892457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:51.892457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:51.892457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:51.892457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:51.892457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:51.892457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:51.892457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:51.892457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:51.892457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:51.892457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:51.892457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:51.892457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:44:51.892457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:44:51.892457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:44:51.892457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:44:51.893445 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:51.893445 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:51.893445 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:44:51.893445 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:51.893445 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:44:51.893445 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:51.893445 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:51.893445 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:51.893445 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:51.893445 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:51.893445 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:51.893445 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:51.893445 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:51.893445 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:51.893445 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:51.893445 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:51.893445 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:51.893445 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:51.894377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:51.894377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:51.894377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:44:51.894377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:44:51.894377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:44:51.894377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:44:51.894377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:44:51.894377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:44:51.894377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 15:44:51.894377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:51.898623 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 414/804] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:44:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:51.899616 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e2c81-4168-4552-9f38-132d547a983f None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:51.905881 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 391/805] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:44:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:51.907033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692bc96-6d5e-4266-9480-88a0c6995d2e None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:51.972925 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:52.036713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e2c81-4168-4552-9f38-132d547a983f None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:52.042830 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692bc96-6d5e-4266-9480-88a0c6995d2e None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:52.058898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:52.071864 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c4882-6579-4220-9e1b-de71c0809a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:52.072499 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c4882-6579-4220-9e1b-de71c0809a11 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:52.072814 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c4882-6579-4220-9e1b-de71c0809a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:52.073089 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c4882-6579-4220-9e1b-de71c0809a11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:52.084589 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c4882-6579-4220-9e1b-de71c0809a11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:52.085411 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d67fd-4af7-45b9-880a-ffd52f18a1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:52.086026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d67fd-4af7-45b9-880a-ffd52f18a1b1 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:52.086122 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c4882-6579-4220-9e1b-de71c0809a11 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:52.086304 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d67fd-4af7-45b9-880a-ffd52f18a1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:52.086574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d67fd-4af7-45b9-880a-ffd52f18a1b1 None admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:52.087307 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d67fd-4af7-45b9-880a-ffd52f18a1b1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:52.087606 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d67fd-4af7-45b9-880a-ffd52f18a1b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:52.089144 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d67fd-4af7-45b9-880a-ffd52f18a1b1 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:52.105075 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-9b3c4882-6579-4220-9e1b-de71c0809a11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:52.105075 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:52.105075 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:52.105075 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:52.105075 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:52.105075 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:52.105075 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:52.105075 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:52.105075 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:52.105075 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:52.105075 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:52.105075 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:52.105075 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:52.105075 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:52.105075 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:52.105075 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:52.106254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:52.106254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:52.106254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:52.106254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:52.106254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:52.106254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:52.106254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:52.106254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:52.106254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:52.106254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:52.106254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:52.106254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:52.106254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:52.106254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:52.106254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:52.106254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:52.106254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:52.107597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:52.107597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:52.107597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:52.107597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 415/806] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:52.107597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c4882-6579-4220-9e1b-de71c0809a11 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:52.110121 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 392/807] 10.222.0.64 () {56 vars in 1135 bytes} [Wed Aug 24 15:44:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:52.111728 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad299d-1e3c-48bd-a50c-fc952c766951 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:52.112013 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad299d-1e3c-48bd-a50c-fc952c766951 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:52.112286 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad299d-1e3c-48bd-a50c-fc952c766951 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:52.113561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 393/808] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:52.114266 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad299d-1e3c-48bd-a50c-fc952c766951 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:52.214058 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:52.221284 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c4882-6579-4220-9e1b-de71c0809a11 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:52.230698 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad299d-1e3c-48bd-a50c-fc952c766951 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:52.256897 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2d254-5d49-4423-b4be-ec5f4a0cfd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:52.257568 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2d254-5d49-4423-b4be-ec5f4a0cfd24 None admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:52.257845 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2d254-5d49-4423-b4be-ec5f4a0cfd24 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:52.258115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2d254-5d49-4423-b4be-ec5f4a0cfd24 None admin] PATH_INFO: `/v3/projects/9b25a7c01ab540ceae16dd618b848f2d/users/eaf3821dd57a4d8f9ca6385c202bb0ed/roles/a74cbb295dd8432985940aa21806f970` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:52.267118 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8ed85-4e69-4350-bcfe-78f56df4df0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:52.268012 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8ed85-4e69-4350-bcfe-78f56df4df0d None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:52.268301 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8ed85-4e69-4350-bcfe-78f56df4df0d None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:52.268567 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8ed85-4e69-4350-bcfe-78f56df4df0d None admin] PATH_INFO: `/v3/services/network` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:52.269173 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8ed85-4e69-4350-bcfe-78f56df4df0d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:52.270551 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8ed85-4e69-4350-bcfe-78f56df4df0d None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:52.276339 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf2d254-5d49-4423-b4be-ec5f4a0cfd24 None admin] RBAC: Authorizing `identity:create_grant(project_id=9b25a7c01ab540ceae16dd618b848f2d, user_id=eaf3821dd57a4d8f9ca6385c202bb0ed, role_id=a74cbb295dd8432985940aa21806f970)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:52.278179 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf2d254-5d49-4423-b4be-ec5f4a0cfd24 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:52.280024 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-37b8ed85-4e69-4350-bcfe-78f56df4df0d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 15:44:52.280024 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:52.280024 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:44:52.280024 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:44:52.280024 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:44:52.280024 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:44:52.280024 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:44:52.280024 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:44:52.280024 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 15:44:52.280024 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:52.280024 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:44:52.280024 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:52.280024 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:52.280024 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:52.280024 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:52.280024 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:52.280024 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:52.281030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:52.281030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:52.281030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:52.281030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:52.281030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:52.281030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:52.281030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:44:52.281030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:44:52.281030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:44:52.281030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:44:52.281030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:52.281030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:52.281030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:52.281030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:52.281030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:52.281030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:52.281956 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:52.281956 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:52.281956 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:52.281956 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:52.281956 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:52.281956 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:52.281956 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:52.281956 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:52.281956 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:52.281956 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:52.281956 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:44:52.281956 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:44:52.281956 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 15:44:52.281956 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:52.287668 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 394/809] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:44:52 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:52.288587 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8ed85-4e69-4350-bcfe-78f56df4df0d None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:52.324507 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:52.341236 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 416/810] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 24 15:44:52 2022] PUT /identity/v3/projects/9b25a7c01ab540ceae16dd618b848f2d/users/eaf3821dd57a4d8f9ca6385c202bb0ed/roles/a74cbb295dd8432985940aa21806f970 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:44:52.342069 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2d254-5d49-4423-b4be-ec5f4a0cfd24 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:52.400763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8ed85-4e69-4350-bcfe-78f56df4df0d None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:52.445068 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c20ebe-c090-41fd-8715-949191650942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:52.445721 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c20ebe-c090-41fd-8715-949191650942 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:52.445998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c20ebe-c090-41fd-8715-949191650942 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:52.446269 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c20ebe-c090-41fd-8715-949191650942 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:52.459078 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c20ebe-c090-41fd-8715-949191650942 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:52.460546 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c20ebe-c090-41fd-8715-949191650942 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:52.478891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-73c20ebe-c090-41fd-8715-949191650942 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:52.478891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:52.478891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:52.478891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:52.478891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:52.478891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:52.478891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:52.478891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:52.478891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:52.478891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:52.478891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:52.478891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:52.478891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:52.478891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:52.478891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:52.478891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:52.479891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:52.479891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:52.479891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:52.479891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:52.479891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:52.479891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:52.479891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:52.479891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:52.479891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:52.479891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:52.479891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:52.479891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:52.479891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:52.479891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:52.479891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:52.479891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:52.479891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:52.480840 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:52.480840 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:52.480840 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:52.480840 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 395/811] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:52.481705 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b634cb-143e-4aa9-9c52-385bb03ba227 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:52.481705 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b634cb-143e-4aa9-9c52-385bb03ba227 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:52.481964 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b634cb-143e-4aa9-9c52-385bb03ba227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:52.501679 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2d254-5d49-4423-b4be-ec5f4a0cfd24 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:52.505417 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-c2b634cb-143e-4aa9-9c52-385bb03ba227 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:52.508678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-c2b634cb-143e-4aa9-9c52-385bb03ba227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:52.541940 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83370f7-a285-413f-9c80-430a769febbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:52.542645 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83370f7-a285-413f-9c80-430a769febbf None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:52.545374 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83370f7-a285-413f-9c80-430a769febbf None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:52.545374 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83370f7-a285-413f-9c80-430a769febbf None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:52.545374 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83370f7-a285-413f-9c80-430a769febbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:52.545374 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83370f7-a285-413f-9c80-430a769febbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:52.545766 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83370f7-a285-413f-9c80-430a769febbf None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:52.565522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 417/812] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:52.565522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83370f7-a285-413f-9c80-430a769febbf None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:52.570121 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:52.600935 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 396/813] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:44:52.602135 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b634cb-143e-4aa9-9c52-385bb03ba227 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:52.630994 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:52.684936 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83370f7-a285-413f-9c80-430a769febbf None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:52.733184 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110fac4-4021-457f-ad43-2695af105f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:52.734169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110fac4-4021-457f-ad43-2695af105f5c None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:52.734957 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110fac4-4021-457f-ad43-2695af105f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:52.735497 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110fac4-4021-457f-ad43-2695af105f5c None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:52.736368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e110fac4-4021-457f-ad43-2695af105f5c None admin] RBAC: Adding query filter params (name=network) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:52.737134 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e110fac4-4021-457f-ad43-2695af105f5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:52.739258 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e110fac4-4021-457f-ad43-2695af105f5c None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:52.750585 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 418/814] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 24 15:44:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:52.750585 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110fac4-4021-457f-ad43-2695af105f5c None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:52.755423 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b634cb-143e-4aa9-9c52-385bb03ba227 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:52.803048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639aaae7-ddf0-4013-bef0-5767c2e78cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:52.803048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639aaae7-ddf0-4013-bef0-5767c2e78cef None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:52.803356 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639aaae7-ddf0-4013-bef0-5767c2e78cef None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:52.803618 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639aaae7-ddf0-4013-bef0-5767c2e78cef None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:52.804200 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639aaae7-ddf0-4013-bef0-5767c2e78cef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:52.804501 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639aaae7-ddf0-4013-bef0-5767c2e78cef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:52.812682 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639aaae7-ddf0-4013-bef0-5767c2e78cef None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:52.823538 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 397/815] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:52.824398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639aaae7-ddf0-4013-bef0-5767c2e78cef None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:52.848520 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:52.895967 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110fac4-4021-457f-ad43-2695af105f5c None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:52.919485 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:52.936123 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196c15a-2380-4136-98f8-a19e1493379f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:52.936951 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196c15a-2380-4136-98f8-a19e1493379f None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:52.937330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196c15a-2380-4136-98f8-a19e1493379f None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:52.937708 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196c15a-2380-4136-98f8-a19e1493379f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:52.947181 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196c15a-2380-4136-98f8-a19e1493379f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:52.947377 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639aaae7-ddf0-4013-bef0-5767c2e78cef None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:52.948899 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196c15a-2380-4136-98f8-a19e1493379f None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:52.960680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-1196c15a-2380-4136-98f8-a19e1493379f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:44:52.960680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:52.960680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:52.960680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:52.960680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:52.960680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:52.960680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:52.960680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:52.960680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:52.960680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:52.960680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:52.960680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:52.960680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:44:52.960680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:44:52.960680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:44:52.960680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:44:52.961878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:52.961878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:52.961878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:44:52.961878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:52.961878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:44:52.961878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:52.961878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:52.961878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:52.961878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:52.961878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:52.961878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:52.961878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:52.961878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:52.961878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:52.961878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:52.961878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:52.961878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:52.961878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:52.963023 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:52.963023 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:52.963023 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:44:52.963023 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:44:52.963023 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:44:52.963023 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:44:52.963023 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:44:52.963023 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:44:52.963023 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:44:52.963023 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:52.964510 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 419/816] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 24 15:44:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:52.965426 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196c15a-2380-4136-98f8-a19e1493379f None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:53.003424 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e19c8-7cb4-487b-9068-2202d78f2e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:53.005078 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e19c8-7cb4-487b-9068-2202d78f2e4c None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:53.005360 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e19c8-7cb4-487b-9068-2202d78f2e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:53.005636 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e19c8-7cb4-487b-9068-2202d78f2e4c None admin] PATH_INFO: `/v3/services` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:53.006282 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e19c8-7cb4-487b-9068-2202d78f2e4c None admin] RBAC: Adding query filter params (type=network) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:53.006592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e19c8-7cb4-487b-9068-2202d78f2e4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:53.007983 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e19c8-7cb4-487b-9068-2202d78f2e4c None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:53.017865 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 398/817] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 24 15:44:52 2022] GET /identity/v3/services?type=network => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:53.017865 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e19c8-7cb4-487b-9068-2202d78f2e4c None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:53.084415 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196c15a-2380-4136-98f8-a19e1493379f None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:53.115176 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:53.120653 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f749b9b-2254-4520-b229-ff1d44e68cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:53.121427 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f749b9b-2254-4520-b229-ff1d44e68cca None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:53.121708 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f749b9b-2254-4520-b229-ff1d44e68cca None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:53.121981 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f749b9b-2254-4520-b229-ff1d44e68cca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:53.132654 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f749b9b-2254-4520-b229-ff1d44e68cca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:53.132654 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f749b9b-2254-4520-b229-ff1d44e68cca None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:53.143251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-3f749b9b-2254-4520-b229-ff1d44e68cca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:53.143251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:53.143251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:53.143251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:53.143251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:53.143251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:53.143251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:53.143251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:53.143251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:53.143251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:53.143251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:53.143251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:53.143251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:44:53.143251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:44:53.143251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:44:53.144328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:44:53.144328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:53.144328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:53.144328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:53.144328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:53.144328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:53.144328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:53.144328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:53.144328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:53.144328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:53.144328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:53.144328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:53.144328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:53.144328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:53.144328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:53.144328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:53.144328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:53.145422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:44:53.145422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:44:53.145422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:44:53.145422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:44:53.145422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:44:53.145422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:44:53.145422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:53.145422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:53.145964 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e19c8-7cb4-487b-9068-2202d78f2e4c None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:53.149320 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 420/818] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:44:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:53.150210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f749b9b-2254-4520-b229-ff1d44e68cca None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:53.186100 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b31a9-fcbf-4ddd-9f1a-26a3ad86aead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:53.186885 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b31a9-fcbf-4ddd-9f1a-26a3ad86aead None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:53.187235 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b31a9-fcbf-4ddd-9f1a-26a3ad86aead None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:53.187575 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b31a9-fcbf-4ddd-9f1a-26a3ad86aead None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:53.188232 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b31a9-fcbf-4ddd-9f1a-26a3ad86aead None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:53.190708 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b31a9-fcbf-4ddd-9f1a-26a3ad86aead None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:53.200667 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-b33b31a9-fcbf-4ddd-9f1a-26a3ad86aead None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 15:44:53.200667 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:53.200667 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:44:53.200667 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:44:53.200667 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:44:53.200667 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:44:53.200667 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:44:53.200667 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:44:53.200667 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 15:44:53.200667 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:53.200667 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:44:53.200667 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:53.200667 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:53.200667 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:53.200667 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:53.200667 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:53.200667 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:53.202017 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:53.202017 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:53.202017 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:53.202017 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:53.202017 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:53.202017 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:53.202017 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:44:53.202017 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:44:53.202017 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:44:53.202017 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:44:53.202017 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:53.202017 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:53.202017 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:53.202017 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:53.202017 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:53.202017 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:53.202831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:53.202831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:53.202831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:53.202831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:53.202831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:53.202831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:53.202831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:53.202831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:53.202831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:53.202831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:53.202831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:44:53.202831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:44:53.202831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 15:44:53.202831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:53.202831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 399/819] 10.222.0.64 () {56 vars in 1129 bytes} [Wed Aug 24 15:44:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:53.204370 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b31a9-fcbf-4ddd-9f1a-26a3ad86aead None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:53.215389 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:53.280314 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f749b9b-2254-4520-b229-ff1d44e68cca None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:53.322880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961592cc-37ac-437b-ac5d-76bf225a9435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:53.323499 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961592cc-37ac-437b-ac5d-76bf225a9435 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:53.323775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961592cc-37ac-437b-ac5d-76bf225a9435 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:53.324046 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961592cc-37ac-437b-ac5d-76bf225a9435 None admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:53.324821 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961592cc-37ac-437b-ac5d-76bf225a9435 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:53.325127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961592cc-37ac-437b-ac5d-76bf225a9435 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:53.326566 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961592cc-37ac-437b-ac5d-76bf225a9435 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:53.330285 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b31a9-fcbf-4ddd-9f1a-26a3ad86aead None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:53.353236 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 421/820] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 24 15:44:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:53.353236 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961592cc-37ac-437b-ac5d-76bf225a9435 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:53.372725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d702dd8-751b-46d1-96c3-d17a4c9b9e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:53.373430 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d702dd8-751b-46d1-96c3-d17a4c9b9e9d None admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:53.373797 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d702dd8-751b-46d1-96c3-d17a4c9b9e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:53.374154 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d702dd8-751b-46d1-96c3-d17a4c9b9e9d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:53.374875 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d702dd8-751b-46d1-96c3-d17a4c9b9e9d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:53.376442 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d702dd8-751b-46d1-96c3-d17a4c9b9e9d None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:53.405558 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:53.464826 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961592cc-37ac-437b-ac5d-76bf225a9435 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:53.499413 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 400/821] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 15:44:53 2022] POST /identity/v3/endpoints => generated 337 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:44:53.501311 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d702dd8-751b-46d1-96c3-d17a4c9b9e9d None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:53.518024 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2eb2b-4c2b-4b05-85c9-a3fc5b9f52ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:53.518863 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2eb2b-4c2b-4b05-85c9-a3fc5b9f52ca None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:53.519723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2eb2b-4c2b-4b05-85c9-a3fc5b9f52ca None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:53.520021 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2eb2b-4c2b-4b05-85c9-a3fc5b9f52ca None admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:53.521073 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2eb2b-4c2b-4b05-85c9-a3fc5b9f52ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:53.527661 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2eb2b-4c2b-4b05-85c9-a3fc5b9f52ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:53.527661 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2eb2b-4c2b-4b05-85c9-a3fc5b9f52ca None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:53.538277 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 422/822] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:44:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:53.539272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2eb2b-4c2b-4b05-85c9-a3fc5b9f52ca None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:53.586474 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:53.643257 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d702dd8-751b-46d1-96c3-d17a4c9b9e9d None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:53.666508 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2eb2b-4c2b-4b05-85c9-a3fc5b9f52ca None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:53.669528 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:53.691644 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1b5d9-eb94-4946-ac35-f3e2a5bb8bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:53.692270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1b5d9-eb94-4946-ac35-f3e2a5bb8bca None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:53.692548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1b5d9-eb94-4946-ac35-f3e2a5bb8bca None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:53.692850 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1b5d9-eb94-4946-ac35-f3e2a5bb8bca None admin] PATH_INFO: `/v3/services` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:53.694110 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a1b5d9-eb94-4946-ac35-f3e2a5bb8bca None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:53.694338 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a1b5d9-eb94-4946-ac35-f3e2a5bb8bca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:53.695932 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a1b5d9-eb94-4946-ac35-f3e2a5bb8bca None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:53.702058 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 401/823] 10.222.0.64 () {56 vars in 1124 bytes} [Wed Aug 24 15:44:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:53.702870 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1b5d9-eb94-4946-ac35-f3e2a5bb8bca None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:53.719429 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0258b-5de3-4821-b33d-44b7de23a5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:53.721420 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0258b-5de3-4821-b33d-44b7de23a5cd None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:53.722092 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0258b-5de3-4821-b33d-44b7de23a5cd None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:53.722995 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0258b-5de3-4821-b33d-44b7de23a5cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:53.838712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0258b-5de3-4821-b33d-44b7de23a5cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:53.841790 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0258b-5de3-4821-b33d-44b7de23a5cd None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:53.846779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1b5d9-eb94-4946-ac35-f3e2a5bb8bca None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:53.884484 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:53.913396 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60402dbb-21f9-47b6-ba2a-736a032a9f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:53.913396 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60402dbb-21f9-47b6-ba2a-736a032a9f82 None admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:53.913396 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60402dbb-21f9-47b6-ba2a-736a032a9f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:53.913396 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60402dbb-21f9-47b6-ba2a-736a032a9f82 None admin] PATH_INFO: `/v3/projects/9b25a7c01ab540ceae16dd618b848f2d/users/b3a0a84e4c4e47fc930881109fc07039/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:53.914105 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60402dbb-21f9-47b6-ba2a-736a032a9f82 None admin] RBAC: Authorizing `identity:create_grant(project_id=9b25a7c01ab540ceae16dd618b848f2d, user_id=b3a0a84e4c4e47fc930881109fc07039, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:53.914105 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60402dbb-21f9-47b6-ba2a-736a032a9f82 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:53.966262 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 423/824] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:44:53 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:44:53.967120 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0258b-5de3-4821-b33d-44b7de23a5cd None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:53.972333 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:53.988692 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 402/825] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 24 15:44:53 2022] PUT /identity/v3/projects/9b25a7c01ab540ceae16dd618b848f2d/users/b3a0a84e4c4e47fc930881109fc07039/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:44:53.988692 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60402dbb-21f9-47b6-ba2a-736a032a9f82 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:54.108128 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0258b-5de3-4821-b33d-44b7de23a5cd None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:54.123277 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60402dbb-21f9-47b6-ba2a-736a032a9f82 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:54.149365 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684e57d-1c50-4c7d-be11-b62505288113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:54.150001 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684e57d-1c50-4c7d-be11-b62505288113 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:54.150284 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684e57d-1c50-4c7d-be11-b62505288113 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:54.150559 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684e57d-1c50-4c7d-be11-b62505288113 None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:54.151216 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a684e57d-1c50-4c7d-be11-b62505288113 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:54.151524 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a684e57d-1c50-4c7d-be11-b62505288113 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:54.153268 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a684e57d-1c50-4c7d-be11-b62505288113 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:54.166416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 424/826] 10.222.0.64 () {56 vars in 1124 bytes} [Wed Aug 24 15:44:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:54.168871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684e57d-1c50-4c7d-be11-b62505288113 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:54.176269 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693e215-9287-4ece-bdc1-c8b659714312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:54.177063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693e215-9287-4ece-bdc1-c8b659714312 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:54.178045 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693e215-9287-4ece-bdc1-c8b659714312 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:54.178962 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693e215-9287-4ece-bdc1-c8b659714312 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:54.195979 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693e215-9287-4ece-bdc1-c8b659714312 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:54.197309 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693e215-9287-4ece-bdc1-c8b659714312 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:54.217229 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-7693e215-9287-4ece-bdc1-c8b659714312 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:54.217229 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:54.217229 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:54.217229 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:54.217229 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:54.217229 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:54.217229 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:54.217229 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:54.217229 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:54.217229 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:54.217229 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:54.217229 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:54.217229 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:54.217229 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:54.217229 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:54.217229 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:54.218273 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:54.218273 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:54.218273 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:54.218273 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:54.218273 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:54.218273 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:54.218273 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:54.218273 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:54.218273 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:54.218273 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:54.218273 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:54.218273 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:54.218273 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:54.218273 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:54.218273 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:54.218273 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:54.218273 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:54.220491 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:54.220491 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:54.220491 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:54.220491 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 403/827] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:54.225617 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693e215-9287-4ece-bdc1-c8b659714312 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:54.271029 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:54.278300 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:54.325215 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684e57d-1c50-4c7d-be11-b62505288113 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:54.342773 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693e215-9287-4ece-bdc1-c8b659714312 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:54.366709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22533171-874a-481c-a598-c8f9855e868e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:54.367557 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22533171-874a-481c-a598-c8f9855e868e None admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:54.367996 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22533171-874a-481c-a598-c8f9855e868e None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:54.368418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22533171-874a-481c-a598-c8f9855e868e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:54.369254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22533171-874a-481c-a598-c8f9855e868e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:54.370818 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22533171-874a-481c-a598-c8f9855e868e None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:54.380267 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9dd259-b52b-4da9-959b-2817ee942c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:54.380934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dd259-b52b-4da9-959b-2817ee942c40 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:54.381212 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dd259-b52b-4da9-959b-2817ee942c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:54.381483 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dd259-b52b-4da9-959b-2817ee942c40 None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:54.382134 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9dd259-b52b-4da9-959b-2817ee942c40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:54.382439 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9dd259-b52b-4da9-959b-2817ee942c40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:54.383849 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9dd259-b52b-4da9-959b-2817ee942c40 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:54.401264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 404/828] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:44:54.401264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db9fe5-ee7a-433b-95fb-f142a3546a2b None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:54.401264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db9fe5-ee7a-433b-95fb-f142a3546a2b None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:54.401264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db9fe5-ee7a-433b-95fb-f142a3546a2b None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:54.401264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 405/829] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:54.404830 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db9fe5-ee7a-433b-95fb-f142a3546a2b None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:54.466140 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 425/830] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 15:44:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:44:54.467741 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667ab6d-48a7-4369-9a1d-ddc52c0cf632 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:54.468172 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667ab6d-48a7-4369-9a1d-ddc52c0cf632 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:54.468647 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667ab6d-48a7-4369-9a1d-ddc52c0cf632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:54.496333 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-1667ab6d-48a7-4369-9a1d-ddc52c0cf632 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:54.498285 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-1667ab6d-48a7-4369-9a1d-ddc52c0cf632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:54.528516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:54.542884 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db9fe5-ee7a-433b-95fb-f142a3546a2b None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:54.589021 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8a859-6469-4802-949b-4e8486ef7a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:54.589779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8a859-6469-4802-949b-4e8486ef7a0a None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:54.590138 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8a859-6469-4802-949b-4e8486ef7a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:54.590821 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8a859-6469-4802-949b-4e8486ef7a0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:54.602992 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d8a859-6469-4802-949b-4e8486ef7a0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:54.604587 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d8a859-6469-4802-949b-4e8486ef7a0a None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:54.608771 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 426/831] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:44:54.618984 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-38d8a859-6469-4802-949b-4e8486ef7a0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:54.618984 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:54.618984 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:54.618984 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:54.618984 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:54.618984 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:54.618984 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:54.618984 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:54.618984 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:54.618984 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:54.618984 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:54.618984 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:54.618984 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:44:54.618984 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:44:54.618984 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:44:54.620562 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:44:54.620562 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:54.620562 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:54.620562 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:54.620562 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:54.620562 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:54.620562 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:54.620562 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:54.620562 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:54.620562 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:54.620562 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:54.620562 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:54.620562 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:54.620562 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:54.620562 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:54.620562 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:54.620562 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:54.622123 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:44:54.622123 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:44:54.622123 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:44:54.622123 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:44:54.622123 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:44:54.622123 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:44:54.622123 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:54.622123 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:54.628683 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 406/832] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:44:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:54.629972 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667ab6d-48a7-4369-9a1d-ddc52c0cf632 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:54.699215 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:54.756691 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667ab6d-48a7-4369-9a1d-ddc52c0cf632 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:54.794987 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0113372-4cc1-470f-a418-fc0dbab79b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:54.796010 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0113372-4cc1-470f-a418-fc0dbab79b68 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:54.796511 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0113372-4cc1-470f-a418-fc0dbab79b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:54.797286 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0113372-4cc1-470f-a418-fc0dbab79b68 None admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:54.798902 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0113372-4cc1-470f-a418-fc0dbab79b68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:54.799540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0113372-4cc1-470f-a418-fc0dbab79b68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:54.801256 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0113372-4cc1-470f-a418-fc0dbab79b68 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:54.815517 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 427/833] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:44:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:54.821080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8a859-6469-4802-949b-4e8486ef7a0a None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:54.897338 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0113372-4cc1-470f-a418-fc0dbab79b68 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:54.946420 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8a859-6469-4802-949b-4e8486ef7a0a None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:54.984144 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46909a65-dfbe-46de-b816-4a6561018544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:54.985297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46909a65-dfbe-46de-b816-4a6561018544 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:54.985865 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46909a65-dfbe-46de-b816-4a6561018544 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:54.986452 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46909a65-dfbe-46de-b816-4a6561018544 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:54.987394 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46909a65-dfbe-46de-b816-4a6561018544 None admin] RBAC: Adding query filter params (role.id=c6745e08f9da4a2bae8510c9983635c3, scope.project.id=9b25a7c01ab540ceae16dd618b848f2d, user.id=e5f0d8fe42e74d68bfa9a0e365bab4b6) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:54.987907 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46909a65-dfbe-46de-b816-4a6561018544 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:54.989633 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46909a65-dfbe-46de-b816-4a6561018544 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:54.997096 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 407/834] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:44:54 2022] GET /identity/v3/role_assignments?user.id=e5f0d8fe42e74d68bfa9a0e365bab4b6&scope.project.id=9b25a7c01ab540ceae16dd618b848f2d&role.id=c6745e08f9da4a2bae8510c9983635c3 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:44:55.011264 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0113372-4cc1-470f-a418-fc0dbab79b68 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:55.029102 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:55.053112 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36635cef-3ed9-4ef9-a955-2162b7c53c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:55.053783 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36635cef-3ed9-4ef9-a955-2162b7c53c66 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:55.054068 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36635cef-3ed9-4ef9-a955-2162b7c53c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:55.054340 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36635cef-3ed9-4ef9-a955-2162b7c53c66 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:55.068442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36635cef-3ed9-4ef9-a955-2162b7c53c66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:55.073749 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-36635cef-3ed9-4ef9-a955-2162b7c53c66 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:55.073749 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:55.073749 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:55.073749 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:55.073749 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:55.073749 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:55.073749 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:55.073749 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:55.073749 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:55.073749 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:55.073749 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:55.073749 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:55.073749 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:55.073749 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:55.073749 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:55.073749 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:55.074756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:55.074756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:55.074756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:55.074756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:55.074756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:55.074756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:55.074756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:55.074756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:55.074756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:55.074756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:55.074756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:55.074756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:55.074756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:55.074756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:55.074756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:55.074756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:55.075593 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:55.075593 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:55.075593 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:55.075593 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:55.075593 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:55.075593 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:55.075593 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:55.075593 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:55.075593 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:55.075593 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:55.075593 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:44:55.075593 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:55.075593 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 428/835] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 24 15:44:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:55.085158 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46909a65-dfbe-46de-b816-4a6561018544 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:55.108070 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:55.212982 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46909a65-dfbe-46de-b816-4a6561018544 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:55.252365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e6e79-56d8-4e82-a913-2809d5ce668a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:55.253021 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e6e79-56d8-4e82-a913-2809d5ce668a None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:55.253302 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e6e79-56d8-4e82-a913-2809d5ce668a None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:55.253582 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e6e79-56d8-4e82-a913-2809d5ce668a None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:55.254256 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e6e79-56d8-4e82-a913-2809d5ce668a None admin] RBAC: Adding query filter params (name=service) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:55.254561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e6e79-56d8-4e82-a913-2809d5ce668a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:55.255930 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e6e79-56d8-4e82-a913-2809d5ce668a None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:55.266165 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 408/836] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 24 15:44:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:44:55.271293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36635cef-3ed9-4ef9-a955-2162b7c53c66 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:55.386594 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36635cef-3ed9-4ef9-a955-2162b7c53c66 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:55.427563 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf422d9-f2fb-4eb9-a538-689e03d4feed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:55.428364 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf422d9-f2fb-4eb9-a538-689e03d4feed None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:55.428774 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf422d9-f2fb-4eb9-a538-689e03d4feed None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:55.429147 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf422d9-f2fb-4eb9-a538-689e03d4feed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:55.441658 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf422d9-f2fb-4eb9-a538-689e03d4feed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:55.443280 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf422d9-f2fb-4eb9-a538-689e03d4feed None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:55.458484 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-3bf422d9-f2fb-4eb9-a538-689e03d4feed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:55.458484 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:55.458484 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:55.458484 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:55.458484 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:55.458484 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:55.458484 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:55.458484 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:55.458484 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:55.458484 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:55.458484 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:55.458484 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:55.458484 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:55.458484 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:55.458484 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:55.458484 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:55.459678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:55.459678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:55.459678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:55.459678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:55.459678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:55.459678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:55.459678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:55.459678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:55.459678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:55.459678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:55.459678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:55.459678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:55.459678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:55.459678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:55.459678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:55.459678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:55.459678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:55.460849 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:55.460849 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:55.460849 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:55.462208 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 429/837] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:55.467836 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e6e79-56d8-4e82-a913-2809d5ce668a None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:55.563221 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:55.583807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e6e79-56d8-4e82-a913-2809d5ce668a None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:55.621359 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a548b1-d48c-453f-aa46-dd1f459be7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:55.622230 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a548b1-d48c-453f-aa46-dd1f459be7db None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:55.622662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a548b1-d48c-453f-aa46-dd1f459be7db None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:55.623116 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a548b1-d48c-453f-aa46-dd1f459be7db None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:55.623911 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a548b1-d48c-453f-aa46-dd1f459be7db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:55.624395 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a548b1-d48c-453f-aa46-dd1f459be7db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:55.626120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a548b1-d48c-453f-aa46-dd1f459be7db None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:55.639512 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 409/838] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:55.645770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf422d9-f2fb-4eb9-a538-689e03d4feed None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:55.694776 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:55.770120 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf422d9-f2fb-4eb9-a538-689e03d4feed None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:55.809233 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0c7a6-6706-41a5-bfea-1987009e8b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:55.809884 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0c7a6-6706-41a5-bfea-1987009e8b8f None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:55.810159 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0c7a6-6706-41a5-bfea-1987009e8b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:55.810428 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0c7a6-6706-41a5-bfea-1987009e8b8f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:55.819395 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0c7a6-6706-41a5-bfea-1987009e8b8f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:55.820810 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0c7a6-6706-41a5-bfea-1987009e8b8f None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:55.833522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-4fc0c7a6-6706-41a5-bfea-1987009e8b8f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 15:44:55.833522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:55.833522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:55.833522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:55.833522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:55.833522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:55.833522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:55.833522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:55.833522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:55.833522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:55.833522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:55.833522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:55.833522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:44:55.833522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:44:55.833522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:44:55.833522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:44:55.834541 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:55.834541 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:55.834541 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:44:55.834541 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:55.834541 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:44:55.834541 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:55.834541 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:55.834541 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:55.834541 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:55.834541 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:55.834541 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:55.834541 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:55.834541 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:55.834541 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:55.834541 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:55.834541 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:55.834541 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:55.834541 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:55.835473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:55.835473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:55.835473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:44:55.835473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:44:55.835473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:44:55.835473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:44:55.835473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:44:55.835473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:44:55.835473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 15:44:55.835473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:55.835473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 430/839] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 24 15:44:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:55.840350 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a548b1-d48c-453f-aa46-dd1f459be7db None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:55.950157 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a548b1-d48c-453f-aa46-dd1f459be7db None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:55.986399 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254847c-9579-4618-975d-1a11caf49106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:55.987014 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254847c-9579-4618-975d-1a11caf49106 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:55.987297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254847c-9579-4618-975d-1a11caf49106 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:55.987574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254847c-9579-4618-975d-1a11caf49106 None admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:55.988308 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254847c-9579-4618-975d-1a11caf49106 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:55.988613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254847c-9579-4618-975d-1a11caf49106 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:55.990082 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254847c-9579-4618-975d-1a11caf49106 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:55.999907 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:56.012757 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 410/840] 10.222.0.64 () {56 vars in 1149 bytes} [Wed Aug 24 15:44:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:44:56.014876 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0c7a6-6706-41a5-bfea-1987009e8b8f None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:56.110881 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572433ee-36fb-4556-b643-46d4750f727f None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:56.111443 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572433ee-36fb-4556-b643-46d4750f727f None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:56.111913 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572433ee-36fb-4556-b643-46d4750f727f None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:56.113714 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 411/841] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:56.116735 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:56.119596 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b3d54-9ad1-419b-8dba-b621fdb16a49 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:56.120121 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b3d54-9ad1-419b-8dba-b621fdb16a49 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:56.120652 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b3d54-9ad1-419b-8dba-b621fdb16a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:56.133033 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0c7a6-6706-41a5-bfea-1987009e8b8f None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:56.140268 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-541b3d54-9ad1-419b-8dba-b621fdb16a49 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:56.142331 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-541b3d54-9ad1-419b-8dba-b621fdb16a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:56.173421 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0d790-4dcb-44ab-89d2-f9a8461dbc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:56.174066 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0d790-4dcb-44ab-89d2-f9a8461dbc98 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:56.174357 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0d790-4dcb-44ab-89d2-f9a8461dbc98 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:56.174632 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0d790-4dcb-44ab-89d2-f9a8461dbc98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:56.225050 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 412/842] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:44:56.254602 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0d790-4dcb-44ab-89d2-f9a8461dbc98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:56.256109 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0d790-4dcb-44ab-89d2-f9a8461dbc98 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:56.360106 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:56.378359 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 431/843] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:44:56 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:44:56.384105 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b3d54-9ad1-419b-8dba-b621fdb16a49 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:56.496818 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b3d54-9ad1-419b-8dba-b621fdb16a49 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:56.504785 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0d790-4dcb-44ab-89d2-f9a8461dbc98 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:56.524551 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:56.533956 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f1dd4-5b87-49be-bf9c-7c1fc1dd917e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:56.534624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f1dd4-5b87-49be-bf9c-7c1fc1dd917e None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:56.534910 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f1dd4-5b87-49be-bf9c-7c1fc1dd917e None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:56.535187 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f1dd4-5b87-49be-bf9c-7c1fc1dd917e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:56.548691 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f1dd4-5b87-49be-bf9c-7c1fc1dd917e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:56.550241 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f1dd4-5b87-49be-bf9c-7c1fc1dd917e None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:56.568653 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-8b8f1dd4-5b87-49be-bf9c-7c1fc1dd917e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:56.568653 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:56.568653 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:56.568653 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:56.568653 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:56.568653 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:56.568653 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:56.568653 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:56.568653 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:56.568653 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:56.568653 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:56.568653 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:56.568653 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:56.568653 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:56.568653 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:56.568653 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:56.569671 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:56.569671 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:56.569671 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:56.569671 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:56.569671 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:56.569671 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:56.569671 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:56.569671 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:56.569671 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:56.569671 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:56.569671 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:56.569671 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:56.569671 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:56.569671 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:56.569671 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:56.569671 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:56.569671 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:56.570540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:56.570540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:56.570540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:56.570540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 413/844] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:56.575186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f1dd4-5b87-49be-bf9c-7c1fc1dd917e None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:56.638179 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0d790-4dcb-44ab-89d2-f9a8461dbc98 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:56.687564 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad30960-6897-4e0c-b853-1df200656bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:56.688996 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad30960-6897-4e0c-b853-1df200656bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:56.689826 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad30960-6897-4e0c-b853-1df200656bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:56.690330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad30960-6897-4e0c-b853-1df200656bb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:56.705669 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f1dd4-5b87-49be-bf9c-7c1fc1dd917e None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:56.709020 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad30960-6897-4e0c-b853-1df200656bb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:44:56.713967 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-8ad30960-6897-4e0c-b853-1df200656bb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:44:56.713967 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:56.713967 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:56.713967 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:56.713967 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:56.713967 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:56.713967 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:56.713967 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:56.713967 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:56.713967 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:56.713967 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:56.713967 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:56.713967 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:44:56.713967 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:44:56.713967 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:44:56.713967 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:44:56.716456 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:44:56.716456 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:44:56.716456 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:44:56.716456 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:44:56.716456 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:56.716456 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:56.716456 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:56.716456 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:56.716456 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:56.716456 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:56.716456 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:56.716456 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:56.716456 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:56.716456 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:56.716456 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:56.716456 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:56.717592 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:56.717592 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:56.717592 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:56.717592 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:56.717592 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:44:56.717592 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:44:56.717592 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:44:56.717592 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:44:56.717592 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:44:56.717592 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:44:56.717592 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:44:56.717592 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:56.717592 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 432/845] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:44:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:56.721685 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad30960-6897-4e0c-b853-1df200656bb6 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:56.757219 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5db2a4-8bec-4c0b-8332-55fe33d88ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:56.757953 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5db2a4-8bec-4c0b-8332-55fe33d88ef1 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:56.758556 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5db2a4-8bec-4c0b-8332-55fe33d88ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:56.758906 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5db2a4-8bec-4c0b-8332-55fe33d88ef1 None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:56.760138 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5db2a4-8bec-4c0b-8332-55fe33d88ef1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:56.760547 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5db2a4-8bec-4c0b-8332-55fe33d88ef1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:56.762429 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5db2a4-8bec-4c0b-8332-55fe33d88ef1 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:56.780895 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:56.784966 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 414/846] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:44:56.788509 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd67798-ef3f-4f0a-bcd4-7561100da688 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:56.788841 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd67798-ef3f-4f0a-bcd4-7561100da688 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:56.789123 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd67798-ef3f-4f0a-bcd4-7561100da688 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:56.792769 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 415/847] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:44:56.792769 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd67798-ef3f-4f0a-bcd4-7561100da688 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:56.847214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:56.852305 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad30960-6897-4e0c-b853-1df200656bb6 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:56.895533 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11008bcf-c15a-4a78-86fc-79fb28b71591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:56.896434 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11008bcf-c15a-4a78-86fc-79fb28b71591 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:56.896946 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11008bcf-c15a-4a78-86fc-79fb28b71591 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:56.897216 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11008bcf-c15a-4a78-86fc-79fb28b71591 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:56.897884 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11008bcf-c15a-4a78-86fc-79fb28b71591 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:56.898187 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11008bcf-c15a-4a78-86fc-79fb28b71591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:56.899582 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11008bcf-c15a-4a78-86fc-79fb28b71591 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:56.915155 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 433/848] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:44:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:56.915155 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e34e3-506f-4f1a-a12d-0ff3d2b33ba9 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:56.915155 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e34e3-506f-4f1a-a12d-0ff3d2b33ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:56.915155 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e34e3-506f-4f1a-a12d-0ff3d2b33ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:56.925295 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd67798-ef3f-4f0a-bcd4-7561100da688 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:56.983703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e152a86-b4dd-41be-bb89-e507547f1489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:56.984831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e152a86-b4dd-41be-bb89-e507547f1489 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:56.986020 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e152a86-b4dd-41be-bb89-e507547f1489 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:56.986506 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e152a86-b4dd-41be-bb89-e507547f1489 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:56.999718 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e152a86-b4dd-41be-bb89-e507547f1489 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:57.002549 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e152a86-b4dd-41be-bb89-e507547f1489 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:57.024654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-9e152a86-b4dd-41be-bb89-e507547f1489 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:57.024654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:57.024654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:57.024654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:57.024654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:57.024654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:57.024654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:57.024654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:57.024654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:57.024654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:57.024654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:57.024654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:57.024654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:44:57.024654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:44:57.024654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:44:57.025613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:44:57.025613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:57.025613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:57.025613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:57.025613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:57.025613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:57.025613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:57.025613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:57.025613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:57.025613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:57.025613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:57.025613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:57.025613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:57.025613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:57.025613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:57.025613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:57.025613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:57.026499 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:44:57.026499 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:44:57.026499 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:44:57.026499 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:44:57.026499 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:44:57.026499 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:44:57.026499 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:57.026499 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:57.027475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 416/849] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:44:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:57.028870 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e152a86-b4dd-41be-bb89-e507547f1489 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:57.053572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-a38e34e3-506f-4f1a-a12d-0ff3d2b33ba9 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:57.054953 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-a38e34e3-506f-4f1a-a12d-0ff3d2b33ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:57.128688 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 434/850] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:44:57.128688 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e34e3-506f-4f1a-a12d-0ff3d2b33ba9 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:57.174512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:57.193594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:57.197171 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e152a86-b4dd-41be-bb89-e507547f1489 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:57.237543 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e34e3-506f-4f1a-a12d-0ff3d2b33ba9 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:57.239230 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f8301-cfc2-4ac5-a4c8-271d805e2bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:57.239898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f8301-cfc2-4ac5-a4c8-271d805e2bff None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:57.240205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f8301-cfc2-4ac5-a4c8-271d805e2bff None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:57.241213 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f8301-cfc2-4ac5-a4c8-271d805e2bff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:57.252773 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f8301-cfc2-4ac5-a4c8-271d805e2bff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:57.254424 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f8301-cfc2-4ac5-a4c8-271d805e2bff None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:57.270044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-693f8301-cfc2-4ac5-a4c8-271d805e2bff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:57.270044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:57.270044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:57.270044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:57.270044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:57.270044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:57.270044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:57.270044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:57.270044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:57.270044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:57.270044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:57.270044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:57.270044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:57.270044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:57.270044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:57.270044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:57.271298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:57.271298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:57.271298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:57.271298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:57.271298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:57.271298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:57.271298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:57.271298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:57.271298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:57.271298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:57.271298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:57.271298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:57.271298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:57.271298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:57.271298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:57.271298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:57.271298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:57.272374 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:57.272374 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:57.272374 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:57.277418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 417/851] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:57.277418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10da229-e0b3-4fb8-ab57-93b3e91492b0 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:57.277418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10da229-e0b3-4fb8-ab57-93b3e91492b0 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:57.277418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10da229-e0b3-4fb8-ab57-93b3e91492b0 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:57.277418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 418/852] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:57.282684 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10da229-e0b3-4fb8-ab57-93b3e91492b0 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:57.292234 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a12ad-3aa4-413e-a4c3-ee8e4b310c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:57.292974 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a12ad-3aa4-413e-a4c3-ee8e4b310c28 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:57.293331 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a12ad-3aa4-413e-a4c3-ee8e4b310c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:57.293680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a12ad-3aa4-413e-a4c3-ee8e4b310c28 None admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:57.294461 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a12ad-3aa4-413e-a4c3-ee8e4b310c28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:57.294878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a12ad-3aa4-413e-a4c3-ee8e4b310c28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:57.300011 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a12ad-3aa4-413e-a4c3-ee8e4b310c28 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:57.314435 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 435/853] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:44:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:57.314435 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c82a6-57e1-40c2-9578-f569a5609862 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:57.314435 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c82a6-57e1-40c2-9578-f569a5609862 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:57.315029 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c82a6-57e1-40c2-9578-f569a5609862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:57.338106 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-b17c82a6-57e1-40c2-9578-f569a5609862 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:57.339461 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-b17c82a6-57e1-40c2-9578-f569a5609862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:57.411318 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10da229-e0b3-4fb8-ab57-93b3e91492b0 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:57.414243 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 436/854] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:44:57.415091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c82a6-57e1-40c2-9578-f569a5609862 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:57.449356 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:57.460000 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa62050-d745-4599-8d2a-e599380ecba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:57.460611 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa62050-d745-4599-8d2a-e599380ecba3 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:57.462123 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa62050-d745-4599-8d2a-e599380ecba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:57.462123 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa62050-d745-4599-8d2a-e599380ecba3 None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:57.462123 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa62050-d745-4599-8d2a-e599380ecba3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:57.462123 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa62050-d745-4599-8d2a-e599380ecba3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:57.463505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa62050-d745-4599-8d2a-e599380ecba3 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:57.480943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 419/855] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:57.480943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa62050-d745-4599-8d2a-e599380ecba3 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:57.498558 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:57.549177 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c82a6-57e1-40c2-9578-f569a5609862 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:57.585483 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f1e54-dfb7-45cc-8637-765d8a9aa9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:57.586238 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f1e54-dfb7-45cc-8637-765d8a9aa9c6 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:57.586583 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f1e54-dfb7-45cc-8637-765d8a9aa9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:57.586932 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f1e54-dfb7-45cc-8637-765d8a9aa9c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:57.587735 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f1e54-dfb7-45cc-8637-765d8a9aa9c6 None admin] RBAC: Adding query filter params (role.id=a74cbb295dd8432985940aa21806f970, scope.project.id=9b25a7c01ab540ceae16dd618b848f2d, user.id=eaf3821dd57a4d8f9ca6385c202bb0ed) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:57.588123 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f1e54-dfb7-45cc-8637-765d8a9aa9c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:57.589685 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f1e54-dfb7-45cc-8637-765d8a9aa9c6 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:57.608668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 437/856] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:44:57 2022] GET /identity/v3/role_assignments?user.id=eaf3821dd57a4d8f9ca6385c202bb0ed&scope.project.id=9b25a7c01ab540ceae16dd618b848f2d&role.id=a74cbb295dd8432985940aa21806f970 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:57.608668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f1e54-dfb7-45cc-8637-765d8a9aa9c6 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:57.614632 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa62050-d745-4599-8d2a-e599380ecba3 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:57.660799 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cab66-f8bf-44a8-bff6-1e76c6388a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:57.661768 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cab66-f8bf-44a8-bff6-1e76c6388a9a None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:57.662604 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cab66-f8bf-44a8-bff6-1e76c6388a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:57.662896 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cab66-f8bf-44a8-bff6-1e76c6388a9a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:57.663717 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cab66-f8bf-44a8-bff6-1e76c6388a9a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:57.665699 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cab66-f8bf-44a8-bff6-1e76c6388a9a None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:57.679722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-c91cab66-f8bf-44a8-bff6-1e76c6388a9a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 15:44:57.679722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:57.679722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:44:57.679722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:44:57.679722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:44:57.679722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:44:57.679722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:44:57.679722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:44:57.679722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 15:44:57.679722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:57.679722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:44:57.679722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:57.679722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:57.679722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:57.679722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:57.679722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:57.679722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:57.681056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:57.681056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:57.681056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:57.681056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:57.681056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:57.681056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:57.681056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:44:57.681056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:44:57.681056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:44:57.681056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:44:57.681056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:57.681056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:57.681056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:57.681056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:57.681056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:57.681056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:57.681901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:57.681901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:57.681901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:57.681901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:57.681901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:57.681901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:57.681901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:57.681901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:57.681901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:57.681901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:57.681901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:44:57.681901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:44:57.681901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 15:44:57.681901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:57.681901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 420/857] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 24 15:44:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:57.687028 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cab66-f8bf-44a8-bff6-1e76c6388a9a None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:57.726442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:57.738598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f1e54-dfb7-45cc-8637-765d8a9aa9c6 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:57.779412 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:57.787877 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e93bdc-7497-4c9e-b72c-6910dbf95770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:57.788602 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e93bdc-7497-4c9e-b72c-6910dbf95770 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:57.789092 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e93bdc-7497-4c9e-b72c-6910dbf95770 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:57.789294 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e93bdc-7497-4c9e-b72c-6910dbf95770 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:57.799099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e93bdc-7497-4c9e-b72c-6910dbf95770 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:57.799918 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e93bdc-7497-4c9e-b72c-6910dbf95770 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:57.808156 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cab66-f8bf-44a8-bff6-1e76c6388a9a None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:57.812473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-72e93bdc-7497-4c9e-b72c-6910dbf95770 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 15:44:57.812473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:57.812473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:57.812473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:57.812473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:57.812473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:57.812473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:57.812473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:57.812473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:57.812473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:57.812473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:57.812473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:57.812473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:44:57.812473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:44:57.812473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:44:57.812473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:44:57.815637 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:57.815637 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:57.815637 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:44:57.815637 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:57.815637 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:44:57.815637 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:44:57.815637 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:57.815637 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:57.815637 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:57.815637 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:57.815637 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:57.815637 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:57.815637 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:57.815637 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:57.815637 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:57.815637 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:57.815637 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:57.815637 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:57.816606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:57.816606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:57.816606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:44:57.816606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:44:57.816606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:44:57.816606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:44:57.816606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:44:57.816606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:44:57.816606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 15:44:57.816606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:44:57.816606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 438/858] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:44:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:57.816606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e93bdc-7497-4c9e-b72c-6910dbf95770 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:57.849846 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534555d9-bb74-4811-ad07-ff0d4db24aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:57.850783 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534555d9-bb74-4811-ad07-ff0d4db24aac None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:57.851192 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534555d9-bb74-4811-ad07-ff0d4db24aac None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:57.851606 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534555d9-bb74-4811-ad07-ff0d4db24aac None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:57.852329 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534555d9-bb74-4811-ad07-ff0d4db24aac None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:57.853949 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534555d9-bb74-4811-ad07-ff0d4db24aac None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:57.864593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-534555d9-bb74-4811-ad07-ff0d4db24aac None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 15:44:57.864593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:57.864593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:44:57.864593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:44:57.864593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:44:57.864593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:44:57.864593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:44:57.864593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:44:57.864593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 15:44:57.864593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:57.864593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:44:57.864593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:57.864593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:57.864593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:57.864593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:57.864593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:57.866593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:57.866593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:57.866593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:57.866593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:57.866593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:57.866593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:57.866593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:57.866593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:44:57.866593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:44:57.866593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:44:57.866593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:44:57.866593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:57.866593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:57.866593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:57.866593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:57.866593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:57.866593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:57.867800 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:57.867800 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:57.867800 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:57.867800 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:57.867800 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:57.867800 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:57.867800 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:57.867800 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:57.867800 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:57.867800 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:57.867800 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:44:57.867800 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:44:57.867800 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 15:44:57.867800 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:57.867800 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 421/859] 10.222.0.64 () {56 vars in 1132 bytes} [Wed Aug 24 15:44:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:44:57.868804 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534555d9-bb74-4811-ad07-ff0d4db24aac None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:57.948408 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e93bdc-7497-4c9e-b72c-6910dbf95770 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:57.986753 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534555d9-bb74-4811-ad07-ff0d4db24aac None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:57.992538 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940edf10-57e0-4697-b1c1-1fdfe036135f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:57.993197 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940edf10-57e0-4697-b1c1-1fdfe036135f None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:57.993478 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940edf10-57e0-4697-b1c1-1fdfe036135f None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:57.993748 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940edf10-57e0-4697-b1c1-1fdfe036135f None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:57.994759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940edf10-57e0-4697-b1c1-1fdfe036135f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:57.994921 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940edf10-57e0-4697-b1c1-1fdfe036135f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:57.996270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940edf10-57e0-4697-b1c1-1fdfe036135f None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:58.007286 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 439/860] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 24 15:44:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:58.007286 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940edf10-57e0-4697-b1c1-1fdfe036135f None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:58.029019 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:58.030805 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e517f3-c8bf-4e93-8f34-5fe856558585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:58.031603 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e517f3-c8bf-4e93-8f34-5fe856558585 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:58.032189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e517f3-c8bf-4e93-8f34-5fe856558585 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:58.032675 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e517f3-c8bf-4e93-8f34-5fe856558585 None admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:58.033651 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e517f3-c8bf-4e93-8f34-5fe856558585 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:58.033987 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e517f3-c8bf-4e93-8f34-5fe856558585 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:58.035525 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e517f3-c8bf-4e93-8f34-5fe856558585 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:58.046906 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:58.060141 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 422/861] 10.222.0.64 () {56 vars in 1135 bytes} [Wed Aug 24 15:44:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:58.060141 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e517f3-c8bf-4e93-8f34-5fe856558585 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:58.128542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940edf10-57e0-4697-b1c1-1fdfe036135f None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:58.170034 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46170442-5f30-453b-bcc6-ac2451fab484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:58.170645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e517f3-c8bf-4e93-8f34-5fe856558585 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:58.170771 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46170442-5f30-453b-bcc6-ac2451fab484 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:58.170935 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46170442-5f30-453b-bcc6-ac2451fab484 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:58.171183 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46170442-5f30-453b-bcc6-ac2451fab484 None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:58.171812 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46170442-5f30-453b-bcc6-ac2451fab484 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:58.172268 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46170442-5f30-453b-bcc6-ac2451fab484 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:58.175463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46170442-5f30-453b-bcc6-ac2451fab484 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:58.185426 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 440/862] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 24 15:44:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:58.185426 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46170442-5f30-453b-bcc6-ac2451fab484 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:58.212141 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c6aa5-a936-4603-b0de-86187bda94be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:58.213196 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c6aa5-a936-4603-b0de-86187bda94be None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:58.213689 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c6aa5-a936-4603-b0de-86187bda94be None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:58.214118 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c6aa5-a936-4603-b0de-86187bda94be None admin] PATH_INFO: `/v3/services` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:58.215145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c6aa5-a936-4603-b0de-86187bda94be None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:58.215648 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c6aa5-a936-4603-b0de-86187bda94be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:58.217957 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c6aa5-a936-4603-b0de-86187bda94be None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:58.223558 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 423/863] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 24 15:44:58 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:58.231210 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c6aa5-a936-4603-b0de-86187bda94be None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:58.289607 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:58.311797 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46170442-5f30-453b-bcc6-ac2451fab484 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:58.335091 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:58.359026 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be443c-68ac-4ecc-9eaf-eb29f219842e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:58.360359 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be443c-68ac-4ecc-9eaf-eb29f219842e None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:58.360972 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be443c-68ac-4ecc-9eaf-eb29f219842e None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:58.361533 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be443c-68ac-4ecc-9eaf-eb29f219842e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:58.404011 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c6aa5-a936-4603-b0de-86187bda94be None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:58.445151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6b81b-b90b-4bdb-a874-cffab74ef61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:58.445768 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6b81b-b90b-4bdb-a874-cffab74ef61f None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:58.446063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6b81b-b90b-4bdb-a874-cffab74ef61f None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:58.446327 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6b81b-b90b-4bdb-a874-cffab74ef61f None admin] PATH_INFO: `/v3/services` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:58.446977 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6b81b-b90b-4bdb-a874-cffab74ef61f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:58.447283 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6b81b-b90b-4bdb-a874-cffab74ef61f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:58.448746 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6b81b-b90b-4bdb-a874-cffab74ef61f None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:58.453922 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 424/864] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 24 15:44:58 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:58.461021 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be443c-68ac-4ecc-9eaf-eb29f219842e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:58.462526 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be443c-68ac-4ecc-9eaf-eb29f219842e None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:58.567303 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:58.589855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 441/865] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:44:58 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:44:58.596254 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6b81b-b90b-4bdb-a874-cffab74ef61f None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:58.711967 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6b81b-b90b-4bdb-a874-cffab74ef61f None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:58.741376 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:58.750445 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc387008-d98e-4893-af1e-afca98041cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:58.756849 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc387008-d98e-4893-af1e-afca98041cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:58.756849 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc387008-d98e-4893-af1e-afca98041cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:58.756849 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc387008-d98e-4893-af1e-afca98041cf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:58.763144 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc387008-d98e-4893-af1e-afca98041cf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:58.764609 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc387008-d98e-4893-af1e-afca98041cf1 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:58.780080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-bc387008-d98e-4893-af1e-afca98041cf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:58.780080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:58.780080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:58.780080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:58.780080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:58.780080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:58.780080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:58.780080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:58.780080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:58.780080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:58.780080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:58.780080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:58.780080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:44:58.780080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:44:58.780080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:44:58.780080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:44:58.781188 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:58.781188 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:58.781188 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:58.781188 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:58.781188 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:58.781188 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:58.781188 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:58.781188 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:58.781188 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:58.781188 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:58.781188 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:58.781188 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:58.781188 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:58.781188 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:58.781188 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:58.781188 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:58.781188 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:44:58.782768 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:44:58.782768 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:44:58.782768 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:58.782768 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 425/866] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:44:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:58.789742 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be443c-68ac-4ecc-9eaf-eb29f219842e None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:58.909900 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be443c-68ac-4ecc-9eaf-eb29f219842e None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:58.948733 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f68b0-fd85-4e13-b50f-49446860c039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:58.949388 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f68b0-fd85-4e13-b50f-49446860c039 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:58.949668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f68b0-fd85-4e13-b50f-49446860c039 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:58.949933 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f68b0-fd85-4e13-b50f-49446860c039 None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:58.950582 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f68b0-fd85-4e13-b50f-49446860c039 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:58.950882 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f68b0-fd85-4e13-b50f-49446860c039 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:58.952236 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f68b0-fd85-4e13-b50f-49446860c039 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:58.965614 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 442/867] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:58.972063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc387008-d98e-4893-af1e-afca98041cf1 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:59.081037 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc387008-d98e-4893-af1e-afca98041cf1 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:59.116666 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0a6d7-6169-480f-821d-c1fb39ec025c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:59.117308 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0a6d7-6169-480f-821d-c1fb39ec025c None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.117589 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0a6d7-6169-480f-821d-c1fb39ec025c None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.117859 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0a6d7-6169-480f-821d-c1fb39ec025c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.124796 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0a6d7-6169-480f-821d-c1fb39ec025c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:59.126295 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0a6d7-6169-480f-821d-c1fb39ec025c None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:59.138321 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-5da0a6d7-6169-480f-821d-c1fb39ec025c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:59.138321 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:44:59.138321 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:44:59.138321 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:44:59.138321 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:44:59.138321 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:44:59.138321 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:44:59.138321 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:44:59.138321 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:44:59.138321 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:44:59.138321 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:44:59.138321 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:44:59.138321 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:44:59.138321 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:44:59.138321 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:44:59.139270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:44:59.139270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:44:59.139270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:44:59.139270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:44:59.139270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:44:59.139270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:44:59.139270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:44:59.139270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:44:59.139270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:44:59.139270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:44:59.139270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:44:59.139270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:44:59.139270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:44:59.139270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:44:59.139270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:44:59.139270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:44:59.139270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:44:59.140145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:44:59.140145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:44:59.140145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:44:59.140145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:44:59.140145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:44:59.140145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:44:59.140145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:44:59.140145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:44:59.140145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 426/868] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:44:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:44:59.146665 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f68b0-fd85-4e13-b50f-49446860c039 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:59.195052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:59.263633 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f68b0-fd85-4e13-b50f-49446860c039 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:59.302208 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3a1f8-105a-4752-a984-b4d43ce18f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:59.302839 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3a1f8-105a-4752-a984-b4d43ce18f7d None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.303121 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3a1f8-105a-4752-a984-b4d43ce18f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.303396 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3a1f8-105a-4752-a984-b4d43ce18f7d None admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.304104 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3a1f8-105a-4752-a984-b4d43ce18f7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:59.304412 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3a1f8-105a-4752-a984-b4d43ce18f7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:59.305906 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3a1f8-105a-4752-a984-b4d43ce18f7d None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:59.322274 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 443/869] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:44:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:44:59.328318 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0a6d7-6169-480f-821d-c1fb39ec025c None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:59.376992 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:59.439840 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0a6d7-6169-480f-821d-c1fb39ec025c None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:59.477848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a57ae0-5695-48ae-ad5a-a49c568867dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:59.478506 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a57ae0-5695-48ae-ad5a-a49c568867dc None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.478864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a57ae0-5695-48ae-ad5a-a49c568867dc None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.479156 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a57ae0-5695-48ae-ad5a-a49c568867dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.479950 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a57ae0-5695-48ae-ad5a-a49c568867dc None admin] RBAC: Adding query filter params (role.id=c6745e08f9da4a2bae8510c9983635c3, scope.project.id=9b25a7c01ab540ceae16dd618b848f2d, user.id=b3a0a84e4c4e47fc930881109fc07039) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:59.480260 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a57ae0-5695-48ae-ad5a-a49c568867dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:59.481883 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a57ae0-5695-48ae-ad5a-a49c568867dc None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:59.489488 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 427/870] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:44:59 2022] GET /identity/v3/role_assignments?user.id=b3a0a84e4c4e47fc930881109fc07039&scope.project.id=9b25a7c01ab540ceae16dd618b848f2d&role.id=c6745e08f9da4a2bae8510c9983635c3 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:59.717795 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbe8c2-9cbd-4980-89c3-0948f7991699 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.721489 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbe8c2-9cbd-4980-89c3-0948f7991699 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.721489 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbe8c2-9cbd-4980-89c3-0948f7991699 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.721489 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 444/871] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:44:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:44:59.727500 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2396cf2-5b68-43b4-accc-47fab73c2a1d None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.728160 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2396cf2-5b68-43b4-accc-47fab73c2a1d None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.728666 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2396cf2-5b68-43b4-accc-47fab73c2a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.747672 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-f2396cf2-5b68-43b4-accc-47fab73c2a1d None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:59.749314 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-f2396cf2-5b68-43b4-accc-47fab73c2a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:59.821702 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 428/872] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:44:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:45:00.096696 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbe8c2-9cbd-4980-89c3-0948f7991699 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:00.202373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:00.206976 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbe8c2-9cbd-4980-89c3-0948f7991699 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:00.250200 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a392ed9-7822-445c-be0c-db3141411ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:00.251759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a392ed9-7822-445c-be0c-db3141411ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.252265 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a392ed9-7822-445c-be0c-db3141411ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.252544 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a392ed9-7822-445c-be0c-db3141411ed8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.264312 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a392ed9-7822-445c-be0c-db3141411ed8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:45:00.269893 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-2a392ed9-7822-445c-be0c-db3141411ed8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 15:45:00.269893 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:00.269893 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:00.269893 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:00.269893 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:00.269893 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:00.269893 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:00.269893 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:00.269893 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:00.269893 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:00.269893 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:00.269893 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:00.269893 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:45:00.269893 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:45:00.269893 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:45:00.269893 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:45:00.270956 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:45:00.270956 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:45:00.270956 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:45:00.270956 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:45:00.270956 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:00.270956 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:00.270956 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:00.270956 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:00.270956 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:00.270956 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:00.270956 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:00.270956 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:00.270956 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:00.270956 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:00.270956 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:00.270956 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:00.271809 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:00.271809 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:00.271809 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:00.271809 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:00.271809 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:45:00.271809 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:45:00.271809 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:45:00.271809 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:45:00.271809 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:45:00.271809 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:45:00.271809 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 15:45:00.271809 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:00.271809 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 445/873] 10.222.0.64 () {56 vars in 1120 bytes} [Wed Aug 24 15:45:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:00.278016 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2396cf2-5b68-43b4-accc-47fab73c2a1d None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:00.318110 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:00.391597 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2396cf2-5b68-43b4-accc-47fab73c2a1d None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:00.427133 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98bf02-b11c-4532-89a1-71c11ae53ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:00.427742 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98bf02-b11c-4532-89a1-71c11ae53ddd None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.428019 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98bf02-b11c-4532-89a1-71c11ae53ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.428343 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98bf02-b11c-4532-89a1-71c11ae53ddd None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.429039 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98bf02-b11c-4532-89a1-71c11ae53ddd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:00.429341 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98bf02-b11c-4532-89a1-71c11ae53ddd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:00.430699 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98bf02-b11c-4532-89a1-71c11ae53ddd None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:00.440471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 429/874] 10.222.0.64 () {56 vars in 1115 bytes} [Wed Aug 24 15:45:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:00.446146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a392ed9-7822-445c-be0c-db3141411ed8 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:00.525934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1eb7c-f543-48ba-bcb5-1350c3c9971a None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.526315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1eb7c-f543-48ba-bcb5-1350c3c9971a None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.526504 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1eb7c-f543-48ba-bcb5-1350c3c9971a None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.528205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 430/875] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:45:00.533835 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45bd29-ca22-49b5-9d05-dfcfda507624 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.534127 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45bd29-ca22-49b5-9d05-dfcfda507624 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.534406 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45bd29-ca22-49b5-9d05-dfcfda507624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.554617 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-8c45bd29-ca22-49b5-9d05-dfcfda507624 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:00.555824 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-8c45bd29-ca22-49b5-9d05-dfcfda507624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:00.582755 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a392ed9-7822-445c-be0c-db3141411ed8 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:00.629828 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3ce16-aefe-4e1f-a260-6684b8c01f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:00.630468 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3ce16-aefe-4e1f-a260-6684b8c01f87 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.630761 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3ce16-aefe-4e1f-a260-6684b8c01f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.631034 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3ce16-aefe-4e1f-a260-6684b8c01f87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.639087 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 431/876] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:45:00.640234 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d24214-e54c-4bac-8a6c-d259e0cd0e4d None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.640522 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d24214-e54c-4bac-8a6c-d259e0cd0e4d None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.640829 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d24214-e54c-4bac-8a6c-d259e0cd0e4d None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.642733 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 432/877] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:00.648229 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896e0f5-3db4-4ea2-8af0-a72ba887eee9 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.648520 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896e0f5-3db4-4ea2-8af0-a72ba887eee9 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.648833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896e0f5-3db4-4ea2-8af0-a72ba887eee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.651327 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3ce16-aefe-4e1f-a260-6684b8c01f87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:00.653639 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3ce16-aefe-4e1f-a260-6684b8c01f87 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:00.669669 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-e896e0f5-3db4-4ea2-8af0-a72ba887eee9 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:00.670875 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e896e0f5-3db4-4ea2-8af0-a72ba887eee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:00.672938 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-19a3ce16-aefe-4e1f-a260-6684b8c01f87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:45:00.672938 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:00.672938 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:00.672938 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:00.672938 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:00.672938 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:00.672938 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:00.672938 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:00.672938 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:00.672938 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:00.672938 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:00.672938 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:00.672938 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:45:00.672938 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:45:00.672938 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:45:00.672938 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:45:00.674643 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:00.674643 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:00.674643 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:00.674643 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:00.674643 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:00.674643 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:00.674643 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:00.674643 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:00.674643 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:00.674643 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:00.674643 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:00.674643 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:00.674643 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:00.674643 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:00.674643 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:00.674643 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:00.674643 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:45:00.676351 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:45:00.676351 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:45:00.676351 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:00.683814 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 446/878] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:45:00.683814 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3ce16-aefe-4e1f-a260-6684b8c01f87 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:00.705185 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:00.706711 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:00.763259 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 433/879] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:45:00.816055 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3ce16-aefe-4e1f-a260-6684b8c01f87 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:00.852960 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db540f86-936d-4902-8209-b531f2052f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:00.853951 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db540f86-936d-4902-8209-b531f2052f75 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.854429 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db540f86-936d-4902-8209-b531f2052f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.854893 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db540f86-936d-4902-8209-b531f2052f75 None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.855743 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db540f86-936d-4902-8209-b531f2052f75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:00.856246 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db540f86-936d-4902-8209-b531f2052f75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:00.857832 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db540f86-936d-4902-8209-b531f2052f75 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:00.871241 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 447/880] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:00.878351 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896e0f5-3db4-4ea2-8af0-a72ba887eee9 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:00.927352 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db540f86-936d-4902-8209-b531f2052f75 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:00.992282 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896e0f5-3db4-4ea2-8af0-a72ba887eee9 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:01.028980 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:01.045044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6070aaa-db2c-49f9-8fe5-40dcd163a1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:01.049967 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6070aaa-db2c-49f9-8fe5-40dcd163a1b7 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:01.049967 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6070aaa-db2c-49f9-8fe5-40dcd163a1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:01.049967 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6070aaa-db2c-49f9-8fe5-40dcd163a1b7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:01.058484 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6070aaa-db2c-49f9-8fe5-40dcd163a1b7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:01.060471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6070aaa-db2c-49f9-8fe5-40dcd163a1b7 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:01.061336 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db540f86-936d-4902-8209-b531f2052f75 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:01.081740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-a6070aaa-db2c-49f9-8fe5-40dcd163a1b7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 15:45:01.081740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:01.081740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:01.081740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:01.081740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:01.081740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:01.081740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:01.081740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:01.081740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:01.081740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:01.081740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:01.081740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:01.081740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:45:01.081740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:45:01.081740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:45:01.081740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:45:01.082933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:01.082933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:01.082933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:45:01.082933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:45:01.082933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:45:01.082933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:45:01.082933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:01.082933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:01.082933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:01.082933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:01.082933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:01.082933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:01.082933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:01.082933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:01.082933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:01.082933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:01.082933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:01.082933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:01.084243 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:01.084243 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:01.084243 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:45:01.084243 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:45:01.084243 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:45:01.084243 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:45:01.084243 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:45:01.084243 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:45:01.084243 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 15:45:01.084243 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:01.091572 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 434/881] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 24 15:45:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:01.091572 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6070aaa-db2c-49f9-8fe5-40dcd163a1b7 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:01.104862 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:01.117098 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaeb673-bbcd-4444-9598-f6f615756bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:01.118564 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaeb673-bbcd-4444-9598-f6f615756bf6 None admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:01.118564 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaeb673-bbcd-4444-9598-f6f615756bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:01.118564 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaeb673-bbcd-4444-9598-f6f615756bf6 None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:01.119153 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaeb673-bbcd-4444-9598-f6f615756bf6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:01.120532 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaeb673-bbcd-4444-9598-f6f615756bf6 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:01.192806 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6070aaa-db2c-49f9-8fe5-40dcd163a1b7 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:01.203832 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 448/882] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 24 15:45:00 2022] POST /identity/v3/services => generated 251 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:45:01.204807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaeb673-bbcd-4444-9598-f6f615756bf6 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:01.253724 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7452a4d-694a-4775-b94c-3e3b233e06f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:01.254751 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7452a4d-694a-4775-b94c-3e3b233e06f5 None admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:01.255178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7452a4d-694a-4775-b94c-3e3b233e06f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:01.255639 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7452a4d-694a-4775-b94c-3e3b233e06f5 None admin] PATH_INFO: `/v3/services` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:01.256910 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7452a4d-694a-4775-b94c-3e3b233e06f5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:01.259297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7452a4d-694a-4775-b94c-3e3b233e06f5 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:01.355434 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaeb673-bbcd-4444-9598-f6f615756bf6 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:01.372205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 435/883] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 24 15:45:01 2022] POST /identity/v3/services => generated 269 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:01.399899 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:01.419503 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b90df-750a-46ee-8793-70dca30f358b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:01.420134 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b90df-750a-46ee-8793-70dca30f358b None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:01.420413 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b90df-750a-46ee-8793-70dca30f358b None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:01.421472 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b90df-750a-46ee-8793-70dca30f358b None admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:01.421472 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b90df-750a-46ee-8793-70dca30f358b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:01.421786 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b90df-750a-46ee-8793-70dca30f358b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:01.423920 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b90df-750a-46ee-8793-70dca30f358b None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:01.451869 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 449/884] 10.222.0.64 () {56 vars in 1149 bytes} [Wed Aug 24 15:45:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:01.455880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7452a4d-694a-4775-b94c-3e3b233e06f5 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:01.540365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:01.575331 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7452a4d-694a-4775-b94c-3e3b233e06f5 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:01.615278 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdadf12d-9e28-4127-91b4-6cf0504150a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:01.615903 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadf12d-9e28-4127-91b4-6cf0504150a1 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:01.616180 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadf12d-9e28-4127-91b4-6cf0504150a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:01.616451 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadf12d-9e28-4127-91b4-6cf0504150a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:01.625929 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95555b57-a4fc-4456-a9ab-cbcb57260525 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:01.626229 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95555b57-a4fc-4456-a9ab-cbcb57260525 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:01.626486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95555b57-a4fc-4456-a9ab-cbcb57260525 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:01.629197 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 450/885] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:01.633501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6070c-79c3-4271-9102-722a769cd893 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:01.633781 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6070c-79c3-4271-9102-722a769cd893 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:01.634054 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6070c-79c3-4271-9102-722a769cd893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:01.653469 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-21d6070c-79c3-4271-9102-722a769cd893 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:01.654711 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-21d6070c-79c3-4271-9102-722a769cd893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:01.714077 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdadf12d-9e28-4127-91b4-6cf0504150a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:01.715729 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdadf12d-9e28-4127-91b4-6cf0504150a1 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:01.730280 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 451/886] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:01 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:45:01.814094 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:01.842713 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 436/887] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:45:01 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:45:01.848969 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6070c-79c3-4271-9102-722a769cd893 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:01.972504 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6070c-79c3-4271-9102-722a769cd893 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:01.995482 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:02.016990 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce9125-8635-4f9f-adc8-8434d33d66c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:02.017916 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce9125-8635-4f9f-adc8-8434d33d66c8 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:02.018369 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce9125-8635-4f9f-adc8-8434d33d66c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:02.018792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce9125-8635-4f9f-adc8-8434d33d66c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:02.025986 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdadf12d-9e28-4127-91b4-6cf0504150a1 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:02.030884 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce9125-8635-4f9f-adc8-8434d33d66c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:02.032994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce9125-8635-4f9f-adc8-8434d33d66c8 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:02.050134 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-dbce9125-8635-4f9f-adc8-8434d33d66c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:45:02.050134 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:02.050134 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:02.050134 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:02.050134 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:02.050134 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:02.050134 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:02.050134 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:02.050134 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:02.050134 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:02.050134 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:02.050134 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:02.050134 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:45:02.050134 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:45:02.050134 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:45:02.050134 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:45:02.051349 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:02.051349 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:02.051349 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:02.051349 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:02.051349 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:02.051349 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:02.051349 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:02.051349 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:02.051349 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:02.051349 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:02.051349 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:02.051349 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:02.051349 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:02.051349 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:02.051349 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:02.051349 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:02.051349 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:45:02.052481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:45:02.052481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:45:02.052481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:02.054358 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 452/888] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:02.060277 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce9125-8635-4f9f-adc8-8434d33d66c8 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:02.158089 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdadf12d-9e28-4127-91b4-6cf0504150a1 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:02.185689 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce9125-8635-4f9f-adc8-8434d33d66c8 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:02.199608 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58b292-1418-4e42-ae94-a667dd3869ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:02.200805 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58b292-1418-4e42-ae94-a667dd3869ae None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:02.201406 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58b292-1418-4e42-ae94-a667dd3869ae None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:02.201943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58b292-1418-4e42-ae94-a667dd3869ae None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:02.202718 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58b292-1418-4e42-ae94-a667dd3869ae None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:02.205156 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58b292-1418-4e42-ae94-a667dd3869ae None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:02.215205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-8b58b292-1418-4e42-ae94-a667dd3869ae None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 15:45:02.215205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:02.215205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:45:02.215205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:45:02.215205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:45:02.215205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:45:02.215205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:45:02.215205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:45:02.215205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 15:45:02.215205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:02.215205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:45:02.215205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:02.215205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:02.215205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:02.215205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:02.215205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:02.215205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:02.216256 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:02.216256 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:02.216256 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:02.216256 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:02.216256 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:02.216256 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:02.216256 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:45:02.216256 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:45:02.216256 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:45:02.216256 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:45:02.216256 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:02.216256 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:02.216256 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:02.216256 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:02.216256 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:02.216256 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:02.217160 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:02.217160 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:02.217160 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:02.217160 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:02.217160 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:02.217160 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:02.217160 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:02.217160 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:02.217160 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:02.217160 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:02.217160 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:45:02.217160 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:45:02.217160 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 15:45:02.217160 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:02.221201 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 437/889] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 24 15:45:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:45:02.223449 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57986d2c-c40a-449f-aba1-5ac099044e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:02.224000 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57986d2c-c40a-449f-aba1-5ac099044e6e None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:02.224284 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57986d2c-c40a-449f-aba1-5ac099044e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:02.224563 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57986d2c-c40a-449f-aba1-5ac099044e6e None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:02.225256 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57986d2c-c40a-449f-aba1-5ac099044e6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:02.225557 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57986d2c-c40a-449f-aba1-5ac099044e6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:02.226952 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57986d2c-c40a-449f-aba1-5ac099044e6e None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:02.227074 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58b292-1418-4e42-ae94-a667dd3869ae None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:02.246488 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 453/890] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:02.247890 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57986d2c-c40a-449f-aba1-5ac099044e6e None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:02.278433 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:02.296125 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:02.384976 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58b292-1418-4e42-ae94-a667dd3869ae None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:02.395931 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57986d2c-c40a-449f-aba1-5ac099044e6e None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:02.428489 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552894c9-381e-4e72-87b0-1a75b35ff033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:02.429509 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552894c9-381e-4e72-87b0-1a75b35ff033 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:02.430033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552894c9-381e-4e72-87b0-1a75b35ff033 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:02.430625 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552894c9-381e-4e72-87b0-1a75b35ff033 None admin] PATH_INFO: `/v3/services` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:02.431726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552894c9-381e-4e72-87b0-1a75b35ff033 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:02.432261 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552894c9-381e-4e72-87b0-1a75b35ff033 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:02.434281 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552894c9-381e-4e72-87b0-1a75b35ff033 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:02.436204 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd93a2d-bb0f-4acb-a731-764638036da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:02.437155 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd93a2d-bb0f-4acb-a731-764638036da5 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:02.437265 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd93a2d-bb0f-4acb-a731-764638036da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:02.437551 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd93a2d-bb0f-4acb-a731-764638036da5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:02.442134 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 438/891] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 24 15:45:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:02.448407 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd93a2d-bb0f-4acb-a731-764638036da5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:02.448700 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552894c9-381e-4e72-87b0-1a75b35ff033 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:02.449249 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd93a2d-bb0f-4acb-a731-764638036da5 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:02.462416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-4fd93a2d-bb0f-4acb-a731-764638036da5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:45:02.462416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:02.462416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:02.462416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:02.462416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:02.462416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:02.462416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:02.462416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:02.462416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:02.462416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:02.462416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:02.462416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:02.462416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:45:02.462416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:45:02.462416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:45:02.463560 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:45:02.463560 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:02.463560 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:02.463560 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:02.463560 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:02.463560 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:02.463560 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:02.463560 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:02.463560 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:02.463560 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:02.463560 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:02.463560 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:02.463560 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:02.463560 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:02.463560 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:02.463560 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:02.463560 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:02.464867 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:45:02.464867 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:45:02.464867 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:45:02.464867 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:45:02.464867 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:45:02.464867 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:45:02.464867 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:45:02.464867 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:02.464867 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 454/892] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:45:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:45:02.470838 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd93a2d-bb0f-4acb-a731-764638036da5 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:02.566206 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:02.570438 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552894c9-381e-4e72-87b0-1a75b35ff033 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:02.605793 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:02.615849 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71deff64-bea7-4f71-b06c-93e698005aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:02.617335 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71deff64-bea7-4f71-b06c-93e698005aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:02.618060 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71deff64-bea7-4f71-b06c-93e698005aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:02.618612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71deff64-bea7-4f71-b06c-93e698005aa3 None admin] PATH_INFO: `/v3/services` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:02.620132 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71deff64-bea7-4f71-b06c-93e698005aa3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:02.620984 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71deff64-bea7-4f71-b06c-93e698005aa3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:02.622630 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71deff64-bea7-4f71-b06c-93e698005aa3 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:02.622899 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd93a2d-bb0f-4acb-a731-764638036da5 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:02.630601 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 439/893] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 24 15:45:02 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:02.669853 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d4951-535b-448f-8d57-e6f0279417b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:02.670476 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d4951-535b-448f-8d57-e6f0279417b2 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:02.670758 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d4951-535b-448f-8d57-e6f0279417b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:02.671033 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d4951-535b-448f-8d57-e6f0279417b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:02.671744 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d4951-535b-448f-8d57-e6f0279417b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:02.672089 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d4951-535b-448f-8d57-e6f0279417b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:02.673715 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d4951-535b-448f-8d57-e6f0279417b2 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:02.688022 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 455/894] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:45:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:02.694645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71deff64-bea7-4f71-b06c-93e698005aa3 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:02.817840 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71deff64-bea7-4f71-b06c-93e698005aa3 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:02.855440 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46796ff2-0fb0-4217-b3fa-c4c570369619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:02.856053 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46796ff2-0fb0-4217-b3fa-c4c570369619 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:02.856333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46796ff2-0fb0-4217-b3fa-c4c570369619 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:02.856606 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46796ff2-0fb0-4217-b3fa-c4c570369619 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:02.857370 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46796ff2-0fb0-4217-b3fa-c4c570369619 None admin] RBAC: Adding query filter params (role.id=645ada3cca2e4ac49e7055528e4748d6, scope.project.id=9b25a7c01ab540ceae16dd618b848f2d, user.id=eaf3821dd57a4d8f9ca6385c202bb0ed) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:02.857679 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46796ff2-0fb0-4217-b3fa-c4c570369619 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:02.859113 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46796ff2-0fb0-4217-b3fa-c4c570369619 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:02.866405 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 440/895] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:45:02 2022] GET /identity/v3/role_assignments?user.id=eaf3821dd57a4d8f9ca6385c202bb0ed&scope.project.id=9b25a7c01ab540ceae16dd618b848f2d&role.id=645ada3cca2e4ac49e7055528e4748d6 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:03.340688 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b0531-824d-4e55-a9d0-bc14bdb621a2 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:03.341228 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b0531-824d-4e55-a9d0-bc14bdb621a2 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:03.341228 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b0531-824d-4e55-a9d0-bc14bdb621a2 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:03.342840 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 456/896] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:03.349009 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b9b86-5349-4365-922d-242b31969867 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:03.349302 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b9b86-5349-4365-922d-242b31969867 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:03.349584 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b9b86-5349-4365-922d-242b31969867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:03.368600 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-c20b9b86-5349-4365-922d-242b31969867 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:03.369835 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-c20b9b86-5349-4365-922d-242b31969867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:03.393249 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:03.447690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 441/897] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:03 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:45:03.535270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7101c6-a657-435a-b0e2-b0eb6aff7560 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:03.535623 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7101c6-a657-435a-b0e2-b0eb6aff7560 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:03.535832 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7101c6-a657-435a-b0e2-b0eb6aff7560 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:03.537360 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 457/898] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:03.542962 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b0d5e-6eda-4e22-9e40-7dc4b4f791d4 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:03.543543 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b0d5e-6eda-4e22-9e40-7dc4b4f791d4 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:03.544097 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b0d5e-6eda-4e22-9e40-7dc4b4f791d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:03.563740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-305b0d5e-6eda-4e22-9e40-7dc4b4f791d4 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:03.565317 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-305b0d5e-6eda-4e22-9e40-7dc4b4f791d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:03.638369 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 442/899] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:03 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:45:03.728016 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7101c6-a657-435a-b0e2-b0eb6aff7560 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:03.847690 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7101c6-a657-435a-b0e2-b0eb6aff7560 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:03.883391 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d65020-ea46-4fcd-8620-722eaed8904d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:03.884021 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d65020-ea46-4fcd-8620-722eaed8904d None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:03.884304 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d65020-ea46-4fcd-8620-722eaed8904d None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:03.884578 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d65020-ea46-4fcd-8620-722eaed8904d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:03.885196 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d65020-ea46-4fcd-8620-722eaed8904d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:03.886570 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d65020-ea46-4fcd-8620-722eaed8904d None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:03.896900 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-c2d65020-ea46-4fcd-8620-722eaed8904d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 15:45:03.896900 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:03.896900 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:45:03.896900 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:45:03.896900 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:45:03.896900 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:45:03.896900 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:45:03.896900 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:45:03.896900 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 15:45:03.896900 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:03.896900 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:45:03.896900 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:03.896900 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:03.896900 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:03.896900 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:03.896900 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:03.896900 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:03.898045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:03.898045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:03.898045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:03.898045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:03.898045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:03.898045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:03.898045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:45:03.898045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:45:03.898045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:45:03.898045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:45:03.898045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:03.898045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:03.898045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:03.898045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:03.898045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:03.898045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:03.898860 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:03.898860 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:03.898860 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:03.898860 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:03.898860 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:03.898860 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:03.898860 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:03.898860 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:03.898860 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:03.898860 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:03.898860 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:45:03.898860 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:45:03.898860 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 15:45:03.898860 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:03.898860 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 458/900] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 24 15:45:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:03.904563 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b0d5e-6eda-4e22-9e40-7dc4b4f791d4 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:03.950837 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d65020-ea46-4fcd-8620-722eaed8904d None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:03.970251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:04.004963 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:04.024137 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b0d5e-6eda-4e22-9e40-7dc4b4f791d4 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:04.072231 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14cab3-2be0-47ce-9617-c093c38a78b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:04.072885 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14cab3-2be0-47ce-9617-c093c38a78b3 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:04.073579 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14cab3-2be0-47ce-9617-c093c38a78b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:04.073884 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14cab3-2be0-47ce-9617-c093c38a78b3 None admin] PATH_INFO: `/v3/services` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:04.074530 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14cab3-2be0-47ce-9617-c093c38a78b3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:04.075000 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14cab3-2be0-47ce-9617-c093c38a78b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:04.076789 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14cab3-2be0-47ce-9617-c093c38a78b3 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:04.084937 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d65020-ea46-4fcd-8620-722eaed8904d None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:04.088937 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 443/901] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 24 15:45:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:04.090836 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14cab3-2be0-47ce-9617-c093c38a78b3 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:04.134270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22f0bc-ae13-466d-bb9d-4aef5a1eeb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:04.135425 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22f0bc-ae13-466d-bb9d-4aef5a1eeb51 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:04.136740 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22f0bc-ae13-466d-bb9d-4aef5a1eeb51 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:04.137242 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22f0bc-ae13-466d-bb9d-4aef5a1eeb51 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:04.138120 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f22f0bc-ae13-466d-bb9d-4aef5a1eeb51 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:04.139752 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f22f0bc-ae13-466d-bb9d-4aef5a1eeb51 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:04.152598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-4f22f0bc-ae13-466d-bb9d-4aef5a1eeb51 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 15:45:04.152598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:04.152598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:45:04.152598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:45:04.152598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:45:04.152598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:45:04.152598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:45:04.152598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:45:04.152598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 15:45:04.152598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:04.152598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:45:04.152598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:04.152598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:04.152598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:04.152598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:04.152598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:04.153621 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:04.153621 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:04.153621 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:04.153621 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:04.153621 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:04.153621 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:04.153621 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:04.153621 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:45:04.153621 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:45:04.153621 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:45:04.153621 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:45:04.153621 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:04.153621 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:04.153621 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:04.153621 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:04.153621 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:04.153621 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:04.154531 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:04.154531 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:04.154531 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:04.154531 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:04.154531 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:04.154531 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:04.154531 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:04.154531 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:04.154531 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:04.154531 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:04.154531 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:45:04.154531 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:45:04.154531 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 15:45:04.154531 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:04.162036 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 459/902] 10.222.0.64 () {56 vars in 1132 bytes} [Wed Aug 24 15:45:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:45:04.164668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22f0bc-ae13-466d-bb9d-4aef5a1eeb51 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:04.220442 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14cab3-2be0-47ce-9617-c093c38a78b3 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:04.259841 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf86a3-885a-44ca-8570-fd8ca4f64c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:04.261765 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf86a3-885a-44ca-8570-fd8ca4f64c3d None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:04.262291 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf86a3-885a-44ca-8570-fd8ca4f64c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:04.262801 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf86a3-885a-44ca-8570-fd8ca4f64c3d None admin] PATH_INFO: `/v3/services` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:04.263664 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf86a3-885a-44ca-8570-fd8ca4f64c3d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:04.264177 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf86a3-885a-44ca-8570-fd8ca4f64c3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:04.267092 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf86a3-885a-44ca-8570-fd8ca4f64c3d None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:04.269429 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:04.274701 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 444/903] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 24 15:45:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:04.282777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf86a3-885a-44ca-8570-fd8ca4f64c3d None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:04.308870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22f0bc-ae13-466d-bb9d-4aef5a1eeb51 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:04.309878 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:04.356488 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacb7e6-3943-43c7-a6f0-802d287deb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:04.357295 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacb7e6-3943-43c7-a6f0-802d287deb73 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:04.357648 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacb7e6-3943-43c7-a6f0-802d287deb73 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:04.357887 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacb7e6-3943-43c7-a6f0-802d287deb73 None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:04.358467 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bacb7e6-3943-43c7-a6f0-802d287deb73 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:04.358903 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bacb7e6-3943-43c7-a6f0-802d287deb73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:04.361035 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bacb7e6-3943-43c7-a6f0-802d287deb73 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:04.368661 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 460/904] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 24 15:45:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:04.373392 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacb7e6-3943-43c7-a6f0-802d287deb73 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:04.439306 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf86a3-885a-44ca-8570-fd8ca4f64c3d None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:04.489031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38478a7c-905d-4645-ba80-ba786247fe93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:04.489904 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38478a7c-905d-4645-ba80-ba786247fe93 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:04.490327 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38478a7c-905d-4645-ba80-ba786247fe93 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:04.490742 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38478a7c-905d-4645-ba80-ba786247fe93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:04.491010 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacb7e6-3943-43c7-a6f0-802d287deb73 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:04.491776 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38478a7c-905d-4645-ba80-ba786247fe93 None admin] RBAC: Adding query filter params (interface=public, service_id=4b3dfabb89d04aa9a398d68d75c489a2, region_id=RegionOne) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:04.492228 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38478a7c-905d-4645-ba80-ba786247fe93 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:04.495084 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38478a7c-905d-4645-ba80-ba786247fe93 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:04.507960 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 445/905] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Aug 24 15:45:04 2022] GET /identity/v3/endpoints?service_id=4b3dfabb89d04aa9a398d68d75c489a2&interface=public®ion_id=RegionOne => generated 194 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:04.509296 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38478a7c-905d-4645-ba80-ba786247fe93 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:04.539333 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0867dd3-39c2-4327-ab03-f61a857ed93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:04.539952 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0867dd3-39c2-4327-ab03-f61a857ed93f None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:04.540289 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0867dd3-39c2-4327-ab03-f61a857ed93f None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:04.540570 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0867dd3-39c2-4327-ab03-f61a857ed93f None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:04.541294 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0867dd3-39c2-4327-ab03-f61a857ed93f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:04.541665 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0867dd3-39c2-4327-ab03-f61a857ed93f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:04.543052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0867dd3-39c2-4327-ab03-f61a857ed93f None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:04.552733 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 461/906] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 24 15:45:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:04.554694 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0867dd3-39c2-4327-ab03-f61a857ed93f None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:04.559386 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:04.620296 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:04.649123 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38478a7c-905d-4645-ba80-ba786247fe93 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:04.674783 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0867dd3-39c2-4327-ab03-f61a857ed93f None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:04.688779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01448a-d846-4b97-9a21-cdcc69e3d4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:04.689455 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01448a-d846-4b97-9a21-cdcc69e3d4f6 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:04.689675 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01448a-d846-4b97-9a21-cdcc69e3d4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:04.689941 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01448a-d846-4b97-9a21-cdcc69e3d4f6 None admin] PATH_INFO: `/v3/services` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:04.690551 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01448a-d846-4b97-9a21-cdcc69e3d4f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:04.691922 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01448a-d846-4b97-9a21-cdcc69e3d4f6 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:04.700796 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 446/907] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 24 15:45:04 2022] GET /identity/v3/services => generated 1268 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:45:04.700796 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a68f4-01f7-4333-bf81-51e48eb92f5a None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:04.700796 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a68f4-01f7-4333-bf81-51e48eb92f5a None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:04.700796 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a68f4-01f7-4333-bf81-51e48eb92f5a None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:04.701768 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 447/908] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:04.710887 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a8062-9742-4748-8f7b-ae8a02a78efa None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:04.711171 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a8062-9742-4748-8f7b-ae8a02a78efa None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:04.715032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a8062-9742-4748-8f7b-ae8a02a78efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:04.719395 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5671ee8-b9e0-467a-888f-72e4d87482cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:04.720652 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5671ee8-b9e0-467a-888f-72e4d87482cd None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:04.721135 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5671ee8-b9e0-467a-888f-72e4d87482cd None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:04.721554 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5671ee8-b9e0-467a-888f-72e4d87482cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:04.722599 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5671ee8-b9e0-467a-888f-72e4d87482cd None admin] RBAC: Adding query filter params (interface=public, service_id=20c76627653b450dbd0c49d2854bb64c, region_id=RegionOne) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:04.723093 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5671ee8-b9e0-467a-888f-72e4d87482cd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:04.724773 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5671ee8-b9e0-467a-888f-72e4d87482cd None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:04.733884 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-c85a8062-9742-4748-8f7b-ae8a02a78efa None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:04.736515 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-c85a8062-9742-4748-8f7b-ae8a02a78efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:04.738983 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 462/909] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Aug 24 15:45:04 2022] GET /identity/v3/endpoints?service_id=20c76627653b450dbd0c49d2854bb64c&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:04.739991 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5671ee8-b9e0-467a-888f-72e4d87482cd None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:04.830133 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:04.851552 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 448/910] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:04 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:45:04.851552 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690eaa3-24ac-4245-806c-2a98468ca67f None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:04.851552 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690eaa3-24ac-4245-806c-2a98468ca67f None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:04.851940 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690eaa3-24ac-4245-806c-2a98468ca67f None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:04.853398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 449/911] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:04.858984 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36245dc3-59d6-4693-b298-bb8f195ea7f7 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:04.859321 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36245dc3-59d6-4693-b298-bb8f195ea7f7 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:04.859576 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36245dc3-59d6-4693-b298-bb8f195ea7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:04.878186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-36245dc3-59d6-4693-b298-bb8f195ea7f7 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:04.879405 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-36245dc3-59d6-4693-b298-bb8f195ea7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:04.879906 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5671ee8-b9e0-467a-888f-72e4d87482cd None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:04.925566 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060dee69-5f4d-4607-9be0-9dcb75d35805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:04.926865 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060dee69-5f4d-4607-9be0-9dcb75d35805 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:04.928262 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060dee69-5f4d-4607-9be0-9dcb75d35805 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:04.928889 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060dee69-5f4d-4607-9be0-9dcb75d35805 None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:04.929733 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060dee69-5f4d-4607-9be0-9dcb75d35805 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:04.931146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060dee69-5f4d-4607-9be0-9dcb75d35805 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:04.939829 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 463/912] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 24 15:45:04 2022] GET /identity/v3/services => generated 1268 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:04.971313 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 450/913] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:04 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:45:05.131624 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060dee69-5f4d-4607-9be0-9dcb75d35805 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:05.243604 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36245dc3-59d6-4693-b298-bb8f195ea7f7 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:05.245819 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:05.251879 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060dee69-5f4d-4607-9be0-9dcb75d35805 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:05.288123 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:05.293932 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba8467-5ad2-4298-bb32-9a77ff7e42f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:05.294547 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba8467-5ad2-4298-bb32-9a77ff7e42f7 None admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:05.294838 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba8467-5ad2-4298-bb32-9a77ff7e42f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:05.295108 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba8467-5ad2-4298-bb32-9a77ff7e42f7 None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:05.295777 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba8467-5ad2-4298-bb32-9a77ff7e42f7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:05.297506 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba8467-5ad2-4298-bb32-9a77ff7e42f7 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:05.375938 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 464/914] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 24 15:45:05 2022] POST /identity/v3/services => generated 241 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:05.379493 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36245dc3-59d6-4693-b298-bb8f195ea7f7 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:05.430930 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714300e0-d4ed-443e-89ac-dd8335d3fe5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:05.432065 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714300e0-d4ed-443e-89ac-dd8335d3fe5f None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:05.432617 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714300e0-d4ed-443e-89ac-dd8335d3fe5f None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:05.433130 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714300e0-d4ed-443e-89ac-dd8335d3fe5f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:05.451881 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714300e0-d4ed-443e-89ac-dd8335d3fe5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:45:05.457760 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-714300e0-d4ed-443e-89ac-dd8335d3fe5f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 15:45:05.457760 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:05.457760 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:05.457760 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:05.457760 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:05.457760 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:05.457760 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:05.457760 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:05.457760 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:05.457760 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:05.457760 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:05.457760 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:05.457760 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:45:05.457760 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:45:05.457760 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:45:05.457760 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:45:05.458765 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:45:05.458765 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:45:05.458765 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:45:05.458765 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:45:05.458765 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:05.458765 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:05.458765 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:05.458765 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:05.458765 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:05.458765 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:05.458765 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:05.458765 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:05.458765 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:05.458765 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:05.458765 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:05.458765 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:05.459624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:05.459624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:05.459624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:05.459624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:05.459624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:45:05.459624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:45:05.459624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:45:05.459624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:45:05.459624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:45:05.459624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:45:05.459624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 15:45:05.459624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:05.459624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 451/915] 10.222.0.64 () {56 vars in 1120 bytes} [Wed Aug 24 15:45:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:05.467253 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba8467-5ad2-4298-bb32-9a77ff7e42f7 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:05.589442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba8467-5ad2-4298-bb32-9a77ff7e42f7 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:05.630080 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901dc6c3-d98b-4406-91b9-f4d08d30005e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:05.630693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901dc6c3-d98b-4406-91b9-f4d08d30005e None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:05.630989 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901dc6c3-d98b-4406-91b9-f4d08d30005e None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:05.631307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901dc6c3-d98b-4406-91b9-f4d08d30005e None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:05.631998 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901dc6c3-d98b-4406-91b9-f4d08d30005e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:05.632285 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901dc6c3-d98b-4406-91b9-f4d08d30005e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:05.633693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901dc6c3-d98b-4406-91b9-f4d08d30005e None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:05.642859 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 465/916] 10.222.0.64 () {56 vars in 1115 bytes} [Wed Aug 24 15:45:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:05.648911 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714300e0-d4ed-443e-89ac-dd8335d3fe5f None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:05.718852 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:05.764958 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714300e0-d4ed-443e-89ac-dd8335d3fe5f None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:05.802904 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67900fe-7249-47fc-b065-ee63604f9221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:05.803550 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67900fe-7249-47fc-b065-ee63604f9221 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:05.803825 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67900fe-7249-47fc-b065-ee63604f9221 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:05.804095 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67900fe-7249-47fc-b065-ee63604f9221 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:05.817435 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67900fe-7249-47fc-b065-ee63604f9221 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:05.818956 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67900fe-7249-47fc-b065-ee63604f9221 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:05.833957 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-c67900fe-7249-47fc-b065-ee63604f9221 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:45:05.833957 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:05.833957 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:05.833957 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:05.833957 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:05.833957 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:05.833957 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:05.833957 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:05.833957 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:05.833957 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:05.833957 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:05.833957 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:05.833957 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:45:05.833957 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:45:05.833957 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:45:05.833957 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:45:05.834991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:05.834991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:05.834991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:05.834991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:05.834991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:05.834991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:05.834991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:05.834991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:05.834991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:05.834991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:05.834991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:05.834991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:05.834991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:05.834991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:05.834991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:05.834991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:05.834991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:45:05.835893 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:45:05.835893 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:45:05.835893 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:05.835893 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 452/917] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:45:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:05.842474 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901dc6c3-d98b-4406-91b9-f4d08d30005e None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:05.910763 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:05.967513 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901dc6c3-d98b-4406-91b9-f4d08d30005e None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:06.007597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de88c4-15a2-44e9-a80f-7da7ddff3e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:06.008277 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de88c4-15a2-44e9-a80f-7da7ddff3e6c None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:06.008560 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de88c4-15a2-44e9-a80f-7da7ddff3e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:06.008858 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de88c4-15a2-44e9-a80f-7da7ddff3e6c None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:06.009508 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de88c4-15a2-44e9-a80f-7da7ddff3e6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:06.011107 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de88c4-15a2-44e9-a80f-7da7ddff3e6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:06.012505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de88c4-15a2-44e9-a80f-7da7ddff3e6c None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:06.030393 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 466/918] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:06.036857 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67900fe-7249-47fc-b065-ee63604f9221 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:06.155857 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67900fe-7249-47fc-b065-ee63604f9221 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:06.168711 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:06.200617 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7b03a-d3bc-47b7-bea6-401475061c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:06.201273 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7b03a-d3bc-47b7-bea6-401475061c10 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:06.201547 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7b03a-d3bc-47b7-bea6-401475061c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:06.201816 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7b03a-d3bc-47b7-bea6-401475061c10 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:06.210222 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7b03a-d3bc-47b7-bea6-401475061c10 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:06.211678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7b03a-d3bc-47b7-bea6-401475061c10 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:06.224474 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-05f7b03a-d3bc-47b7-bea6-401475061c10 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 15:45:06.224474 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:06.224474 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:06.224474 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:06.224474 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:06.224474 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:06.224474 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:06.224474 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:06.224474 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:06.224474 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:06.224474 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:06.224474 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:06.224474 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:45:06.224474 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:45:06.224474 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:45:06.224474 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:45:06.225500 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:06.225500 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:06.225500 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:45:06.225500 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:45:06.225500 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:45:06.225500 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:45:06.225500 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:06.225500 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:06.225500 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:06.225500 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:06.225500 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:06.225500 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:06.225500 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:06.225500 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:06.225500 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:06.225500 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:06.225500 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:06.225500 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:06.226426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:06.226426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:06.226426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:45:06.226426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:45:06.226426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:45:06.226426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:45:06.226426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:45:06.226426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:45:06.226426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 15:45:06.226426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:06.226426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 453/919] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 24 15:45:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:06.235681 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de88c4-15a2-44e9-a80f-7da7ddff3e6c None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:06.362185 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de88c4-15a2-44e9-a80f-7da7ddff3e6c None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:06.378046 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:06.400836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4a842-9a60-43d7-9285-9f0dd481ae25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:06.401447 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4a842-9a60-43d7-9285-9f0dd481ae25 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:06.401723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4a842-9a60-43d7-9285-9f0dd481ae25 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:06.401988 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4a842-9a60-43d7-9285-9f0dd481ae25 None admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:06.406960 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4a842-9a60-43d7-9285-9f0dd481ae25 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:06.406960 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4a842-9a60-43d7-9285-9f0dd481ae25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:06.406960 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4a842-9a60-43d7-9285-9f0dd481ae25 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:06.425895 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 467/920] 10.222.0.64 () {56 vars in 1149 bytes} [Wed Aug 24 15:45:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:06.433780 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7b03a-d3bc-47b7-bea6-401475061c10 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:06.544010 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7b03a-d3bc-47b7-bea6-401475061c10 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:06.580470 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcb8d2-8321-4d34-bcc4-c89ecd3ebe80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:06.581150 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcb8d2-8321-4d34-bcc4-c89ecd3ebe80 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:06.581425 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcb8d2-8321-4d34-bcc4-c89ecd3ebe80 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:06.581690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcb8d2-8321-4d34-bcc4-c89ecd3ebe80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:06.592997 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bcb8d2-8321-4d34-bcc4-c89ecd3ebe80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:06.594825 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bcb8d2-8321-4d34-bcc4-c89ecd3ebe80 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:06.610394 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-a9bcb8d2-8321-4d34-bcc4-c89ecd3ebe80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:45:06.610394 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:06.610394 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:06.610394 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:06.610394 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:06.610394 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:06.610394 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:06.610394 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:06.610394 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:06.610394 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:06.610394 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:06.610394 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:06.610394 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:45:06.610394 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:45:06.610394 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:45:06.610394 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:45:06.611518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:06.611518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:06.611518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:06.611518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:06.611518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:06.611518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:06.611518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:06.611518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:06.611518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:06.611518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:06.611518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:06.611518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:06.611518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:06.611518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:06.611518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:06.611518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:06.611518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:45:06.612426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:45:06.612426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:45:06.612426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:06.612426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 454/921] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:06.619221 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4a842-9a60-43d7-9285-9f0dd481ae25 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:06.744419 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4a842-9a60-43d7-9285-9f0dd481ae25 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:06.766792 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba07a1-46d8-49a7-aba3-0319f17b57fa None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:06.767110 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba07a1-46d8-49a7-aba3-0319f17b57fa None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:06.767349 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba07a1-46d8-49a7-aba3-0319f17b57fa None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:06.770777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 455/922] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:06.775797 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3c2c7-0d65-46bc-8a50-4438729a87cd None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:06.776078 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3c2c7-0d65-46bc-8a50-4438729a87cd None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:06.776356 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3c2c7-0d65-46bc-8a50-4438729a87cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:06.785859 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ecb11-7860-4b70-a6a2-4346f1876a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:06.787326 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ecb11-7860-4b70-a6a2-4346f1876a21 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:06.787601 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ecb11-7860-4b70-a6a2-4346f1876a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:06.787871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ecb11-7860-4b70-a6a2-4346f1876a21 None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:06.788519 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ecb11-7860-4b70-a6a2-4346f1876a21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:06.788851 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ecb11-7860-4b70-a6a2-4346f1876a21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:06.790324 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ecb11-7860-4b70-a6a2-4346f1876a21 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:06.797779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-5ad3c2c7-0d65-46bc-8a50-4438729a87cd None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:06.799252 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-5ad3c2c7-0d65-46bc-8a50-4438729a87cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:06.805377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 468/923] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:06.811290 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ecb11-7860-4b70-a6a2-4346f1876a21 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:06.819306 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:06.857501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:06.881842 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 456/924] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:45:06.910121 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935eef54-e4bf-476f-8296-4da547bbc843 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:06.910441 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935eef54-e4bf-476f-8296-4da547bbc843 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:06.910677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935eef54-e4bf-476f-8296-4da547bbc843 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:06.912322 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 457/925] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:45:06.917880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e5909-c3f3-4df2-87ce-c2a478fe827a None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:06.918547 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e5909-c3f3-4df2-87ce-c2a478fe827a None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:06.918922 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e5909-c3f3-4df2-87ce-c2a478fe827a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:06.940660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ecb11-7860-4b70-a6a2-4346f1876a21 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:06.944698 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-900e5909-c3f3-4df2-87ce-c2a478fe827a None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:06.946033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-900e5909-c3f3-4df2-87ce-c2a478fe827a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:06.987189 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8cb2c-dd06-45d3-8f8b-91a83926ba01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:06.988011 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8cb2c-dd06-45d3-8f8b-91a83926ba01 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:06.988395 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8cb2c-dd06-45d3-8f8b-91a83926ba01 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:06.988801 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8cb2c-dd06-45d3-8f8b-91a83926ba01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:06.996704 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8cb2c-dd06-45d3-8f8b-91a83926ba01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:06.998320 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8cb2c-dd06-45d3-8f8b-91a83926ba01 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:07.014414 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-62e8cb2c-dd06-45d3-8f8b-91a83926ba01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:45:07.014414 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:07.014414 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:07.014414 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:07.014414 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:07.014414 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:07.014414 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:07.014414 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:07.014414 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:07.014414 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:07.014414 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:07.014414 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:07.014414 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:45:07.014414 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:45:07.014414 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:45:07.015462 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:45:07.015462 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:07.015462 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:07.015462 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:07.015462 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:07.015462 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:07.015462 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:07.015462 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:07.015462 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:07.015462 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:07.015462 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:07.015462 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:07.015462 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:07.015462 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:07.015462 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:07.015462 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:07.015462 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:07.016323 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:45:07.016323 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:45:07.016323 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:45:07.016323 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:45:07.016323 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:45:07.016323 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:45:07.016323 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:45:07.016323 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:07.016323 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 469/926] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:45:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:45:07.021674 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8cb2c-dd06-45d3-8f8b-91a83926ba01 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:07.037374 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 458/927] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:45:07.125645 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:07.134656 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8cb2c-dd06-45d3-8f8b-91a83926ba01 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:07.172059 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb94eb5-6f7a-48f1-b68c-7ba2edd8a59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:07.172876 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb94eb5-6f7a-48f1-b68c-7ba2edd8a59b None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:07.173161 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb94eb5-6f7a-48f1-b68c-7ba2edd8a59b None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:07.173437 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb94eb5-6f7a-48f1-b68c-7ba2edd8a59b None admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:07.174144 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb94eb5-6f7a-48f1-b68c-7ba2edd8a59b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:07.174515 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb94eb5-6f7a-48f1-b68c-7ba2edd8a59b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:07.175989 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb94eb5-6f7a-48f1-b68c-7ba2edd8a59b None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:07.180144 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e5909-c3f3-4df2-87ce-c2a478fe827a None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:07.191078 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 470/928] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:45:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:07.202046 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb94eb5-6f7a-48f1-b68c-7ba2edd8a59b None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:07.318754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:07.346196 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e5909-c3f3-4df2-87ce-c2a478fe827a None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:07.367584 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb94eb5-6f7a-48f1-b68c-7ba2edd8a59b None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:07.399313 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695d8ab-17ec-493a-8e79-575ab982d60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:07.401576 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695d8ab-17ec-493a-8e79-575ab982d60f None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:07.401576 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695d8ab-17ec-493a-8e79-575ab982d60f None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:07.401576 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695d8ab-17ec-493a-8e79-575ab982d60f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:07.401849 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695d8ab-17ec-493a-8e79-575ab982d60f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:07.403763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695d8ab-17ec-493a-8e79-575ab982d60f None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:07.411563 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a18441-dce6-454b-86a4-3f0d5de5c4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:07.412245 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a18441-dce6-454b-86a4-3f0d5de5c4df None admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:07.412526 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a18441-dce6-454b-86a4-3f0d5de5c4df None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:07.412823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a18441-dce6-454b-86a4-3f0d5de5c4df None admin] PATH_INFO: `/v3/projects/9b25a7c01ab540ceae16dd618b848f2d/users/eaf3821dd57a4d8f9ca6385c202bb0ed/roles/645ada3cca2e4ac49e7055528e4748d6` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:07.413786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-3695d8ab-17ec-493a-8e79-575ab982d60f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 15:45:07.413786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:07.413786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:45:07.413786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:45:07.413786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:45:07.413786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:45:07.413786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:45:07.413786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:45:07.413786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 15:45:07.413786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:07.413786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:45:07.413786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:07.413786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:07.413786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:07.413786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:07.413786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:07.413786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:07.414731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:07.414731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:07.414731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:07.414731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:07.414731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:07.414731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:07.414731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:45:07.414731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:45:07.414731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:45:07.414731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:45:07.414731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:07.414731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:07.414731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:07.414731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:07.414731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:07.414731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:07.415554 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:07.415554 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:07.415554 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:07.415554 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:07.415554 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:07.415554 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:07.415554 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:07.415554 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:07.415554 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:07.415554 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:07.415554 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:45:07.415554 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:45:07.415554 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 15:45:07.415554 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:07.416898 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a18441-dce6-454b-86a4-3f0d5de5c4df None admin] RBAC: Authorizing `identity:create_grant(project_id=9b25a7c01ab540ceae16dd618b848f2d, user_id=eaf3821dd57a4d8f9ca6385c202bb0ed, role_id=645ada3cca2e4ac49e7055528e4748d6)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:07.416898 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a18441-dce6-454b-86a4-3f0d5de5c4df None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:07.419901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 459/929] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 24 15:45:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:45:07.420760 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695d8ab-17ec-493a-8e79-575ab982d60f None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:07.521530 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 471/930] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 24 15:45:07 2022] PUT /identity/v3/projects/9b25a7c01ab540ceae16dd618b848f2d/users/eaf3821dd57a4d8f9ca6385c202bb0ed/roles/645ada3cca2e4ac49e7055528e4748d6 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:07.522621 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a18441-dce6-454b-86a4-3f0d5de5c4df None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:07.546394 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695d8ab-17ec-493a-8e79-575ab982d60f None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:07.548090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:07.606747 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78373123-b147-497f-bb9b-3e2f3509855c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:07.607655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78373123-b147-497f-bb9b-3e2f3509855c None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:07.608203 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78373123-b147-497f-bb9b-3e2f3509855c None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:07.608659 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78373123-b147-497f-bb9b-3e2f3509855c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:07.609639 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78373123-b147-497f-bb9b-3e2f3509855c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:07.611245 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78373123-b147-497f-bb9b-3e2f3509855c None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:07.621946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-78373123-b147-497f-bb9b-3e2f3509855c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 15:45:07.621946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:07.621946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:45:07.621946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:45:07.621946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:45:07.621946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:45:07.621946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:45:07.621946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:45:07.621946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 15:45:07.621946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:07.621946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:45:07.621946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:07.621946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:07.621946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:07.621946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:07.621946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:07.623058 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:07.623058 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:07.623058 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:07.623058 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:07.623058 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:07.623058 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:07.623058 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:07.623058 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:45:07.623058 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:45:07.623058 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:45:07.623058 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:45:07.623058 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:07.623058 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:07.623058 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:07.623058 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:07.623058 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:07.623058 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:07.624051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:07.624051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:07.624051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:07.624051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:07.624051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:07.624051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:07.624051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:07.624051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:07.624051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:07.624051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:07.624051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:45:07.624051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:45:07.624051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 15:45:07.624051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:07.627809 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 460/931] 10.222.0.64 () {56 vars in 1132 bytes} [Wed Aug 24 15:45:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:07.633669 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78373123-b147-497f-bb9b-3e2f3509855c None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:07.669104 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:07.680021 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a18441-dce6-454b-86a4-3f0d5de5c4df None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:07.725326 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba507fa-aaa0-4934-9e03-b133af3cee7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:07.725978 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba507fa-aaa0-4934-9e03-b133af3cee7f None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:07.726255 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba507fa-aaa0-4934-9e03-b133af3cee7f None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:07.726560 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba507fa-aaa0-4934-9e03-b133af3cee7f None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:07.727232 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba507fa-aaa0-4934-9e03-b133af3cee7f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:07.727542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba507fa-aaa0-4934-9e03-b133af3cee7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:07.728951 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba507fa-aaa0-4934-9e03-b133af3cee7f None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:07.734301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 472/932] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 24 15:45:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:07.735403 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a0875-f196-4bcb-a762-69e96a2a195e None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:07.735691 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a0875-f196-4bcb-a762-69e96a2a195e None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:07.735972 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a0875-f196-4bcb-a762-69e96a2a195e None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:07.737403 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 473/933] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:07.742149 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a0875-f196-4bcb-a762-69e96a2a195e None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:07.776467 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78373123-b147-497f-bb9b-3e2f3509855c None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:07.820744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16481adc-1aa9-4314-8094-4848a6feb529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:07.821366 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16481adc-1aa9-4314-8094-4848a6feb529 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:07.821645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16481adc-1aa9-4314-8094-4848a6feb529 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:07.822197 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16481adc-1aa9-4314-8094-4848a6feb529 None admin] PATH_INFO: `/v3/services` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:07.822550 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16481adc-1aa9-4314-8094-4848a6feb529 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:07.822853 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16481adc-1aa9-4314-8094-4848a6feb529 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:07.824228 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16481adc-1aa9-4314-8094-4848a6feb529 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:07.834321 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 461/934] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 24 15:45:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:07.834321 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6626c-61a0-4459-b67f-ac9ca85b5cb8 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:07.834321 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6626c-61a0-4459-b67f-ac9ca85b5cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:07.834321 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6626c-61a0-4459-b67f-ac9ca85b5cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:07.841640 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:07.851598 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-49e6626c-61a0-4459-b67f-ac9ca85b5cb8 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:07.852843 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-49e6626c-61a0-4459-b67f-ac9ca85b5cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:07.875402 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a0875-f196-4bcb-a762-69e96a2a195e None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:07.914565 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f777c70-1745-4fc6-9cfb-da328190856e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:07.915176 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f777c70-1745-4fc6-9cfb-da328190856e None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:07.915453 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f777c70-1745-4fc6-9cfb-da328190856e None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:07.915720 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f777c70-1745-4fc6-9cfb-da328190856e None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:07.916355 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f777c70-1745-4fc6-9cfb-da328190856e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:07.916673 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f777c70-1745-4fc6-9cfb-da328190856e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:07.918060 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f777c70-1745-4fc6-9cfb-da328190856e None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:07.924433 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 474/935] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 24 15:45:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:07.925327 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f777c70-1745-4fc6-9cfb-da328190856e None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:07.937059 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 462/936] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:45:07.939052 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6626c-61a0-4459-b67f-ac9ca85b5cb8 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:07.942605 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:08.075973 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f777c70-1745-4fc6-9cfb-da328190856e None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:08.091212 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6626c-61a0-4459-b67f-ac9ca85b5cb8 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:08.121053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515db5b-7d38-457c-b949-32224a39c225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:08.122221 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515db5b-7d38-457c-b949-32224a39c225 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:08.122722 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515db5b-7d38-457c-b949-32224a39c225 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:08.123172 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515db5b-7d38-457c-b949-32224a39c225 None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:08.124250 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515db5b-7d38-457c-b949-32224a39c225 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:08.124828 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515db5b-7d38-457c-b949-32224a39c225 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:08.127489 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515db5b-7d38-457c-b949-32224a39c225 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:08.133720 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 475/937] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 24 15:45:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:08.142147 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515db5b-7d38-457c-b949-32224a39c225 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:08.160067 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b6bd8-2077-44f3-b78d-71f9bc8acb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:08.160993 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:08.162576 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b6bd8-2077-44f3-b78d-71f9bc8acb02 None admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:08.163060 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b6bd8-2077-44f3-b78d-71f9bc8acb02 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:08.163452 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b6bd8-2077-44f3-b78d-71f9bc8acb02 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:08.164998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b6bd8-2077-44f3-b78d-71f9bc8acb02 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:08.166407 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b6bd8-2077-44f3-b78d-71f9bc8acb02 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:08.261225 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 463/938] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 15:45:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:08.261660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515db5b-7d38-457c-b949-32224a39c225 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:08.262310 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b6bd8-2077-44f3-b78d-71f9bc8acb02 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:08.338158 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5accb-677a-4d9f-9e88-a7d6a4c4cc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:08.338950 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5accb-677a-4d9f-9e88-a7d6a4c4cc7a None admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:08.339325 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5accb-677a-4d9f-9e88-a7d6a4c4cc7a None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:08.339751 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5accb-677a-4d9f-9e88-a7d6a4c4cc7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:08.340855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5accb-677a-4d9f-9e88-a7d6a4c4cc7a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:08.343154 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5accb-677a-4d9f-9e88-a7d6a4c4cc7a None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:08.347212 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:08.402630 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b6bd8-2077-44f3-b78d-71f9bc8acb02 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:08.443314 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815f153-f14e-42d3-8527-3263726944bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:08.444057 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815f153-f14e-42d3-8527-3263726944bf None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:08.444449 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815f153-f14e-42d3-8527-3263726944bf None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:08.444912 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815f153-f14e-42d3-8527-3263726944bf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:08.445658 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815f153-f14e-42d3-8527-3263726944bf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:08.448950 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815f153-f14e-42d3-8527-3263726944bf None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:08.461471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-f815f153-f14e-42d3-8527-3263726944bf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 15:45:08.461471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:08.461471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:45:08.461471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:45:08.461471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:45:08.461471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:45:08.461471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:45:08.461471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:45:08.461471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 15:45:08.461471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:08.461471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:45:08.461471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:08.461471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:08.461471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:08.461471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:08.461471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:08.461471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:08.463446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:08.463446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:08.463446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:08.463446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:08.463446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:08.463446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:08.463446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:45:08.463446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:45:08.463446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:45:08.463446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:45:08.463446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:08.463446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:08.463446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:08.463446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:08.463446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:08.463446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:08.465203 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:08.465203 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:08.465203 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:08.465203 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:08.465203 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:08.465203 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:08.465203 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:08.465203 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:08.465203 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:08.465203 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:08.465203 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:45:08.465203 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:45:08.465203 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 15:45:08.465203 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:08.468929 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 464/939] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 24 15:45:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:08.475257 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815f153-f14e-42d3-8527-3263726944bf None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:08.476949 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 476/940] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 15:45:08 2022] POST /identity/v3/endpoints => generated 347 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:08.609583 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815f153-f14e-42d3-8527-3263726944bf None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:08.637290 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:08.657590 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d509f6-ebab-4c50-917b-28b85d85be5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:08.658276 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d509f6-ebab-4c50-917b-28b85d85be5c None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:08.658616 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d509f6-ebab-4c50-917b-28b85d85be5c None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:08.658891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d509f6-ebab-4c50-917b-28b85d85be5c None admin] PATH_INFO: `/v3/services` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:08.659626 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d509f6-ebab-4c50-917b-28b85d85be5c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:08.659929 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d509f6-ebab-4c50-917b-28b85d85be5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:08.661394 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d509f6-ebab-4c50-917b-28b85d85be5c None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:08.669069 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 465/941] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 24 15:45:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:08.675549 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5accb-677a-4d9f-9e88-a7d6a4c4cc7a None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:08.745224 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:08.793085 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5accb-677a-4d9f-9e88-a7d6a4c4cc7a None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:08.831825 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5862ca0-4710-46de-895b-2ca2b4da6f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:08.832442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5862ca0-4710-46de-895b-2ca2b4da6f12 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:08.832756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5862ca0-4710-46de-895b-2ca2b4da6f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:08.833033 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5862ca0-4710-46de-895b-2ca2b4da6f12 None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:08.833679 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5862ca0-4710-46de-895b-2ca2b4da6f12 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:08.834046 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5862ca0-4710-46de-895b-2ca2b4da6f12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:08.835452 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5862ca0-4710-46de-895b-2ca2b4da6f12 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:08.841213 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 477/942] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 24 15:45:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:08.847066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d509f6-ebab-4c50-917b-28b85d85be5c None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:08.966545 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d509f6-ebab-4c50-917b-28b85d85be5c None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:09.004161 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08ea3b-f708-4df0-a742-32270f148551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:09.004813 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08ea3b-f708-4df0-a742-32270f148551 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:09.005097 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08ea3b-f708-4df0-a742-32270f148551 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:09.005369 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08ea3b-f708-4df0-a742-32270f148551 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:09.006075 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08ea3b-f708-4df0-a742-32270f148551 None admin] RBAC: Adding query filter params (interface=public, service_id=53b2f276dbff4d059aeff4ed682b04b2, region_id=RegionOne) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:09.006385 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08ea3b-f708-4df0-a742-32270f148551 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:09.007761 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08ea3b-f708-4df0-a742-32270f148551 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:09.015416 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 466/943] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Aug 24 15:45:08 2022] GET /identity/v3/endpoints?service_id=53b2f276dbff4d059aeff4ed682b04b2&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:09.021259 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5862ca0-4710-46de-895b-2ca2b4da6f12 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:09.132505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5862ca0-4710-46de-895b-2ca2b4da6f12 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:09.153318 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:09.169061 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf6ff7-4175-45e3-8699-51cd6e20dc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:09.169668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf6ff7-4175-45e3-8699-51cd6e20dc22 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:09.169949 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf6ff7-4175-45e3-8699-51cd6e20dc22 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:09.170222 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf6ff7-4175-45e3-8699-51cd6e20dc22 None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:09.170880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf6ff7-4175-45e3-8699-51cd6e20dc22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:09.173013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf6ff7-4175-45e3-8699-51cd6e20dc22 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:09.179465 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 478/944] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 24 15:45:09 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:09.529803 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a4c04-b3df-4062-950e-a130ae0a6c42 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:09.530142 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a4c04-b3df-4062-950e-a130ae0a6c42 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:09.530364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a4c04-b3df-4062-950e-a130ae0a6c42 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:09.532785 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 467/945] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:09.538461 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e231b-d5ee-49f5-9f5c-a27c302a0346 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:09.538962 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e231b-d5ee-49f5-9f5c-a27c302a0346 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:09.539038 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e231b-d5ee-49f5-9f5c-a27c302a0346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:09.568096 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-9c7e231b-d5ee-49f5-9f5c-a27c302a0346 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:09.569253 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-9c7e231b-d5ee-49f5-9f5c-a27c302a0346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:09.649025 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 479/946] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:45:09.922425 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a4c04-b3df-4062-950e-a130ae0a6c42 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:09.987535 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:10.043481 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a4c04-b3df-4062-950e-a130ae0a6c42 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:10.080503 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f33167-db54-4563-86b0-172be6e48b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:10.081190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f33167-db54-4563-86b0-172be6e48b75 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:10.081479 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f33167-db54-4563-86b0-172be6e48b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:10.081752 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f33167-db54-4563-86b0-172be6e48b75 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:10.093141 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f33167-db54-4563-86b0-172be6e48b75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:45:10.098858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-d6f33167-db54-4563-86b0-172be6e48b75 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 15:45:10.098858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:10.098858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:10.098858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:10.098858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:10.098858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:10.098858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:10.098858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:10.098858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:10.098858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:10.098858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:10.098858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:10.098858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:45:10.098858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:45:10.098858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:45:10.098858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:45:10.099798 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:45:10.099798 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:45:10.099798 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:45:10.099798 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:45:10.099798 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:10.099798 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:10.099798 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:10.099798 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:10.099798 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:10.099798 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:10.099798 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:10.099798 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:10.099798 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:10.099798 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:10.099798 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:10.099798 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:10.100614 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:10.100614 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:10.100614 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:10.100614 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:10.100614 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:45:10.100614 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:45:10.100614 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:45:10.100614 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:45:10.100614 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:45:10.100614 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:45:10.100614 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 15:45:10.100614 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:10.100614 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 468/947] 10.222.0.64 () {56 vars in 1120 bytes} [Wed Aug 24 15:45:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:10.106061 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e231b-d5ee-49f5-9f5c-a27c302a0346 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:10.214674 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e231b-d5ee-49f5-9f5c-a27c302a0346 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:10.230729 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:10.253609 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09224576-d9a1-4af7-b0e3-3194e7e2fb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:10.254236 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09224576-d9a1-4af7-b0e3-3194e7e2fb8c None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:10.254520 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09224576-d9a1-4af7-b0e3-3194e7e2fb8c None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:10.254793 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09224576-d9a1-4af7-b0e3-3194e7e2fb8c None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:10.255631 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09224576-d9a1-4af7-b0e3-3194e7e2fb8c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:10.255907 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09224576-d9a1-4af7-b0e3-3194e7e2fb8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:10.257499 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09224576-d9a1-4af7-b0e3-3194e7e2fb8c None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:10.267776 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 480/948] 10.222.0.64 () {56 vars in 1115 bytes} [Wed Aug 24 15:45:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:10.273416 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f33167-db54-4563-86b0-172be6e48b75 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:10.399407 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f33167-db54-4563-86b0-172be6e48b75 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:10.414206 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:10.444826 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9716fbc-aa7c-4914-a9a1-8219ed940d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:10.445483 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9716fbc-aa7c-4914-a9a1-8219ed940d87 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:10.445987 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9716fbc-aa7c-4914-a9a1-8219ed940d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:10.446262 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9716fbc-aa7c-4914-a9a1-8219ed940d87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:10.457364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9716fbc-aa7c-4914-a9a1-8219ed940d87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:10.458827 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9716fbc-aa7c-4914-a9a1-8219ed940d87 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:10.475056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-f9716fbc-aa7c-4914-a9a1-8219ed940d87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:45:10.475056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:10.475056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:10.475056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:10.475056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:10.475056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:10.475056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:10.475056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:10.475056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:10.475056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:10.475056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:10.475056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:10.475056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:45:10.475056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:45:10.475056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:45:10.475056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:45:10.476001 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:10.476001 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:10.476001 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:10.476001 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:10.476001 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:10.476001 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:10.476001 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:10.476001 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:10.476001 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:10.476001 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:10.476001 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:10.476001 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:10.476001 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:10.476001 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:10.476001 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:10.476001 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:10.476001 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:45:10.476925 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:45:10.476925 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:45:10.476925 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:10.476925 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 469/949] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:45:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:10.483647 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09224576-d9a1-4af7-b0e3-3194e7e2fb8c None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:10.553879 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2e150-017a-4c96-a553-864222827c2a None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:10.554276 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2e150-017a-4c96-a553-864222827c2a None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:10.554552 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2e150-017a-4c96-a553-864222827c2a None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:10.556740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 470/950] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:10 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:45:10.558232 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b838fb-378c-4739-8a55-58e6fd691175 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:10.558523 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b838fb-378c-4739-8a55-58e6fd691175 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:10.558804 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b838fb-378c-4739-8a55-58e6fd691175 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:10.560316 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 471/951] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:10.563320 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e81325-170e-4fb0-9a3f-9611f897f314 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:10.563629 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e81325-170e-4fb0-9a3f-9611f897f314 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:10.563871 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e81325-170e-4fb0-9a3f-9611f897f314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:10.585763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-68e81325-170e-4fb0-9a3f-9611f897f314 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:10.586950 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-68e81325-170e-4fb0-9a3f-9611f897f314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:10.605841 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09224576-d9a1-4af7-b0e3-3194e7e2fb8c None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:10.644505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf587ad8-44cd-4a38-b504-9d9e6c9c1945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:10.645157 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf587ad8-44cd-4a38-b504-9d9e6c9c1945 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:10.645445 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf587ad8-44cd-4a38-b504-9d9e6c9c1945 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:10.645711 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf587ad8-44cd-4a38-b504-9d9e6c9c1945 None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:10.646368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf587ad8-44cd-4a38-b504-9d9e6c9c1945 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:10.646666 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf587ad8-44cd-4a38-b504-9d9e6c9c1945 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:10.648047 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf587ad8-44cd-4a38-b504-9d9e6c9c1945 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:10.662010 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 481/952] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:10.663699 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290bbec-4f58-406f-9de0-59fc3ec98161 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:10.663994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290bbec-4f58-406f-9de0-59fc3ec98161 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:10.664269 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290bbec-4f58-406f-9de0-59fc3ec98161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:10.682659 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 472/953] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:45:10.689839 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e81325-170e-4fb0-9a3f-9611f897f314 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:10.692815 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-e290bbec-4f58-406f-9de0-59fc3ec98161 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:10.693909 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-e290bbec-4f58-406f-9de0-59fc3ec98161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:10.737491 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:10.789127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 482/954] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:45:10.813266 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:10.823976 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e81325-170e-4fb0-9a3f-9611f897f314 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:10.862374 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1711a30-92fd-4806-be4a-1c6827480e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:10.863389 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1711a30-92fd-4806-be4a-1c6827480e8e None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:10.863897 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1711a30-92fd-4806-be4a-1c6827480e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:10.864362 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1711a30-92fd-4806-be4a-1c6827480e8e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:10.872655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1711a30-92fd-4806-be4a-1c6827480e8e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:10.874440 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1711a30-92fd-4806-be4a-1c6827480e8e None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:10.887536 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-e1711a30-92fd-4806-be4a-1c6827480e8e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 15:45:10.887536 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:10.887536 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:10.887536 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:10.887536 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:10.887536 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:10.887536 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:10.887536 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:10.887536 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:10.887536 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:10.887536 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:10.887536 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:10.887536 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:45:10.887536 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:45:10.887536 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:45:10.887536 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:45:10.888516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:10.888516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:10.888516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:45:10.888516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:45:10.888516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:45:10.888516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:45:10.888516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:10.888516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:10.888516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:10.888516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:10.888516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:10.888516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:10.888516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:10.888516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:10.888516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:10.888516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:10.888516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:10.888516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:10.889502 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:10.889502 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:10.889502 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:45:10.889502 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:45:10.889502 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:45:10.889502 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:45:10.889502 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:45:10.889502 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:45:10.889502 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 15:45:10.889502 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:10.892849 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 473/955] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 24 15:45:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:10.904049 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290bbec-4f58-406f-9de0-59fc3ec98161 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:10.959549 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1711a30-92fd-4806-be4a-1c6827480e8e None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:11.015720 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290bbec-4f58-406f-9de0-59fc3ec98161 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:11.055353 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58e99f-0eb4-4f5e-8b3a-74a4ef317c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:11.056490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58e99f-0eb4-4f5e-8b3a-74a4ef317c3f None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:11.057292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58e99f-0eb4-4f5e-8b3a-74a4ef317c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:11.058108 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58e99f-0eb4-4f5e-8b3a-74a4ef317c3f None admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:11.059560 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58e99f-0eb4-4f5e-8b3a-74a4ef317c3f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:11.060442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58e99f-0eb4-4f5e-8b3a-74a4ef317c3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:11.063881 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58e99f-0eb4-4f5e-8b3a-74a4ef317c3f None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:11.085349 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 483/956] 10.222.0.64 () {56 vars in 1149 bytes} [Wed Aug 24 15:45:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:11.090226 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1711a30-92fd-4806-be4a-1c6827480e8e None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:11.090317 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58e99f-0eb4-4f5e-8b3a-74a4ef317c3f None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:11.129935 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:11.137728 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfcdb8-31bb-403a-b9fb-ea1e3204e416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:11.138349 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfcdb8-31bb-403a-b9fb-ea1e3204e416 None admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:11.138631 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfcdb8-31bb-403a-b9fb-ea1e3204e416 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:11.138904 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfcdb8-31bb-403a-b9fb-ea1e3204e416 None admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:11.139564 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbfcdb8-31bb-403a-b9fb-ea1e3204e416 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:11.142109 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbfcdb8-31bb-403a-b9fb-ea1e3204e416 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:11.146555 dv-cinder-849325-3-smb devstack@keystone.service[81717]: WARNING keystone.server.flask.common [None req-cdbfcdb8-31bb-403a-b9fb-ea1e3204e416 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 15:45:11.194891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.sql.core [None req-cdbfcdb8-31bb-403a-b9fb-ea1e3204e416 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 15:45:11.194891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 15:45:11.194891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [parameters: {'id': '0e45c040920c4a1fbbeed8509e20d1cc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 15:45:11.194891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81717) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 15:45:11.201779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-cdbfcdb8-31bb-403a-b9fb-ea1e3204e416 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0e45c040920c4a1fbbeed8509e20d1cc.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0e45c040920c4a1fbbeed8509e20d1cc. Aug 24 15:45:11.201779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:11.201779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 15:45:11.201779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 15:45:11.201779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 15:45:11.201779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 15:45:11.201779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 15:45:11.201779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 15:45:11.201779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 15:45:11.201779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application conn.query(q) Aug 24 15:45:11.201779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 15:45:11.201779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 15:45:11.201779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 15:45:11.203214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application result.read() Aug 24 15:45:11.203214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 15:45:11.203214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 15:45:11.203214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 15:45:11.203214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 15:45:11.203214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 15:45:11.203214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 15:45:11.203214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 15:45:11.203214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 15:45:11.203214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 15:45:11.203214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:11.203214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 15:45:11.203214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:11.203214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:11.203214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 15:45:11.203214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 15:45:11.203214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 15:45:11.203214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 15:45:11.210939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 15:45:11.210939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application next(self.gen) Aug 24 15:45:11.210939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 15:45:11.210939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application yield resource Aug 24 15:45:11.210939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 15:45:11.210939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application next(self.gen) Aug 24 15:45:11.210939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 15:45:11.210939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 15:45:11.210939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 15:45:11.210939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 15:45:11.210939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 15:45:11.210939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise self.value Aug 24 15:45:11.210939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 15:45:11.210939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 15:45:11.210939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 15:45:11.210939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application session.commit() Aug 24 15:45:11.210939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 15:45:11.212090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 15:45:11.212090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 15:45:11.212090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 15:45:11.212090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 15:45:11.212090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self.session.flush() Aug 24 15:45:11.212090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 15:45:11.212090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 15:45:11.212090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 15:45:11.212090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 15:45:11.212090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 15:45:11.212090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application compat.raise_( Aug 24 15:45:11.212090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 15:45:11.212090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception Aug 24 15:45:11.212090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 15:45:11.212090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 15:45:11.212090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 15:45:11.212090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 15:45:11.213227 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 15:45:11.213227 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 15:45:11.213227 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 15:45:11.213227 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 15:45:11.213227 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 15:45:11.213227 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 15:45:11.213227 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 15:45:11.213227 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 15:45:11.213227 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 15:45:11.213227 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 15:45:11.213227 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 15:45:11.213227 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 15:45:11.213227 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 15:45:11.213227 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 15:45:11.213227 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 15:45:11.214214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 15:45:11.214214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 15:45:11.214214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception Aug 24 15:45:11.214214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 15:45:11.214214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 15:45:11.214214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 15:45:11.214214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 15:45:11.214214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 15:45:11.214214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 15:45:11.214214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 15:45:11.214214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application conn.query(q) Aug 24 15:45:11.214214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 15:45:11.214214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 15:45:11.214214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 15:45:11.214214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application result.read() Aug 24 15:45:11.214214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 15:45:11.214214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 15:45:11.215477 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 15:45:11.215477 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 15:45:11.215477 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 15:45:11.215477 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 15:45:11.215477 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 15:45:11.215477 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 15:45:11.215477 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 15:45:11.215477 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 15:45:11.215477 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [parameters: {'id': '0e45c040920c4a1fbbeed8509e20d1cc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 15:45:11.215477 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 15:45:11.215477 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:11.215477 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:45:11.215477 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:11.215477 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:11.215477 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 15:45:11.216469 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 15:45:11.216469 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 15:45:11.216469 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 15:45:11.216469 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 15:45:11.216469 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:11.216469 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:45:11.216469 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:11.216469 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:11.216469 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:11.216469 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:11.216469 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:11.216469 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:11.216469 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:11.216469 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:11.216469 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:11.216469 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:11.216469 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:11.217666 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:11.217666 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 15:45:11.217666 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 15:45:11.217666 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:11.217666 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:11.217666 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 15:45:11.217666 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 15:45:11.217666 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0e45c040920c4a1fbbeed8509e20d1cc. Aug 24 15:45:11.217666 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:11.217666 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 474/957] 10.222.0.64 () {60 vars in 1140 bytes} [Wed Aug 24 15:45:10 2022] POST /identity/v3/projects => generated 262 bytes in 245 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:45:11.217666 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfcdb8-31bb-403a-b9fb-ea1e3204e416 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:11.221728 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58e99f-0eb4-4f5e-8b3a-74a4ef317c3f None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:11.225382 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:11.268219 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a5f83-73c1-4e66-b9b1-ded273d40654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:11.268868 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a5f83-73c1-4e66-b9b1-ded273d40654 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:11.269182 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a5f83-73c1-4e66-b9b1-ded273d40654 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:11.269468 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a5f83-73c1-4e66-b9b1-ded273d40654 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:11.270069 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a5f83-73c1-4e66-b9b1-ded273d40654 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:11.271495 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a5f83-73c1-4e66-b9b1-ded273d40654 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:11.281263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-397a5f83-73c1-4e66-b9b1-ded273d40654 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 15:45:11.281263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:11.281263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:45:11.281263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:45:11.281263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:45:11.281263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:45:11.281263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:45:11.281263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:45:11.281263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 15:45:11.281263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:11.281263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:45:11.281263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:11.281263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:11.281263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:11.281263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:11.281263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:11.281263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:11.282432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:11.282432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:11.282432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:11.282432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:11.282432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:11.282432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:11.282432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:45:11.282432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:45:11.282432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:45:11.282432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:45:11.282432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:11.282432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:11.282432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:11.282432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:11.282432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:11.282432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:11.283290 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:11.283290 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:11.283290 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:11.283290 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:11.283290 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:11.283290 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:11.283290 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:11.283290 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:11.283290 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:11.283290 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:11.283290 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:45:11.283290 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:45:11.283290 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 15:45:11.283290 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:11.283290 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 484/958] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:45:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:11.284159 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a5f83-73c1-4e66-b9b1-ded273d40654 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:11.339935 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfcdb8-31bb-403a-b9fb-ea1e3204e416 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:11.375488 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6f27f-14dc-4b6e-84ce-864d7aaa26fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:11.376099 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6f27f-14dc-4b6e-84ce-864d7aaa26fe None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:11.376392 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6f27f-14dc-4b6e-84ce-864d7aaa26fe None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:11.376681 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6f27f-14dc-4b6e-84ce-864d7aaa26fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:11.383703 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:11.397334 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a5f83-73c1-4e66-b9b1-ded273d40654 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:11.434070 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca1f76-3e71-4a6c-8e0b-71c446051f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:11.434822 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca1f76-3e71-4a6c-8e0b-71c446051f82 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:11.435206 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca1f76-3e71-4a6c-8e0b-71c446051f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:11.435570 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca1f76-3e71-4a6c-8e0b-71c446051f82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:11.446750 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca1f76-3e71-4a6c-8e0b-71c446051f82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:11.449022 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca1f76-3e71-4a6c-8e0b-71c446051f82 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:11.451434 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6f27f-14dc-4b6e-84ce-864d7aaa26fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:11.454547 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6f27f-14dc-4b6e-84ce-864d7aaa26fe None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:11.464711 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-5aca1f76-3e71-4a6c-8e0b-71c446051f82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:45:11.464711 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:11.464711 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:11.464711 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:11.464711 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:11.464711 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:11.464711 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:11.464711 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:11.464711 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:11.464711 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:11.464711 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:11.464711 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:11.464711 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:45:11.464711 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:45:11.464711 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:45:11.466442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:45:11.466442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:11.466442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:11.466442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:11.466442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:11.466442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:11.466442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:11.466442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:11.466442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:11.466442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:11.466442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:11.466442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:11.466442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:11.466442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:11.466442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:11.466442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:11.466442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:11.468028 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:45:11.468028 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:45:11.468028 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:45:11.468028 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:45:11.468028 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:45:11.468028 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:45:11.468028 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:45:11.468028 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:11.469000 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:11.469133 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 485/959] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:45:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:11.469133 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351d45d-abc5-4154-8e2a-08e037bfc164 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:11.469133 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351d45d-abc5-4154-8e2a-08e037bfc164 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:11.469133 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351d45d-abc5-4154-8e2a-08e037bfc164 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:11.469991 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 486/960] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:11.469991 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351d45d-abc5-4154-8e2a-08e037bfc164 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:11.568470 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 475/961] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:45:11 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:45:11.569268 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6f27f-14dc-4b6e-84ce-864d7aaa26fe None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:11.582345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351d45d-abc5-4154-8e2a-08e037bfc164 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:11.616720 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7ec9b-ad38-4d60-a3f3-674faf8aebc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:11.617407 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7ec9b-ad38-4d60-a3f3-674faf8aebc6 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:11.617586 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7ec9b-ad38-4d60-a3f3-674faf8aebc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:11.617851 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7ec9b-ad38-4d60-a3f3-674faf8aebc6 None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:11.618487 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7ec9b-ad38-4d60-a3f3-674faf8aebc6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:11.618787 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7ec9b-ad38-4d60-a3f3-674faf8aebc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:11.620150 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7ec9b-ad38-4d60-a3f3-674faf8aebc6 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:11.626198 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 487/962] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 24 15:45:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:11.627408 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2853a1-fe10-4cf1-9b74-a1cca9ab804c None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:11.627687 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2853a1-fe10-4cf1-9b74-a1cca9ab804c None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:11.627959 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2853a1-fe10-4cf1-9b74-a1cca9ab804c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:11.646026 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-3c2853a1-fe10-4cf1-9b74-a1cca9ab804c None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:11.647245 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-3c2853a1-fe10-4cf1-9b74-a1cca9ab804c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:11.655356 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:11.686402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6f27f-14dc-4b6e-84ce-864d7aaa26fe None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:11.694785 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:11.719731 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 488/963] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:45:11.720717 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2853a1-fe10-4cf1-9b74-a1cca9ab804c None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:11.727530 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637bbdd9-c92e-44e7-aa20-9ce9cb38035a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:11.728474 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637bbdd9-c92e-44e7-aa20-9ce9cb38035a None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:11.729401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637bbdd9-c92e-44e7-aa20-9ce9cb38035a None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:11.729811 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637bbdd9-c92e-44e7-aa20-9ce9cb38035a None admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:11.730607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637bbdd9-c92e-44e7-aa20-9ce9cb38035a None admin] RBAC: Adding query filter params (name=service) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:11.731394 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637bbdd9-c92e-44e7-aa20-9ce9cb38035a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:11.733520 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637bbdd9-c92e-44e7-aa20-9ce9cb38035a None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:11.768426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 476/964] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 24 15:45:11 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:11.768426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637bbdd9-c92e-44e7-aa20-9ce9cb38035a None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:11.870761 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2853a1-fe10-4cf1-9b74-a1cca9ab804c None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:11.889669 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637bbdd9-c92e-44e7-aa20-9ce9cb38035a None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:11.933201 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a83606-9a08-4927-bbf5-74f052046f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:11.933850 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a83606-9a08-4927-bbf5-74f052046f39 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:11.935343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a83606-9a08-4927-bbf5-74f052046f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:11.935343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a83606-9a08-4927-bbf5-74f052046f39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:11.945869 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f35bb-00dd-46fb-b202-9473574835ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:11.946665 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f35bb-00dd-46fb-b202-9473574835ba None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:11.947065 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f35bb-00dd-46fb-b202-9473574835ba None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:11.947357 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f35bb-00dd-46fb-b202-9473574835ba None admin] PATH_INFO: `/v3/services` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:11.947833 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a83606-9a08-4927-bbf5-74f052046f39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:11.947995 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f35bb-00dd-46fb-b202-9473574835ba None admin] RBAC: Adding query filter params (type=compute) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:11.948299 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f35bb-00dd-46fb-b202-9473574835ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:11.949348 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a83606-9a08-4927-bbf5-74f052046f39 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:11.949787 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f35bb-00dd-46fb-b202-9473574835ba None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:11.953753 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:11.959643 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 477/965] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 24 15:45:11 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:11.975177 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-e3a83606-9a08-4927-bbf5-74f052046f39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:45:11.975177 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:11.975177 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:11.975177 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:11.975177 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:11.975177 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:11.975177 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:11.975177 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:11.975177 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:11.975177 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:11.975177 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:11.975177 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:11.975177 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:45:11.975177 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:45:11.975177 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:45:11.975177 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:45:11.976377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:11.976377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:11.976377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:11.976377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:11.976377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:11.976377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:11.976377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:11.976377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:11.976377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:11.976377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:11.976377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:11.976377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:11.976377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:11.976377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:11.976377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:11.976377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:11.976377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:45:11.977596 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:45:11.977596 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:45:11.977596 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:11.977596 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 489/966] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:45:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:11.980316 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f35bb-00dd-46fb-b202-9473574835ba None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:11.992987 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a83606-9a08-4927-bbf5-74f052046f39 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:12.038577 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:12.141403 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a83606-9a08-4927-bbf5-74f052046f39 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:12.151964 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f35bb-00dd-46fb-b202-9473574835ba None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:12.187636 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532a3b1-2b56-4335-b63f-e44f82a1cb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:12.188541 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532a3b1-2b56-4335-b63f-e44f82a1cb69 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:12.189033 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532a3b1-2b56-4335-b63f-e44f82a1cb69 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:12.189459 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532a3b1-2b56-4335-b63f-e44f82a1cb69 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:12.190203 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532a3b1-2b56-4335-b63f-e44f82a1cb69 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:12.191757 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532a3b1-2b56-4335-b63f-e44f82a1cb69 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:12.197428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc82a76-79a0-44e5-b13b-79e5985ed74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:12.198545 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc82a76-79a0-44e5-b13b-79e5985ed74d None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:12.204013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-7532a3b1-2b56-4335-b63f-e44f82a1cb69 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 15:45:12.204013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:12.204013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:45:12.204013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:45:12.204013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:45:12.204013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:45:12.204013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:45:12.204013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:45:12.204013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 15:45:12.204013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:12.204013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:45:12.204013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:12.204013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:12.204013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:12.204013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:12.204013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:12.204013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:12.205278 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:12.205278 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:12.205278 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:12.205278 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:12.205278 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:12.205278 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:12.205278 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:45:12.205278 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:45:12.205278 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:45:12.205278 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:45:12.205278 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:12.205278 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:12.205278 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:12.205278 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:12.205278 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:12.205278 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:12.206304 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:12.206304 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:12.206304 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:12.206304 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:12.206304 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:12.206304 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:12.206304 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:12.206304 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:12.206304 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:12.206304 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:12.206304 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:45:12.206304 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:45:12.206304 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 15:45:12.206304 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:12.207509 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc82a76-79a0-44e5-b13b-79e5985ed74d None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:12.207917 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc82a76-79a0-44e5-b13b-79e5985ed74d None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:12.208766 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc82a76-79a0-44e5-b13b-79e5985ed74d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:12.209205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc82a76-79a0-44e5-b13b-79e5985ed74d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:12.210738 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc82a76-79a0-44e5-b13b-79e5985ed74d None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:12.214950 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 490/967] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 24 15:45:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:12.221723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532a3b1-2b56-4335-b63f-e44f82a1cb69 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:12.228518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 478/968] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:12.240818 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc82a76-79a0-44e5-b13b-79e5985ed74d None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:12.306307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:12.363448 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532a3b1-2b56-4335-b63f-e44f82a1cb69 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:12.380339 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:12.395339 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc82a76-79a0-44e5-b13b-79e5985ed74d None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:12.411219 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e6be7-cf8e-40f5-b670-e65c2de52141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:12.411843 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e6be7-cf8e-40f5-b670-e65c2de52141 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:12.412124 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e6be7-cf8e-40f5-b670-e65c2de52141 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:12.412472 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e6be7-cf8e-40f5-b670-e65c2de52141 None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:12.413601 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e6be7-cf8e-40f5-b670-e65c2de52141 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:12.413912 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e6be7-cf8e-40f5-b670-e65c2de52141 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:12.415651 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e6be7-cf8e-40f5-b670-e65c2de52141 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:12.426827 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 491/969] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 24 15:45:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:12.428572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e6be7-cf8e-40f5-b670-e65c2de52141 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:12.449577 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c58788-9dc3-48a8-b7fb-fff9d592368c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:12.450234 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c58788-9dc3-48a8-b7fb-fff9d592368c None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:12.450517 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c58788-9dc3-48a8-b7fb-fff9d592368c None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:12.450788 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c58788-9dc3-48a8-b7fb-fff9d592368c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:12.461389 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c58788-9dc3-48a8-b7fb-fff9d592368c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:12.463600 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c58788-9dc3-48a8-b7fb-fff9d592368c None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:12.479880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-f8c58788-9dc3-48a8-b7fb-fff9d592368c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:45:12.479880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:12.479880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:12.479880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:12.479880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:12.479880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:12.479880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:12.479880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:12.479880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:12.479880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:12.479880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:12.479880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:12.479880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:45:12.479880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:45:12.479880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:45:12.481090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:45:12.481090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:12.481090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:12.481090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:12.481090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:12.481090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:12.481090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:12.481090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:12.481090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:12.481090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:12.481090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:12.481090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:12.481090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:12.481090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:12.481090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:12.481090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:12.481090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:12.481976 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:45:12.481976 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:45:12.481976 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:45:12.481976 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:45:12.481976 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:45:12.481976 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:45:12.481976 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:45:12.481976 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:12.484748 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 479/970] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:45:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:12.488559 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c58788-9dc3-48a8-b7fb-fff9d592368c None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:12.565561 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e6be7-cf8e-40f5-b670-e65c2de52141 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:12.593859 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:12.608554 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a36e25-afa8-40f5-96f2-ae6e2097feee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:12.609504 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a36e25-afa8-40f5-96f2-ae6e2097feee None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:12.609794 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a36e25-afa8-40f5-96f2-ae6e2097feee None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:12.610070 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a36e25-afa8-40f5-96f2-ae6e2097feee None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:12.612910 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a36e25-afa8-40f5-96f2-ae6e2097feee None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:12.612910 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a36e25-afa8-40f5-96f2-ae6e2097feee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:12.612910 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a36e25-afa8-40f5-96f2-ae6e2097feee None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:12.618184 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 492/971] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 24 15:45:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:12.624445 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a36e25-afa8-40f5-96f2-ae6e2097feee None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:12.634498 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c58788-9dc3-48a8-b7fb-fff9d592368c None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:12.677482 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65ffaa-1634-4652-898e-c6a799873fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:12.678020 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65ffaa-1634-4652-898e-c6a799873fdd None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:12.678350 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65ffaa-1634-4652-898e-c6a799873fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:12.678629 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65ffaa-1634-4652-898e-c6a799873fdd None admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:12.679334 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65ffaa-1634-4652-898e-c6a799873fdd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:12.679641 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65ffaa-1634-4652-898e-c6a799873fdd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:12.681177 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65ffaa-1634-4652-898e-c6a799873fdd None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:12.695424 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 480/972] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:45:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:12.703164 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65ffaa-1634-4652-898e-c6a799873fdd None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:12.727587 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:12.762584 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a36e25-afa8-40f5-96f2-ae6e2097feee None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:12.802642 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299f352-e0cf-4cdc-b5ef-118bc1c6f401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:12.803516 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299f352-e0cf-4cdc-b5ef-118bc1c6f401 None admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:12.803948 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299f352-e0cf-4cdc-b5ef-118bc1c6f401 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:12.804401 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299f352-e0cf-4cdc-b5ef-118bc1c6f401 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:12.805318 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299f352-e0cf-4cdc-b5ef-118bc1c6f401 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:12.806915 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299f352-e0cf-4cdc-b5ef-118bc1c6f401 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:12.841265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65ffaa-1634-4652-898e-c6a799873fdd None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:12.879146 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39cf40-8064-46d4-aa2c-e86bdaf54b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:12.879790 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39cf40-8064-46d4-aa2c-e86bdaf54b1c None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:12.880113 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39cf40-8064-46d4-aa2c-e86bdaf54b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:12.880394 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39cf40-8064-46d4-aa2c-e86bdaf54b1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:12.881216 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39cf40-8064-46d4-aa2c-e86bdaf54b1c None admin] RBAC: Adding query filter params (role.id=645ada3cca2e4ac49e7055528e4748d6, scope.project.id=9b25a7c01ab540ceae16dd618b848f2d, user.id=eaf3821dd57a4d8f9ca6385c202bb0ed) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:12.881533 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39cf40-8064-46d4-aa2c-e86bdaf54b1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:12.883031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39cf40-8064-46d4-aa2c-e86bdaf54b1c None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:12.890880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 481/973] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:45:12 2022] GET /identity/v3/role_assignments?user.id=eaf3821dd57a4d8f9ca6385c202bb0ed&scope.project.id=9b25a7c01ab540ceae16dd618b848f2d&role.id=645ada3cca2e4ac49e7055528e4748d6 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:12.900645 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 493/974] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 15:45:12 2022] POST /identity/v3/endpoints => generated 349 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:13.907003 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391d34f-7580-4898-9e33-8da5e52485bf None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:13.907559 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391d34f-7580-4898-9e33-8da5e52485bf None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:13.907559 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391d34f-7580-4898-9e33-8da5e52485bf None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:13.909183 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 482/975] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:13.914843 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f8919-8bed-45f4-93ef-95b8be02e4d1 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:13.915318 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f8919-8bed-45f4-93ef-95b8be02e4d1 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:13.915429 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f8919-8bed-45f4-93ef-95b8be02e4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:13.934182 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-0e7f8919-8bed-45f4-93ef-95b8be02e4d1 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:13.935372 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-0e7f8919-8bed-45f4-93ef-95b8be02e4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:13.981002 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:14.017387 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478e6ca-1a23-4e8d-b310-b92e071b2829 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:14.017718 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478e6ca-1a23-4e8d-b310-b92e071b2829 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:14.017934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478e6ca-1a23-4e8d-b310-b92e071b2829 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:14.019613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 483/976] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:14.026242 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b25f9b-19e5-42f7-afb4-e0c2c940adc0 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:14.026773 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b25f9b-19e5-42f7-afb4-e0c2c940adc0 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:14.027068 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b25f9b-19e5-42f7-afb4-e0c2c940adc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:14.028953 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 494/977] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:45:14.055543 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-b1b25f9b-19e5-42f7-afb4-e0c2c940adc0 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:14.057212 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-b1b25f9b-19e5-42f7-afb4-e0c2c940adc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:14.138165 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 484/978] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:45:14.331777 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f8919-8bed-45f4-93ef-95b8be02e4d1 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:14.424852 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b25f9b-19e5-42f7-afb4-e0c2c940adc0 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:14.441347 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:14.446237 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f8919-8bed-45f4-93ef-95b8be02e4d1 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:14.491296 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75e67f-b734-42bc-9eeb-0329ce9fb5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:14.492003 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75e67f-b734-42bc-9eeb-0329ce9fb5d8 None admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:14.492338 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75e67f-b734-42bc-9eeb-0329ce9fb5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:14.492730 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75e67f-b734-42bc-9eeb-0329ce9fb5d8 None admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:14.493394 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75e67f-b734-42bc-9eeb-0329ce9fb5d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:14.494838 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75e67f-b734-42bc-9eeb-0329ce9fb5d8 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:14.497698 dv-cinder-849325-3-smb devstack@keystone.service[81716]: WARNING keystone.server.flask.common [None req-cc75e67f-b734-42bc-9eeb-0329ce9fb5d8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 15:45:14.543358 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.sql.core [None req-cc75e67f-b734-42bc-9eeb-0329ce9fb5d8 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 15:45:14.543358 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 15:45:14.543358 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [parameters: {'user_id': 'ca8b8dc225fd4b8986b49e9dc401e11a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 15:45:14.543358 dv-cinder-849325-3-smb devstack@keystone.service[81716]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81716) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 15:45:14.551921 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b25f9b-19e5-42f7-afb4-e0c2c940adc0 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:14.562731 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-cc75e67f-b734-42bc-9eeb-0329ce9fb5d8 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 15:45:14.562731 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:14.562731 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 15:45:14.562731 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 15:45:14.562731 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 15:45:14.562731 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 15:45:14.562731 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 15:45:14.562731 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 15:45:14.562731 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 15:45:14.562731 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application conn.query(q) Aug 24 15:45:14.562731 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 15:45:14.562731 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 15:45:14.562731 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 15:45:14.562731 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application result.read() Aug 24 15:45:14.562731 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 15:45:14.563676 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 15:45:14.563676 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 15:45:14.563676 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 15:45:14.563676 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 15:45:14.563676 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 15:45:14.563676 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 15:45:14.563676 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 15:45:14.563676 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 15:45:14.563676 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:14.563676 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 15:45:14.563676 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:14.563676 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:14.563676 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 15:45:14.563676 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 15:45:14.563676 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 15:45:14.563676 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 15:45:14.563676 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 15:45:14.563676 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application next(self.gen) Aug 24 15:45:14.565115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 15:45:14.565115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application yield resource Aug 24 15:45:14.565115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 15:45:14.565115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application next(self.gen) Aug 24 15:45:14.565115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 15:45:14.565115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 15:45:14.565115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 15:45:14.565115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 15:45:14.565115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 15:45:14.565115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise self.value Aug 24 15:45:14.565115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 15:45:14.565115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 15:45:14.565115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 15:45:14.565115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application session.commit() Aug 24 15:45:14.565115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 15:45:14.565115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 15:45:14.565115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 15:45:14.566807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 15:45:14.566807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 15:45:14.566807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application self.session.flush() Aug 24 15:45:14.566807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 15:45:14.566807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 15:45:14.566807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 15:45:14.566807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 15:45:14.566807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 15:45:14.566807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application compat.raise_( Aug 24 15:45:14.566807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 15:45:14.566807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception Aug 24 15:45:14.566807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 15:45:14.566807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 15:45:14.566807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 15:45:14.566807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 15:45:14.566807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 15:45:14.566807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 15:45:14.568928 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 15:45:14.568928 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 15:45:14.568928 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 15:45:14.568928 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 15:45:14.568928 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 15:45:14.568928 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 15:45:14.568928 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 15:45:14.568928 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 15:45:14.568928 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 15:45:14.568928 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 15:45:14.568928 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 15:45:14.568928 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 15:45:14.568928 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 15:45:14.568928 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 15:45:14.568928 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 15:45:14.568928 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception Aug 24 15:45:14.579038 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 15:45:14.579038 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 15:45:14.579038 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 15:45:14.579038 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 15:45:14.579038 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 15:45:14.579038 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 15:45:14.579038 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 15:45:14.579038 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application conn.query(q) Aug 24 15:45:14.579038 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 15:45:14.579038 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 15:45:14.579038 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 15:45:14.579038 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application result.read() Aug 24 15:45:14.579038 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 15:45:14.579038 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 15:45:14.579038 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 15:45:14.579038 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 15:45:14.581098 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 15:45:14.581098 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 15:45:14.581098 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 15:45:14.581098 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 15:45:14.581098 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 15:45:14.581098 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 15:45:14.581098 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ca8b8dc225fd4b8986b49e9dc401e11a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 15:45:14.581098 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 15:45:14.581098 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:14.581098 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:45:14.581098 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:14.581098 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:14.581098 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:14.581098 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:14.581098 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:14.582986 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:14.582986 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:14.582986 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:14.582986 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:14.582986 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:14.582986 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:14.582986 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:14.582986 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 15:45:14.582986 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 15:45:14.582986 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:14.582986 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:14.582986 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:45:14.582986 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:45:14.582986 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:45:14.582986 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:45:14.582986 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 15:45:14.582986 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 15:45:14.585203 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 15:45:14.585203 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 15:45:14.585203 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 15:45:14.585203 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 15:45:14.585203 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 15:45:14.585203 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:14.585203 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 495/979] 10.222.0.64 () {60 vars in 1131 bytes} [Wed Aug 24 15:45:14 2022] POST /identity/v3/users => generated 160 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:14.585203 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75e67f-b734-42bc-9eeb-0329ce9fb5d8 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:14.591468 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537646b8-5f18-442f-9597-585baa458baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:14.592096 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537646b8-5f18-442f-9597-585baa458baa None admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:14.592372 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537646b8-5f18-442f-9597-585baa458baa None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:14.592984 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537646b8-5f18-442f-9597-585baa458baa None admin] PATH_INFO: `/v3/services` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:14.594829 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537646b8-5f18-442f-9597-585baa458baa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:14.596245 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537646b8-5f18-442f-9597-585baa458baa None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:14.607896 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:14.676812 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 485/980] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 24 15:45:14 2022] POST /identity/v3/services => generated 242 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:45:14.695812 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75e67f-b734-42bc-9eeb-0329ce9fb5d8 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:14.757676 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c557f10-c0e8-4cc3-9c4f-4d45406b2818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:14.758348 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c557f10-c0e8-4cc3-9c4f-4d45406b2818 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:14.758881 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c557f10-c0e8-4cc3-9c4f-4d45406b2818 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:14.759345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c557f10-c0e8-4cc3-9c4f-4d45406b2818 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:14.771467 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c557f10-c0e8-4cc3-9c4f-4d45406b2818 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:14.776898 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c557f10-c0e8-4cc3-9c4f-4d45406b2818 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:14.787822 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-5c557f10-c0e8-4cc3-9c4f-4d45406b2818 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 15:45:14.787822 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:14.787822 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:14.787822 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:14.787822 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:14.787822 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:14.787822 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:14.787822 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:14.787822 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:14.787822 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:14.787822 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:14.787822 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:14.787822 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:45:14.787822 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:45:14.787822 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:45:14.787822 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:45:14.789854 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:14.789854 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:14.789854 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:45:14.789854 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:45:14.789854 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:45:14.789854 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:45:14.789854 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:14.789854 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:14.789854 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:14.789854 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:14.789854 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:14.789854 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:14.789854 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:14.789854 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:14.789854 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:14.789854 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:14.789854 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:14.789854 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:14.791373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:14.791373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:14.791373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:45:14.791373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:45:14.791373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:45:14.791373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:45:14.791373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:45:14.791373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:45:14.791373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 15:45:14.791373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:14.791373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 496/981] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:45:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:14.795309 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537646b8-5f18-442f-9597-585baa458baa None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:14.876146 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:14.923058 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537646b8-5f18-442f-9597-585baa458baa None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:14.967309 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6e45d-57cc-47cd-b5a2-3c537ef71508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:14.968054 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6e45d-57cc-47cd-b5a2-3c537ef71508 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:14.968537 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6e45d-57cc-47cd-b5a2-3c537ef71508 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:14.968902 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6e45d-57cc-47cd-b5a2-3c537ef71508 None admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:14.969720 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6e45d-57cc-47cd-b5a2-3c537ef71508 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:14.970072 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6e45d-57cc-47cd-b5a2-3c537ef71508 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:14.972087 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6e45d-57cc-47cd-b5a2-3c537ef71508 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:14.990252 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af0308-f32a-41cc-9569-0d93eb008a4a None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:14.990252 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af0308-f32a-41cc-9569-0d93eb008a4a None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:14.990252 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af0308-f32a-41cc-9569-0d93eb008a4a None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:14.990252 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 497/982] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:45:15.000670 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863479a6-f535-4a24-925e-ee7a913faa33 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:15.000670 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863479a6-f535-4a24-925e-ee7a913faa33 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:15.000670 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863479a6-f535-4a24-925e-ee7a913faa33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:15.013543 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 486/983] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 24 15:45:14 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:15.015390 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7bd08-86d1-4fcd-9744-15883dbf1683 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:15.015729 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7bd08-86d1-4fcd-9744-15883dbf1683 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:15.016152 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7bd08-86d1-4fcd-9744-15883dbf1683 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:15.018091 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 487/984] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:15.023803 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7b54c-2cc3-49bf-b209-07d5ebfc9877 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:15.024165 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7b54c-2cc3-49bf-b209-07d5ebfc9877 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:15.024351 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7b54c-2cc3-49bf-b209-07d5ebfc9877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:15.025306 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-863479a6-f535-4a24-925e-ee7a913faa33 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:15.027525 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-863479a6-f535-4a24-925e-ee7a913faa33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:15.044016 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-69b7b54c-2cc3-49bf-b209-07d5ebfc9877 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:15.045299 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-69b7b54c-2cc3-49bf-b209-07d5ebfc9877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:15.116865 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 498/985] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:14 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:45:15.126936 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 488/986] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:15 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:45:15.389852 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863479a6-f535-4a24-925e-ee7a913faa33 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:15.407274 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7b54c-2cc3-49bf-b209-07d5ebfc9877 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:15.409760 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:15.470872 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:15.514458 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863479a6-f535-4a24-925e-ee7a913faa33 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:15.527517 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7b54c-2cc3-49bf-b209-07d5ebfc9877 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:15.560095 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3229d-7762-41da-99aa-27c874281c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:15.560762 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3229d-7762-41da-99aa-27c874281c04 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:15.561043 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3229d-7762-41da-99aa-27c874281c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:15.561323 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3229d-7762-41da-99aa-27c874281c04 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:15.562463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3229d-7762-41da-99aa-27c874281c04 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:15.563839 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3229d-7762-41da-99aa-27c874281c04 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:15.573428 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-cbb3229d-7762-41da-99aa-27c874281c04 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 15:45:15.573428 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:15.573428 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:45:15.573428 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:45:15.573428 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:45:15.573428 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:45:15.573428 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:45:15.573428 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:45:15.573428 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 15:45:15.573428 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:15.573428 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:45:15.573428 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:15.573428 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:15.573428 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:15.573428 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:15.573428 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:15.573428 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:15.574477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:15.574477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:15.574477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:15.574477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:15.574477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:15.574477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:15.574477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:45:15.574477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:45:15.574477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:45:15.574477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:45:15.574477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:15.574477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:15.574477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:15.574477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:15.574477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:15.574477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:15.575943 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:15.575943 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:15.575943 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:15.575943 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:15.575943 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:15.575943 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:15.575943 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:15.575943 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:15.575943 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:15.575943 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:15.575943 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:45:15.575943 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:45:15.575943 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 15:45:15.575943 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:15.575943 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 499/987] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 24 15:45:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:15.576802 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae0613-a4f4-43a0-b7b4-425d5e57c8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:15.576802 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae0613-a4f4-43a0-b7b4-425d5e57c8f7 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:15.576955 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae0613-a4f4-43a0-b7b4-425d5e57c8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:15.578278 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae0613-a4f4-43a0-b7b4-425d5e57c8f7 None admin] PATH_INFO: `/v3/services/image` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:15.578900 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae0613-a4f4-43a0-b7b4-425d5e57c8f7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:15.580283 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae0613-a4f4-43a0-b7b4-425d5e57c8f7 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:15.580668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3229d-7762-41da-99aa-27c874281c04 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:15.591055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-72ae0613-a4f4-43a0-b7b4-425d5e57c8f7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 15:45:15.591055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:15.591055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:45:15.591055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:45:15.591055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:45:15.591055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:45:15.591055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:45:15.591055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:45:15.591055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 15:45:15.591055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:15.591055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:45:15.591055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:15.591055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:15.591055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:15.591055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:15.591055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:15.591055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:15.592124 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:15.592124 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:15.592124 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:15.592124 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:15.592124 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:15.592124 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:15.592124 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:45:15.592124 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:45:15.592124 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:45:15.592124 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:45:15.592124 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:15.592124 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:15.592124 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:15.592124 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:15.592124 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:15.592124 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:15.593750 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:15.593750 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:15.593750 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:15.593750 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:15.593750 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:15.593750 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:15.593750 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:15.593750 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:15.593750 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:15.593750 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:15.593750 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:45:15.593750 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:45:15.593750 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 15:45:15.593750 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:15.593750 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 489/988] 10.222.0.64 () {56 vars in 1105 bytes} [Wed Aug 24 15:45:15 2022] GET /identity/v3/services/image => generated 86 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:15.598424 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae0613-a4f4-43a0-b7b4-425d5e57c8f7 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:15.682653 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:15.714029 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3229d-7762-41da-99aa-27c874281c04 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:15.739222 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae0613-a4f4-43a0-b7b4-425d5e57c8f7 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:15.751802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd767f0-7632-4b03-a9e0-23c5b6c4c41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:15.752775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd767f0-7632-4b03-a9e0-23c5b6c4c41d None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:15.753069 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd767f0-7632-4b03-a9e0-23c5b6c4c41d None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:15.753520 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd767f0-7632-4b03-a9e0-23c5b6c4c41d None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:15.754173 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd767f0-7632-4b03-a9e0-23c5b6c4c41d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:15.754481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd767f0-7632-4b03-a9e0-23c5b6c4c41d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:15.755908 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd767f0-7632-4b03-a9e0-23c5b6c4c41d None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:15.760372 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:15.762514 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 500/989] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 24 15:45:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:15.768899 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd767f0-7632-4b03-a9e0-23c5b6c4c41d None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:15.781546 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18d8ae-0b07-478d-992c-14ef6345e6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:15.782160 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18d8ae-0b07-478d-992c-14ef6345e6d0 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:15.782436 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18d8ae-0b07-478d-992c-14ef6345e6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:15.782705 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18d8ae-0b07-478d-992c-14ef6345e6d0 None admin] PATH_INFO: `/v3/services` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:15.783336 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd18d8ae-0b07-478d-992c-14ef6345e6d0 None admin] RBAC: Adding query filter params (name=image) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:15.783638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd18d8ae-0b07-478d-992c-14ef6345e6d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:15.785078 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd18d8ae-0b07-478d-992c-14ef6345e6d0 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:15.791950 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 490/990] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:45:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:15.797837 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18d8ae-0b07-478d-992c-14ef6345e6d0 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:15.898181 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd767f0-7632-4b03-a9e0-23c5b6c4c41d None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:15.915031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18d8ae-0b07-478d-992c-14ef6345e6d0 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:15.937284 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e54268-71f7-4953-ab41-26b56dc817e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:15.938011 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e54268-71f7-4953-ab41-26b56dc817e2 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:15.938292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e54268-71f7-4953-ab41-26b56dc817e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:15.938560 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e54268-71f7-4953-ab41-26b56dc817e2 None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:15.939189 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e54268-71f7-4953-ab41-26b56dc817e2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:15.939491 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e54268-71f7-4953-ab41-26b56dc817e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:15.941227 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e54268-71f7-4953-ab41-26b56dc817e2 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:15.946444 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 501/991] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 24 15:45:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:15.952072 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e54268-71f7-4953-ab41-26b56dc817e2 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:15.958081 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206b6e6-eed8-4e2a-b694-002f448c2ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:15.958705 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206b6e6-eed8-4e2a-b694-002f448c2ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:15.958983 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206b6e6-eed8-4e2a-b694-002f448c2ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:15.959259 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206b6e6-eed8-4e2a-b694-002f448c2ee2 None admin] PATH_INFO: `/v3/services` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:15.959905 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d206b6e6-eed8-4e2a-b694-002f448c2ee2 None admin] RBAC: Adding query filter params (type=image) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:15.960211 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d206b6e6-eed8-4e2a-b694-002f448c2ee2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:15.961636 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d206b6e6-eed8-4e2a-b694-002f448c2ee2 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:15.964485 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:15.967048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 491/992] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:45:15 2022] GET /identity/v3/services?type=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:16.087692 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e54268-71f7-4953-ab41-26b56dc817e2 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:16.131997 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d7826-4ec7-4283-bb7b-c1fd9079f35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:16.132613 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d7826-4ec7-4283-bb7b-c1fd9079f35b None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:16.132928 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d7826-4ec7-4283-bb7b-c1fd9079f35b None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:16.133199 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d7826-4ec7-4283-bb7b-c1fd9079f35b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:16.133924 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d7826-4ec7-4283-bb7b-c1fd9079f35b None admin] RBAC: Adding query filter params (interface=admin, service_id=53b2f276dbff4d059aeff4ed682b04b2, region_id=RegionOne) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:16.134227 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d7826-4ec7-4283-bb7b-c1fd9079f35b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:16.135596 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d7826-4ec7-4283-bb7b-c1fd9079f35b None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:16.141749 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 502/993] 10.222.0.64 () {56 vars in 1249 bytes} [Wed Aug 24 15:45:15 2022] GET /identity/v3/endpoints?service_id=53b2f276dbff4d059aeff4ed682b04b2&interface=admin®ion_id=RegionOne => generated 193 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:16.147321 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206b6e6-eed8-4e2a-b694-002f448c2ee2 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:16.198452 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:16.262767 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206b6e6-eed8-4e2a-b694-002f448c2ee2 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:16.309462 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a77164-505d-4b10-b33f-0c55da2bcac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:16.310083 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a77164-505d-4b10-b33f-0c55da2bcac5 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:16.310354 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a77164-505d-4b10-b33f-0c55da2bcac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:16.310622 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a77164-505d-4b10-b33f-0c55da2bcac5 None admin] PATH_INFO: `/v3/services` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:16.311226 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a77164-505d-4b10-b33f-0c55da2bcac5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:16.313656 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a77164-505d-4b10-b33f-0c55da2bcac5 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:16.320734 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 492/994] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 24 15:45:16 2022] GET /identity/v3/services => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:16.752988 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2efda-f1c7-4f67-a7ca-abb785e393b5 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:16.753278 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2efda-f1c7-4f67-a7ca-abb785e393b5 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:16.753558 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2efda-f1c7-4f67-a7ca-abb785e393b5 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:16.755552 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 503/995] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:16.761177 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f4463-d31d-41ec-94ac-cb051e5b0925 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:16.761465 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f4463-d31d-41ec-94ac-cb051e5b0925 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:16.761745 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f4463-d31d-41ec-94ac-cb051e5b0925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:16.782465 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-323f4463-d31d-41ec-94ac-cb051e5b0925 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:16.783681 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-323f4463-d31d-41ec-94ac-cb051e5b0925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:16.860417 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 493/996] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:16 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:45:17.134089 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2efda-f1c7-4f67-a7ca-abb785e393b5 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:17.216249 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:17.251801 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2efda-f1c7-4f67-a7ca-abb785e393b5 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:17.310717 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780f05b-665e-444b-af2f-386f2fb84c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:17.310717 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780f05b-665e-444b-af2f-386f2fb84c67 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:17.310717 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780f05b-665e-444b-af2f-386f2fb84c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:17.310717 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780f05b-665e-444b-af2f-386f2fb84c67 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:17.311140 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780f05b-665e-444b-af2f-386f2fb84c67 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:17.311215 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780f05b-665e-444b-af2f-386f2fb84c67 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:17.321090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-7780f05b-665e-444b-af2f-386f2fb84c67 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 15:45:17.321090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:17.321090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:45:17.321090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:45:17.321090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:45:17.321090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:45:17.321090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:45:17.321090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:45:17.321090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 15:45:17.321090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:17.321090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:45:17.321090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:17.321090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:17.321090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:17.321090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:17.321090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:17.321090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:17.322169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:17.322169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:17.322169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:17.322169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:17.322169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:17.322169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:17.322169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:45:17.322169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:45:17.322169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:45:17.322169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:45:17.322169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:17.322169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:17.322169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:17.322169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:17.322169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:17.322169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:17.325693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:17.325693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:17.325693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:17.325693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:17.325693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:17.325693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:17.325693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:17.325693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:17.325693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:17.325693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:17.325693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:45:17.325693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:45:17.325693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 15:45:17.325693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:17.325693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 504/997] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:45:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:17.328433 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f4463-d31d-41ec-94ac-cb051e5b0925 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:17.373096 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:17.444359 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f4463-d31d-41ec-94ac-cb051e5b0925 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:17.481433 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665122c-18c3-4be7-a791-74276a0155c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:17.482051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665122c-18c3-4be7-a791-74276a0155c4 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:17.482327 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665122c-18c3-4be7-a791-74276a0155c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:17.482600 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665122c-18c3-4be7-a791-74276a0155c4 None admin] PATH_INFO: `/v3/services` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:17.483910 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665122c-18c3-4be7-a791-74276a0155c4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:17.484348 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665122c-18c3-4be7-a791-74276a0155c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:17.485858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665122c-18c3-4be7-a791-74276a0155c4 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:17.495800 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 494/998] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 24 15:45:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:17.497221 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780f05b-665e-444b-af2f-386f2fb84c67 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:17.611565 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780f05b-665e-444b-af2f-386f2fb84c67 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:17.649473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e2e82-83f0-48f7-979b-884a4dc2c3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:17.654062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e2e82-83f0-48f7-979b-884a4dc2c3c2 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:17.654062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e2e82-83f0-48f7-979b-884a4dc2c3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:17.654062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e2e82-83f0-48f7-979b-884a4dc2c3c2 None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:17.654062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e2e82-83f0-48f7-979b-884a4dc2c3c2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:17.654062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e2e82-83f0-48f7-979b-884a4dc2c3c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:17.654062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e2e82-83f0-48f7-979b-884a4dc2c3c2 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:17.656801 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:17.664874 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 505/999] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 24 15:45:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:17.666660 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665122c-18c3-4be7-a791-74276a0155c4 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:17.777759 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665122c-18c3-4be7-a791-74276a0155c4 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:17.779987 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:17.824026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690feb9-c1ca-4aed-837c-48a7f300ddc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:17.825060 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690feb9-c1ca-4aed-837c-48a7f300ddc0 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:17.825522 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690feb9-c1ca-4aed-837c-48a7f300ddc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:17.825973 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690feb9-c1ca-4aed-837c-48a7f300ddc0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:17.826854 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690feb9-c1ca-4aed-837c-48a7f300ddc0 None admin] RBAC: Adding query filter params (interface=public, service_id=464e19a6aac2417cbadeefcf95e4053e, region_id=RegionOne) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:17.827933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690feb9-c1ca-4aed-837c-48a7f300ddc0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:17.829528 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690feb9-c1ca-4aed-837c-48a7f300ddc0 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:17.839855 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 495/1000] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Aug 24 15:45:17 2022] GET /identity/v3/endpoints?service_id=464e19a6aac2417cbadeefcf95e4053e&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:17.841144 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e2e82-83f0-48f7-979b-884a4dc2c3c2 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:17.963859 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e2e82-83f0-48f7-979b-884a4dc2c3c2 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:17.970580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4124a-eb6f-4786-a87a-004cbba9ada2 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:17.970864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4124a-eb6f-4786-a87a-004cbba9ada2 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:17.971190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4124a-eb6f-4786-a87a-004cbba9ada2 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:17.972690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 496/1001] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:17.977832 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71d3aa-4d3d-4bdc-a63d-4a377a83e14a None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:17.978110 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71d3aa-4d3d-4bdc-a63d-4a377a83e14a None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:17.978380 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71d3aa-4d3d-4bdc-a63d-4a377a83e14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:17.997378 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-ff71d3aa-4d3d-4bdc-a63d-4a377a83e14a None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:17.998598 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-ff71d3aa-4d3d-4bdc-a63d-4a377a83e14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:18.011855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371bad4-21bf-49ab-9465-656df81e90d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:18.012475 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371bad4-21bf-49ab-9465-656df81e90d2 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:18.012788 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371bad4-21bf-49ab-9465-656df81e90d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:18.013065 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371bad4-21bf-49ab-9465-656df81e90d2 None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:18.013685 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371bad4-21bf-49ab-9465-656df81e90d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:18.015878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371bad4-21bf-49ab-9465-656df81e90d2 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:18.032190 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 506/1002] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 24 15:45:17 2022] GET /identity/v3/services => generated 1727 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:45:18.086507 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 497/1003] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:17 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:45:18.261490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd5d7a-2627-43d2-a8a6-305dcbabd8ba None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:18.262002 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd5d7a-2627-43d2-a8a6-305dcbabd8ba None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:18.262002 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd5d7a-2627-43d2-a8a6-305dcbabd8ba None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:18.263502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 507/1004] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:18.269578 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578407d-d383-4cca-b669-5e8a071244ed None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:18.269872 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578407d-d383-4cca-b669-5e8a071244ed None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:18.270124 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578407d-d383-4cca-b669-5e8a071244ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:18.292419 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-8578407d-d383-4cca-b669-5e8a071244ed None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:18.293583 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-8578407d-d383-4cca-b669-5e8a071244ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:18.356033 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd5d7a-2627-43d2-a8a6-305dcbabd8ba None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:18.388658 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 498/1005] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:18 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:45:18.424467 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:18.467135 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd5d7a-2627-43d2-a8a6-305dcbabd8ba None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:18.515072 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db6627-87eb-4da4-abb8-ec3ae5e44bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:18.515797 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db6627-87eb-4da4-abb8-ec3ae5e44bb7 None admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:18.516103 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db6627-87eb-4da4-abb8-ec3ae5e44bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:18.516386 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db6627-87eb-4da4-abb8-ec3ae5e44bb7 None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:18.517133 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db6627-87eb-4da4-abb8-ec3ae5e44bb7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:18.518534 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db6627-87eb-4da4-abb8-ec3ae5e44bb7 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:18.578462 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 508/1006] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 24 15:45:18 2022] POST /identity/v3/services => generated 242 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:45:18.660448 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578407d-d383-4cca-b669-5e8a071244ed None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:18.696314 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:18.790325 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578407d-d383-4cca-b669-5e8a071244ed None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:18.835755 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3732382-267e-442f-bed1-da3d9ba8d00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:18.836312 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3732382-267e-442f-bed1-da3d9ba8d00d None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:18.836593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3732382-267e-442f-bed1-da3d9ba8d00d None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:18.836895 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3732382-267e-442f-bed1-da3d9ba8d00d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:18.837475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3732382-267e-442f-bed1-da3d9ba8d00d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:18.838845 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3732382-267e-442f-bed1-da3d9ba8d00d None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:18.848402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-b3732382-267e-442f-bed1-da3d9ba8d00d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 15:45:18.848402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:18.848402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:45:18.848402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:45:18.848402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:45:18.848402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:45:18.848402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:45:18.848402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:45:18.848402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 15:45:18.848402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:18.848402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:45:18.848402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:18.848402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:18.848402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:18.848402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:18.848402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:18.848402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:18.849437 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:18.849437 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:18.849437 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:18.849437 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:18.849437 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:18.849437 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:18.849437 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:45:18.849437 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:45:18.849437 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:45:18.849437 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:45:18.849437 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:18.849437 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:18.849437 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:18.849437 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:18.849437 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:18.849437 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:18.850297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:18.850297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:18.850297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:18.850297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:18.850297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:18.850297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:18.850297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:18.850297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:18.850297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:18.850297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:18.850297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:45:18.850297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:45:18.850297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 15:45:18.850297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:18.850297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 499/1007] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 24 15:45:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:18.855357 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db6627-87eb-4da4-abb8-ec3ae5e44bb7 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:18.977400 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db6627-87eb-4da4-abb8-ec3ae5e44bb7 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:19.013952 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:19.028117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4027235-c9f1-4fc3-b505-1f5c8e5ffd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:19.031478 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4027235-c9f1-4fc3-b505-1f5c8e5ffd9b None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:19.031478 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4027235-c9f1-4fc3-b505-1f5c8e5ffd9b None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:19.031478 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4027235-c9f1-4fc3-b505-1f5c8e5ffd9b None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:19.031478 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4027235-c9f1-4fc3-b505-1f5c8e5ffd9b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:19.031478 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4027235-c9f1-4fc3-b505-1f5c8e5ffd9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:19.032984 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4027235-c9f1-4fc3-b505-1f5c8e5ffd9b None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:19.040098 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 509/1008] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 24 15:45:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:19.046561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3732382-267e-442f-bed1-da3d9ba8d00d None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:19.139898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:19.157184 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3732382-267e-442f-bed1-da3d9ba8d00d None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:19.192932 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c7a1f-2cde-47bf-a470-849853592a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:19.193533 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c7a1f-2cde-47bf-a470-849853592a2b None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:19.193809 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c7a1f-2cde-47bf-a470-849853592a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:19.194077 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c7a1f-2cde-47bf-a470-849853592a2b None admin] PATH_INFO: `/v3/services` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:19.194689 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c7a1f-2cde-47bf-a470-849853592a2b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:19.194986 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c7a1f-2cde-47bf-a470-849853592a2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:19.196332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c7a1f-2cde-47bf-a470-849853592a2b None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:19.206383 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 500/1009] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 24 15:45:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:19.207335 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4027235-c9f1-4fc3-b505-1f5c8e5ffd9b None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:19.318819 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4027235-c9f1-4fc3-b505-1f5c8e5ffd9b None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:19.353806 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e8346-b09f-44fe-b158-8b0cf0d6b87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:19.354406 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e8346-b09f-44fe-b158-8b0cf0d6b87b None admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:19.354686 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e8346-b09f-44fe-b158-8b0cf0d6b87b None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:19.354954 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e8346-b09f-44fe-b158-8b0cf0d6b87b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:19.355610 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e8346-b09f-44fe-b158-8b0cf0d6b87b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:19.356994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e8346-b09f-44fe-b158-8b0cf0d6b87b None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:19.438836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 510/1010] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 15:45:19 2022] POST /identity/v3/endpoints => generated 325 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:45:20.000413 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfbc79-81b3-4019-bb9f-83e8314249ef None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:20.001013 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfbc79-81b3-4019-bb9f-83e8314249ef None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:20.001013 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfbc79-81b3-4019-bb9f-83e8314249ef None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:20.002533 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 501/1011] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:20.007817 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591599c-a712-49ee-8b8f-425b6d5dc388 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:20.008113 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591599c-a712-49ee-8b8f-425b6d5dc388 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:20.008388 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591599c-a712-49ee-8b8f-425b6d5dc388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:20.026900 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-b591599c-a712-49ee-8b8f-425b6d5dc388 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:20.028093 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-b591599c-a712-49ee-8b8f-425b6d5dc388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:20.076601 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:20.124946 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 511/1012] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:20 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:45:20.388899 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebfbc79-81b3-4019-bb9f-83e8314249ef None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:20.500229 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebfbc79-81b3-4019-bb9f-83e8314249ef None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:20.539723 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5286b0-b4fc-42a4-aeac-52eb6c27567a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:20.540369 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5286b0-b4fc-42a4-aeac-52eb6c27567a None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:20.540675 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5286b0-b4fc-42a4-aeac-52eb6c27567a None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:20.540958 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5286b0-b4fc-42a4-aeac-52eb6c27567a None admin] PATH_INFO: `/v3/services/compute` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:20.541553 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5286b0-b4fc-42a4-aeac-52eb6c27567a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:20.542931 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5286b0-b4fc-42a4-aeac-52eb6c27567a None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:20.553117 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-fd5286b0-b4fc-42a4-aeac-52eb6c27567a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 15:45:20.553117 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:20.553117 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:45:20.553117 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:45:20.553117 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:45:20.553117 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:45:20.553117 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:45:20.553117 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:45:20.553117 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 15:45:20.553117 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:20.553117 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:45:20.553117 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:20.553117 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:20.553117 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:20.553117 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:20.553117 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:20.553117 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:20.555679 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:20.555679 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:20.555679 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:20.555679 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:20.555679 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:20.555679 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:20.555679 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:45:20.555679 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:45:20.555679 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:45:20.555679 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:45:20.555679 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:20.555679 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:20.555679 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:20.555679 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:20.555679 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:20.555679 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:20.557856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:20.557856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:20.557856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:20.557856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:20.557856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:20.557856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:20.557856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:20.557856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:20.557856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:20.557856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:20.557856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:45:20.557856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:45:20.557856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 15:45:20.557856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:20.557856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 502/1013] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:45:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:20.560583 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600061b-5c2f-41cc-9303-919d66b94316 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:20.561687 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600061b-5c2f-41cc-9303-919d66b94316 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:20.561687 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600061b-5c2f-41cc-9303-919d66b94316 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:20.563414 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 512/1014] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:20.564349 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5286b0-b4fc-42a4-aeac-52eb6c27567a None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:20.568824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a2589-6844-4196-a1c4-19c13b90d750 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:20.569106 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a2589-6844-4196-a1c4-19c13b90d750 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:20.569375 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a2589-6844-4196-a1c4-19c13b90d750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:20.583236 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:20.588877 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-b28a2589-6844-4196-a1c4-19c13b90d750 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:20.590570 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-b28a2589-6844-4196-a1c4-19c13b90d750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:20.670174 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 513/1015] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:20 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:45:20.682746 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5286b0-b4fc-42a4-aeac-52eb6c27567a None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:20.724439 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2de9e-a156-45a4-abad-dd8eb4e2b39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:20.725355 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2de9e-a156-45a4-abad-dd8eb4e2b39b None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:20.725804 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2de9e-a156-45a4-abad-dd8eb4e2b39b None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:20.726223 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2de9e-a156-45a4-abad-dd8eb4e2b39b None admin] PATH_INFO: `/v3/services` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:20.727003 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2de9e-a156-45a4-abad-dd8eb4e2b39b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:20.727453 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2de9e-a156-45a4-abad-dd8eb4e2b39b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:20.728990 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2de9e-a156-45a4-abad-dd8eb4e2b39b None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:20.735175 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 503/1016] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 24 15:45:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:20.740729 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a2589-6844-4196-a1c4-19c13b90d750 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:20.849886 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a2589-6844-4196-a1c4-19c13b90d750 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:20.852545 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:20.886642 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa055925-99b1-44ea-98d9-1b79ea2e80ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:20.887725 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa055925-99b1-44ea-98d9-1b79ea2e80ae None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:20.888022 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa055925-99b1-44ea-98d9-1b79ea2e80ae None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:20.888286 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa055925-99b1-44ea-98d9-1b79ea2e80ae None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:20.888972 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa055925-99b1-44ea-98d9-1b79ea2e80ae None admin] RBAC: Adding query filter params (type=compute) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:20.889841 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa055925-99b1-44ea-98d9-1b79ea2e80ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:20.891429 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa055925-99b1-44ea-98d9-1b79ea2e80ae None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:20.901462 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 514/1017] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 24 15:45:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:20.902763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2de9e-a156-45a4-abad-dd8eb4e2b39b None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:20.949480 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa055925-99b1-44ea-98d9-1b79ea2e80ae None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:21.001563 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:21.024460 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2de9e-a156-45a4-abad-dd8eb4e2b39b None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:21.059166 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa055925-99b1-44ea-98d9-1b79ea2e80ae None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:21.062300 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8a674-ed19-4215-9192-e3f3514a9236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:21.062998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8a674-ed19-4215-9192-e3f3514a9236 None admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:21.063281 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8a674-ed19-4215-9192-e3f3514a9236 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:21.063554 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8a674-ed19-4215-9192-e3f3514a9236 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:21.064211 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8a674-ed19-4215-9192-e3f3514a9236 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:21.065635 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8a674-ed19-4215-9192-e3f3514a9236 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:21.095764 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2bfb4-ab45-494e-b1a7-90188f185e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:21.096425 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2bfb4-ab45-494e-b1a7-90188f185e9a None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:21.096743 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2bfb4-ab45-494e-b1a7-90188f185e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:21.097018 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2bfb4-ab45-494e-b1a7-90188f185e9a None admin] PATH_INFO: `/v3/services/image` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:21.097602 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2bfb4-ab45-494e-b1a7-90188f185e9a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:21.098968 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2bfb4-ab45-494e-b1a7-90188f185e9a None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:21.107785 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-66e2bfb4-ab45-494e-b1a7-90188f185e9a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 15:45:21.107785 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:21.107785 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:45:21.107785 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:45:21.107785 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:45:21.107785 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:45:21.107785 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:45:21.107785 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:45:21.107785 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 15:45:21.107785 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:21.107785 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:45:21.107785 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:21.107785 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:21.107785 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:21.107785 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:21.107785 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:21.107785 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:21.109261 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:21.109261 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:21.109261 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:21.109261 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:21.109261 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:21.109261 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:21.109261 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:45:21.109261 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:45:21.109261 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:45:21.109261 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:45:21.109261 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:21.109261 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:21.109261 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:21.109261 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:21.109261 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:21.109261 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:21.110088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:21.110088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:21.110088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:21.110088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:21.110088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:21.110088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:21.110088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:21.110088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:21.110088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:21.110088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:21.110088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:45:21.110088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:45:21.110088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 15:45:21.110088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:21.110088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 515/1018] 10.222.0.64 () {56 vars in 1105 bytes} [Wed Aug 24 15:45:20 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:21.114798 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2bfb4-ab45-494e-b1a7-90188f185e9a None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:21.148378 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:21.177990 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 504/1019] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 15:45:20 2022] POST /identity/v3/endpoints => generated 334 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:21.225535 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2bfb4-ab45-494e-b1a7-90188f185e9a None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:21.272064 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e1d9b-722a-4a87-8ba1-f5da673c1ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:21.272712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e1d9b-722a-4a87-8ba1-f5da673c1ecf None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:21.272992 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e1d9b-722a-4a87-8ba1-f5da673c1ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:21.273260 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e1d9b-722a-4a87-8ba1-f5da673c1ecf None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:21.273893 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e1d9b-722a-4a87-8ba1-f5da673c1ecf None admin] RBAC: Adding query filter params (name=image) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:21.274193 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e1d9b-722a-4a87-8ba1-f5da673c1ecf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:21.275586 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e1d9b-722a-4a87-8ba1-f5da673c1ecf None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:21.290590 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 516/1020] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:45:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:21.292550 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8a674-ed19-4215-9192-e3f3514a9236 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:21.412033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8a674-ed19-4215-9192-e3f3514a9236 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:21.458511 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373f3f6-80d3-42ba-b699-1585de731375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:21.459477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27f371-f923-4594-9fba-1716c668430e None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:21.459912 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27f371-f923-4594-9fba-1716c668430e None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:21.460186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373f3f6-80d3-42ba-b699-1585de731375 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:21.460558 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27f371-f923-4594-9fba-1716c668430e None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:21.460950 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373f3f6-80d3-42ba-b699-1585de731375 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:21.461437 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373f3f6-80d3-42ba-b699-1585de731375 None admin] PATH_INFO: `/v3/services` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:21.462433 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373f3f6-80d3-42ba-b699-1585de731375 None admin] RBAC: Adding query filter params (type=image) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:21.462966 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373f3f6-80d3-42ba-b699-1585de731375 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:21.463295 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 517/1021] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:21.464696 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373f3f6-80d3-42ba-b699-1585de731375 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:21.466287 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:21.469939 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a142c-2cd0-4f68-b49c-d7b8a7ebec51 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:21.470298 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a142c-2cd0-4f68-b49c-d7b8a7ebec51 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:21.470671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a142c-2cd0-4f68-b49c-d7b8a7ebec51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:21.472975 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 505/1022] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:45:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:21.478574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373f3f6-80d3-42ba-b699-1585de731375 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:21.494721 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-2c4a142c-2cd0-4f68-b49c-d7b8a7ebec51 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:21.496260 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-2c4a142c-2cd0-4f68-b49c-d7b8a7ebec51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:21.584084 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 518/1023] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:21 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:45:21.617062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373f3f6-80d3-42ba-b699-1585de731375 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:21.654580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ab917-ab46-4217-a3f4-1e97a4fd360c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:21.655241 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ab917-ab46-4217-a3f4-1e97a4fd360c None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:21.655519 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ab917-ab46-4217-a3f4-1e97a4fd360c None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:21.655823 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ab917-ab46-4217-a3f4-1e97a4fd360c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:21.656494 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ab917-ab46-4217-a3f4-1e97a4fd360c None admin] RBAC: Adding query filter params (interface=public, service_id=19caec8a590249319318fbe6e8c453ef, region_id=RegionOne) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:21.656830 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ab917-ab46-4217-a3f4-1e97a4fd360c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:21.658202 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ab917-ab46-4217-a3f4-1e97a4fd360c None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:21.668257 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 506/1024] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Aug 24 15:45:21 2022] GET /identity/v3/endpoints?service_id=19caec8a590249319318fbe6e8c453ef&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:21.669968 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a142c-2cd0-4f68-b49c-d7b8a7ebec51 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:21.697020 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:21.779363 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a142c-2cd0-4f68-b49c-d7b8a7ebec51 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:21.815948 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77302af9-7698-47e6-a3f3-e868ad6a745a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:21.816616 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77302af9-7698-47e6-a3f3-e868ad6a745a None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:21.816878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77302af9-7698-47e6-a3f3-e868ad6a745a None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:21.817151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77302af9-7698-47e6-a3f3-e868ad6a745a None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:21.817764 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77302af9-7698-47e6-a3f3-e868ad6a745a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:21.819150 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77302af9-7698-47e6-a3f3-e868ad6a745a None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:21.832964 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 519/1025] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 24 15:45:21 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:21.867238 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ab917-ab46-4217-a3f4-1e97a4fd360c None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:21.941562 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:21.987728 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ab917-ab46-4217-a3f4-1e97a4fd360c None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:22.022522 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920369d-100c-4c0e-9717-0a4dbf49ee64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:22.023181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920369d-100c-4c0e-9717-0a4dbf49ee64 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:22.023421 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920369d-100c-4c0e-9717-0a4dbf49ee64 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:22.023695 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920369d-100c-4c0e-9717-0a4dbf49ee64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:22.024811 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920369d-100c-4c0e-9717-0a4dbf49ee64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:22.026482 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920369d-100c-4c0e-9717-0a4dbf49ee64 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:22.028201 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 507/1026] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:45:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:22.034767 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77302af9-7698-47e6-a3f3-e868ad6a745a None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:22.125289 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:22.141135 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77302af9-7698-47e6-a3f3-e868ad6a745a None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:22.176414 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0360d-106c-4e1a-a86e-9d2f5f28e1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:22.177093 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0360d-106c-4e1a-a86e-9d2f5f28e1b4 None admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:22.177377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0360d-106c-4e1a-a86e-9d2f5f28e1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:22.177647 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0360d-106c-4e1a-a86e-9d2f5f28e1b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:22.178318 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0360d-106c-4e1a-a86e-9d2f5f28e1b4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:22.179761 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0360d-106c-4e1a-a86e-9d2f5f28e1b4 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:22.268062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 520/1027] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 24 15:45:22 2022] POST /identity/v3/projects => generated 311 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:45:23.272746 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8848df7-0a93-4a63-899e-f04919634721 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:23.273270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8848df7-0a93-4a63-899e-f04919634721 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:23.273270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8848df7-0a93-4a63-899e-f04919634721 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:23.274772 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 508/1028] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:23.280407 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4dc1a-8cb9-4b11-af28-a58288f56b88 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:23.281034 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4dc1a-8cb9-4b11-af28-a58288f56b88 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:23.281142 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4dc1a-8cb9-4b11-af28-a58288f56b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:23.299311 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-7ec4dc1a-8cb9-4b11-af28-a58288f56b88 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:23.300508 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-7ec4dc1a-8cb9-4b11-af28-a58288f56b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:23.370404 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 521/1029] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:23 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:45:23.639082 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8848df7-0a93-4a63-899e-f04919634721 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:23.764611 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8848df7-0a93-4a63-899e-f04919634721 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:23.773825 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3eeccf-e4c8-4e03-8c7a-40a8efb912b5 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:23.774118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3eeccf-e4c8-4e03-8c7a-40a8efb912b5 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:23.774383 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3eeccf-e4c8-4e03-8c7a-40a8efb912b5 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:23.776138 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 522/1030] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:45:23.781842 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f1cfc-f116-416c-bded-6fc5eebf6fb4 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:23.782124 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f1cfc-f116-416c-bded-6fc5eebf6fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:23.782397 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f1cfc-f116-416c-bded-6fc5eebf6fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:23.801875 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-4e6f1cfc-f116-416c-bded-6fc5eebf6fb4 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:23.803079 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-4e6f1cfc-f116-416c-bded-6fc5eebf6fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:23.805247 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:23.814224 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54834971-ea4b-469c-9dc7-092549d24b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:23.814871 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54834971-ea4b-469c-9dc7-092549d24b40 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:23.815178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54834971-ea4b-469c-9dc7-092549d24b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:23.816804 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54834971-ea4b-469c-9dc7-092549d24b40 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:23.826602 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54834971-ea4b-469c-9dc7-092549d24b40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:45:23.831939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-54834971-ea4b-469c-9dc7-092549d24b40 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 15:45:23.831939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:23.831939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:23.831939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:23.831939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:23.831939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:23.831939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:23.831939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:23.831939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:23.831939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:23.831939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:23.831939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:23.831939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:45:23.831939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:45:23.831939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:45:23.831939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:45:23.832946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:45:23.832946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:45:23.832946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:45:23.832946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:45:23.832946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:23.832946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:23.832946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:23.832946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:23.832946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:23.832946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:23.832946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:23.832946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:23.832946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:23.832946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:23.832946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:23.832946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:23.833782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:23.833782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:23.833782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:23.833782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:23.833782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:45:23.833782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:45:23.833782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:45:23.833782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:45:23.833782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:45:23.833782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:45:23.833782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 15:45:23.833782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:23.838282 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 509/1031] 10.222.0.64 () {56 vars in 1120 bytes} [Wed Aug 24 15:45:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:23.838948 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54834971-ea4b-469c-9dc7-092549d24b40 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:23.878144 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:23.884727 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 523/1032] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:23 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:45:23.958913 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54834971-ea4b-469c-9dc7-092549d24b40 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:23.996543 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590c75a-440a-4cf4-a100-1bc9d27c1615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:23.997190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590c75a-440a-4cf4-a100-1bc9d27c1615 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:23.997492 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590c75a-440a-4cf4-a100-1bc9d27c1615 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:23.997749 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590c75a-440a-4cf4-a100-1bc9d27c1615 None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:23.998549 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590c75a-440a-4cf4-a100-1bc9d27c1615 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:23.999064 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590c75a-440a-4cf4-a100-1bc9d27c1615 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:24.000438 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590c75a-440a-4cf4-a100-1bc9d27c1615 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:24.013971 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 510/1033] 10.222.0.64 () {56 vars in 1115 bytes} [Wed Aug 24 15:45:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:24.015487 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f1cfc-f116-416c-bded-6fc5eebf6fb4 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:24.128315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f1cfc-f116-416c-bded-6fc5eebf6fb4 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:24.159040 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590c75a-440a-4cf4-a100-1bc9d27c1615 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:24.165470 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1521d47-113f-4d71-88b9-ee543d0f7686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:24.166111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1521d47-113f-4d71-88b9-ee543d0f7686 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:24.166392 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1521d47-113f-4d71-88b9-ee543d0f7686 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:24.166662 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1521d47-113f-4d71-88b9-ee543d0f7686 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:24.181075 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1521d47-113f-4d71-88b9-ee543d0f7686 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:24.182920 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1521d47-113f-4d71-88b9-ee543d0f7686 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:24.204760 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-c1521d47-113f-4d71-88b9-ee543d0f7686 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:45:24.204760 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:24.204760 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:24.204760 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:24.204760 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:24.204760 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:24.204760 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:24.204760 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:24.204760 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:24.204760 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:24.204760 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:24.204760 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:24.204760 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:45:24.204760 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:45:24.204760 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:45:24.204760 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:45:24.205880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:24.205880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:24.205880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:24.205880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:24.205880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:24.205880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:24.205880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:24.205880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:24.205880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:24.205880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:24.205880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:24.205880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:24.205880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:24.205880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:24.205880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:24.205880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:24.205880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:45:24.206816 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:45:24.206816 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:45:24.206816 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:24.207386 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 524/1034] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:45:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:24.213081 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1521d47-113f-4d71-88b9-ee543d0f7686 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:24.228411 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:24.275496 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:24.288447 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590c75a-440a-4cf4-a100-1bc9d27c1615 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:24.339238 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb537323-fc99-4376-ba14-327f93f5a9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:24.340711 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb537323-fc99-4376-ba14-327f93f5a9a5 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:24.341138 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb537323-fc99-4376-ba14-327f93f5a9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:24.341555 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb537323-fc99-4376-ba14-327f93f5a9a5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:24.341946 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1521d47-113f-4d71-88b9-ee543d0f7686 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:24.343695 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb537323-fc99-4376-ba14-327f93f5a9a5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:24.345680 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb537323-fc99-4376-ba14-327f93f5a9a5 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:24.357537 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-eb537323-fc99-4376-ba14-327f93f5a9a5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 15:45:24.357537 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:24.357537 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:45:24.357537 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:45:24.357537 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:45:24.357537 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:45:24.357537 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:45:24.357537 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:45:24.357537 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 15:45:24.357537 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:24.357537 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:45:24.357537 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:24.357537 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:24.357537 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:24.357537 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:24.357537 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:24.357537 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:24.358963 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:24.358963 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:24.358963 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:24.358963 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:24.358963 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:24.358963 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:24.358963 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:45:24.358963 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:45:24.358963 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:45:24.358963 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:45:24.358963 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:24.358963 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:24.358963 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:24.358963 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:24.358963 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:24.358963 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:24.360418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:24.360418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:24.360418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:24.360418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:24.360418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:24.360418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:24.360418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:24.360418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:24.360418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:24.360418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:24.360418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:45:24.360418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:45:24.360418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 15:45:24.360418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:24.360418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 511/1035] 10.222.0.64 () {56 vars in 1105 bytes} [Wed Aug 24 15:45:24 2022] GET /identity/v3/services/image => generated 86 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:45:24.361266 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b43f40-2496-400b-ab42-d0a4439e5e3e None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:24.361266 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b43f40-2496-400b-ab42-d0a4439e5e3e None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:24.361266 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b43f40-2496-400b-ab42-d0a4439e5e3e None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:24.362497 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 512/1036] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:24.365680 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b43f40-2496-400b-ab42-d0a4439e5e3e None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:24.396477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd094b-e967-46c4-88b6-dc79f600c1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:24.397292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd094b-e967-46c4-88b6-dc79f600c1b6 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:24.397633 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd094b-e967-46c4-88b6-dc79f600c1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:24.397976 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd094b-e967-46c4-88b6-dc79f600c1b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:24.398907 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd094b-e967-46c4-88b6-dc79f600c1b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:24.399273 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd094b-e967-46c4-88b6-dc79f600c1b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:24.401200 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd094b-e967-46c4-88b6-dc79f600c1b6 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:24.414897 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 525/1037] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:24.416769 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ea58c-c2ba-4631-a79d-1496ee1def05 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:24.417092 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ea58c-c2ba-4631-a79d-1496ee1def05 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:24.417226 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ea58c-c2ba-4631-a79d-1496ee1def05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:24.435922 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-cc5ea58c-c2ba-4631-a79d-1496ee1def05 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:24.437525 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-cc5ea58c-c2ba-4631-a79d-1496ee1def05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:24.481840 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b43f40-2496-400b-ab42-d0a4439e5e3e None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:24.500692 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:24.507561 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 526/1038] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:24 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:45:24.508428 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ea58c-c2ba-4631-a79d-1496ee1def05 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:24.520954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0e3aa-4e81-4a25-9001-52817c445c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:24.521579 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0e3aa-4e81-4a25-9001-52817c445c88 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:24.521864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0e3aa-4e81-4a25-9001-52817c445c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:24.522139 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0e3aa-4e81-4a25-9001-52817c445c88 None admin] PATH_INFO: `/v3/services` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:24.522789 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0e3aa-4e81-4a25-9001-52817c445c88 None admin] RBAC: Adding query filter params (name=image) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:24.523096 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0e3aa-4e81-4a25-9001-52817c445c88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:24.524563 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0e3aa-4e81-4a25-9001-52817c445c88 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:24.530441 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 513/1039] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:45:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:24.536171 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0e3aa-4e81-4a25-9001-52817c445c88 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:24.559622 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:24.626935 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ea58c-c2ba-4631-a79d-1496ee1def05 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:24.664975 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0e3aa-4e81-4a25-9001-52817c445c88 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:24.671585 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da5bb6-a172-44dc-b447-9d357c02b8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:24.672230 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da5bb6-a172-44dc-b447-9d357c02b8ad None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:24.672633 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da5bb6-a172-44dc-b447-9d357c02b8ad None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:24.672928 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da5bb6-a172-44dc-b447-9d357c02b8ad None admin] PATH_INFO: `/v3/users/nova` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:24.684051 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da5bb6-a172-44dc-b447-9d357c02b8ad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:24.685545 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da5bb6-a172-44dc-b447-9d357c02b8ad None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:24.698877 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-d5da5bb6-a172-44dc-b447-9d357c02b8ad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:45:24.698877 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:24.698877 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:24.698877 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:24.698877 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:24.698877 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:24.698877 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:24.698877 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:24.698877 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:24.698877 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:24.698877 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:24.698877 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:24.698877 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:45:24.698877 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:45:24.698877 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:45:24.698877 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:45:24.699934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:24.699934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:24.699934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:45:24.699934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:45:24.699934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:45:24.699934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:45:24.699934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:24.699934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:24.699934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:24.699934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:24.699934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:24.699934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:24.699934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:24.699934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:24.699934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:24.699934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:24.699934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:24.699934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:24.701052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:24.701052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:24.701052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:45:24.701052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:45:24.701052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:45:24.701052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:45:24.701052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:45:24.701052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:45:24.701052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:45:24.701052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:24.701052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 527/1040] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 24 15:45:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:24.706244 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da5bb6-a172-44dc-b447-9d357c02b8ad None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:24.710733 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ea9d2-85fe-4bbe-be30-8e180d2fcdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:24.711352 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ea9d2-85fe-4bbe-be30-8e180d2fcdb2 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:24.711639 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ea9d2-85fe-4bbe-be30-8e180d2fcdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:24.711899 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ea9d2-85fe-4bbe-be30-8e180d2fcdb2 None admin] PATH_INFO: `/v3/services` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:24.712531 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ea9d2-85fe-4bbe-be30-8e180d2fcdb2 None admin] RBAC: Adding query filter params (type=image) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:24.712862 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ea9d2-85fe-4bbe-be30-8e180d2fcdb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:24.714233 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ea9d2-85fe-4bbe-be30-8e180d2fcdb2 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:24.719863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 514/1041] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:45:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:24.725426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ea9d2-85fe-4bbe-be30-8e180d2fcdb2 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:24.773947 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:24.811964 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:24.814840 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da5bb6-a172-44dc-b447-9d357c02b8ad None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:24.830910 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ea9d2-85fe-4bbe-be30-8e180d2fcdb2 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:24.852220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0433d-ed95-4430-b1d0-60768a91651b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:24.852857 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0433d-ed95-4430-b1d0-60768a91651b None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:24.853140 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0433d-ed95-4430-b1d0-60768a91651b None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:24.853407 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0433d-ed95-4430-b1d0-60768a91651b None admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:24.854130 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d0433d-ed95-4430-b1d0-60768a91651b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:24.854433 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d0433d-ed95-4430-b1d0-60768a91651b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:24.855856 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d0433d-ed95-4430-b1d0-60768a91651b None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:24.867636 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd4d2a-c621-4cd7-abe7-09e7a94252aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:24.868240 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd4d2a-c621-4cd7-abe7-09e7a94252aa None admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:24.868522 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd4d2a-c621-4cd7-abe7-09e7a94252aa None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:24.868825 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd4d2a-c621-4cd7-abe7-09e7a94252aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:24.869476 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd4d2a-c621-4cd7-abe7-09e7a94252aa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:24.870830 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd4d2a-c621-4cd7-abe7-09e7a94252aa None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:24.873841 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 528/1042] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 24 15:45:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:24.874748 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0433d-ed95-4430-b1d0-60768a91651b None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:24.965599 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 515/1043] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 15:45:24 2022] POST /identity/v3/endpoints => generated 327 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:45:24.966450 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd4d2a-c621-4cd7-abe7-09e7a94252aa None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:24.984666 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0433d-ed95-4430-b1d0-60768a91651b None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:25.038778 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39331b3-ecaa-4fe0-b3c9-3285d0412eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:25.039692 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39331b3-ecaa-4fe0-b3c9-3285d0412eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:25.040004 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39331b3-ecaa-4fe0-b3c9-3285d0412eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:25.040310 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39331b3-ecaa-4fe0-b3c9-3285d0412eb5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:25.041474 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39331b3-ecaa-4fe0-b3c9-3285d0412eb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:25.042945 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39331b3-ecaa-4fe0-b3c9-3285d0412eb5 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:25.048679 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 529/1044] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:45:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:25.051213 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39331b3-ecaa-4fe0-b3c9-3285d0412eb5 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:25.080844 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:25.090885 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:25.095832 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd4d2a-c621-4cd7-abe7-09e7a94252aa None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:25.138643 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103feb39-82d3-47c4-965f-8dfe395def5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:25.139637 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103feb39-82d3-47c4-965f-8dfe395def5c None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:25.139918 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103feb39-82d3-47c4-965f-8dfe395def5c None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:25.140200 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103feb39-82d3-47c4-965f-8dfe395def5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:25.188898 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39331b3-ecaa-4fe0-b3c9-3285d0412eb5 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:25.220294 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103feb39-82d3-47c4-965f-8dfe395def5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:25.221891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103feb39-82d3-47c4-965f-8dfe395def5c None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:25.223062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b0b45-6f17-4b5b-b90e-bf8e058c76df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:25.223676 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b0b45-6f17-4b5b-b90e-bf8e058c76df None admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:25.223962 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b0b45-6f17-4b5b-b90e-bf8e058c76df None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:25.224234 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b0b45-6f17-4b5b-b90e-bf8e058c76df None admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:25.224915 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b0b45-6f17-4b5b-b90e-bf8e058c76df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:25.226342 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b0b45-6f17-4b5b-b90e-bf8e058c76df None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:25.300747 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 530/1045] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 24 15:45:25 2022] POST /identity/v3/users => generated 285 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:45:25.334279 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:25.338535 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 516/1046] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:45:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:45:25.344669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b0b45-6f17-4b5b-b90e-bf8e058c76df None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:25.433831 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:25.458114 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b0b45-6f17-4b5b-b90e-bf8e058c76df None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:25.506425 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93552913-2efd-43d1-a216-87673373f5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:25.507070 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93552913-2efd-43d1-a216-87673373f5bf None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:25.507354 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93552913-2efd-43d1-a216-87673373f5bf None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:25.507840 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93552913-2efd-43d1-a216-87673373f5bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:25.519877 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93552913-2efd-43d1-a216-87673373f5bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:25.521557 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93552913-2efd-43d1-a216-87673373f5bf None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:25.538060 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-93552913-2efd-43d1-a216-87673373f5bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:45:25.538060 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:25.538060 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:25.538060 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:25.538060 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:25.538060 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:25.538060 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:25.538060 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:25.538060 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:25.538060 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:25.538060 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:25.538060 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:25.538060 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:45:25.538060 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:45:25.538060 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:45:25.538060 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:45:25.539089 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:25.539089 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:25.539089 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:25.539089 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:25.539089 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:25.539089 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:25.539089 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:25.539089 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:25.539089 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:25.539089 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:25.539089 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:25.539089 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:25.539089 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:25.539089 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:25.539089 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:25.539089 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:25.539089 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:45:25.540326 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:45:25.540326 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:45:25.540326 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:25.540326 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 531/1047] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:25.544961 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103feb39-82d3-47c4-965f-8dfe395def5c None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:25.662133 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103feb39-82d3-47c4-965f-8dfe395def5c None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:25.702754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f274c50-7399-41bc-ae91-f7b1410ca5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:25.703533 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f274c50-7399-41bc-ae91-f7b1410ca5bb None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:25.703908 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f274c50-7399-41bc-ae91-f7b1410ca5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:25.704278 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f274c50-7399-41bc-ae91-f7b1410ca5bb None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:25.705114 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f274c50-7399-41bc-ae91-f7b1410ca5bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:25.705584 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f274c50-7399-41bc-ae91-f7b1410ca5bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:25.707417 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f274c50-7399-41bc-ae91-f7b1410ca5bb None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:25.724115 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 517/1048] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:25.730652 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93552913-2efd-43d1-a216-87673373f5bf None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:25.874244 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93552913-2efd-43d1-a216-87673373f5bf None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:25.906548 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:25.920955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0854323-b116-43d3-8cf4-45a11fa591ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:25.920955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0854323-b116-43d3-8cf4-45a11fa591ba None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:25.920955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0854323-b116-43d3-8cf4-45a11fa591ba None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:25.920955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0854323-b116-43d3-8cf4-45a11fa591ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:25.924034 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0854323-b116-43d3-8cf4-45a11fa591ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:25.925644 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0854323-b116-43d3-8cf4-45a11fa591ba None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:25.939006 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-e0854323-b116-43d3-8cf4-45a11fa591ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:45:25.939006 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:25.939006 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:25.939006 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:25.939006 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:25.939006 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:25.939006 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:25.939006 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:25.939006 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:25.939006 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:25.939006 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:25.939006 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:25.939006 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:45:25.939006 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:45:25.939006 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:45:25.940239 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:45:25.940239 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:25.940239 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:25.940239 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:25.940239 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:25.940239 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:25.940239 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:25.940239 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:25.940239 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:25.940239 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:25.940239 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:25.940239 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:25.940239 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:25.940239 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:25.940239 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:25.940239 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:25.940239 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:25.941492 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:45:25.941492 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:45:25.941492 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:45:25.941492 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:45:25.941492 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:45:25.941492 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:45:25.941492 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:45:25.941492 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:25.947482 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 532/1049] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:45:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:45:25.948735 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f274c50-7399-41bc-ae91-f7b1410ca5bb None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:26.031388 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:26.078031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f274c50-7399-41bc-ae91-f7b1410ca5bb None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:26.119500 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f7f24-d6de-446d-acb5-5ca0619a9255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:26.120124 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f7f24-d6de-446d-acb5-5ca0619a9255 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:26.120382 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f7f24-d6de-446d-acb5-5ca0619a9255 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:26.120687 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f7f24-d6de-446d-acb5-5ca0619a9255 None admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:26.121364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f7f24-d6de-446d-acb5-5ca0619a9255 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:26.121661 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f7f24-d6de-446d-acb5-5ca0619a9255 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:26.123086 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f7f24-d6de-446d-acb5-5ca0619a9255 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:26.142148 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 518/1050] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:45:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:26.143775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0854323-b116-43d3-8cf4-45a11fa591ba None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:26.261331 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0854323-b116-43d3-8cf4-45a11fa591ba None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:26.312963 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5709f-e4dd-4ca8-89a9-23aca81541ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:26.313801 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5709f-e4dd-4ca8-89a9-23aca81541ab None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:26.314684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5709f-e4dd-4ca8-89a9-23aca81541ab None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:26.314893 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5709f-e4dd-4ca8-89a9-23aca81541ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:26.315911 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5709f-e4dd-4ca8-89a9-23aca81541ab None admin] RBAC: Adding query filter params (role.id=645ada3cca2e4ac49e7055528e4748d6, scope.project.id=9b25a7c01ab540ceae16dd618b848f2d, user.id=e5f0d8fe42e74d68bfa9a0e365bab4b6) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:26.316282 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5709f-e4dd-4ca8-89a9-23aca81541ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:26.317784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5709f-e4dd-4ca8-89a9-23aca81541ab None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:26.332721 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 533/1051] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:45:26 2022] GET /identity/v3/role_assignments?user.id=e5f0d8fe42e74d68bfa9a0e365bab4b6&scope.project.id=9b25a7c01ab540ceae16dd618b848f2d&role.id=645ada3cca2e4ac49e7055528e4748d6 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:27.059468 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce927a94-0bfd-467b-9cae-da840d954d71 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:27.059986 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce927a94-0bfd-467b-9cae-da840d954d71 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:27.060110 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce927a94-0bfd-467b-9cae-da840d954d71 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:27.061488 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 519/1052] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:27.066592 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675f02f-2a92-4fdb-ad08-e1d6a79ea48e None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:27.066968 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675f02f-2a92-4fdb-ad08-e1d6a79ea48e None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:27.067155 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675f02f-2a92-4fdb-ad08-e1d6a79ea48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:27.085449 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-a675f02f-2a92-4fdb-ad08-e1d6a79ea48e None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:27.086644 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-a675f02f-2a92-4fdb-ad08-e1d6a79ea48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:27.137319 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:27.156656 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 534/1053] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:45:27.354674 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f8bbb-183c-4c25-9437-5c2b815261e0 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:27.355268 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f8bbb-183c-4c25-9437-5c2b815261e0 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:27.355817 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f8bbb-183c-4c25-9437-5c2b815261e0 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:27.358518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 520/1054] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:45:27.365197 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338d686-7ea7-49ae-9111-b3524093b434 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:27.365480 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338d686-7ea7-49ae-9111-b3524093b434 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:27.365905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338d686-7ea7-49ae-9111-b3524093b434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:27.386764 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-9338d686-7ea7-49ae-9111-b3524093b434 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:27.387983 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-9338d686-7ea7-49ae-9111-b3524093b434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:27.431996 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f8bbb-183c-4c25-9437-5c2b815261e0 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:27.471602 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 535/1055] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:45:27.553171 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f8bbb-183c-4c25-9437-5c2b815261e0 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:27.575404 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:27.593139 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f9a61-79cf-450a-80ad-4d69bb297f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:27.593814 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f9a61-79cf-450a-80ad-4d69bb297f94 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:27.594095 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f9a61-79cf-450a-80ad-4d69bb297f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:27.594449 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f9a61-79cf-450a-80ad-4d69bb297f94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:27.670191 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f9a61-79cf-450a-80ad-4d69bb297f94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:27.671563 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f9a61-79cf-450a-80ad-4d69bb297f94 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:27.742939 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338d686-7ea7-49ae-9111-b3524093b434 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:27.791019 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 521/1056] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:45:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:45:27.800003 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f9a61-79cf-450a-80ad-4d69bb297f94 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:27.837973 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:27.879150 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338d686-7ea7-49ae-9111-b3524093b434 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:27.895464 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:27.919598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65f9ff-b3f6-4816-9bf5-f5ad12eaf6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:27.920427 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65f9ff-b3f6-4816-9bf5-f5ad12eaf6fc None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:27.920683 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65f9ff-b3f6-4816-9bf5-f5ad12eaf6fc None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:27.921066 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65f9ff-b3f6-4816-9bf5-f5ad12eaf6fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:27.931568 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f9a61-79cf-450a-80ad-4d69bb297f94 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:27.932785 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65f9ff-b3f6-4816-9bf5-f5ad12eaf6fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:45:27.939059 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-ad65f9ff-b3f6-4816-9bf5-f5ad12eaf6fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:45:27.939059 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:27.939059 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:27.939059 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:27.939059 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:27.939059 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:27.939059 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:27.939059 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:27.939059 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:27.939059 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:27.939059 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:27.939059 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:27.939059 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:45:27.939059 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:45:27.939059 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:45:27.939059 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:45:27.940252 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:45:27.940252 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:45:27.940252 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:45:27.940252 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:45:27.940252 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:27.940252 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:27.940252 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:27.940252 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:27.940252 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:27.940252 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:27.940252 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:27.940252 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:27.940252 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:27.940252 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:27.940252 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:27.940252 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:27.941193 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:27.941193 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:27.941193 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:27.941193 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:27.941193 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:45:27.941193 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:45:27.941193 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:45:27.941193 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:45:27.941193 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:45:27.941193 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:45:27.941193 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:45:27.941193 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:27.944669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 536/1057] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:45:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:27.949981 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65f9ff-b3f6-4816-9bf5-f5ad12eaf6fc None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:27.970363 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1909551-a9ce-46c2-a192-1e27c71db937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:27.971006 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1909551-a9ce-46c2-a192-1e27c71db937 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:27.971291 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1909551-a9ce-46c2-a192-1e27c71db937 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:27.971593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1909551-a9ce-46c2-a192-1e27c71db937 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:27.982385 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1909551-a9ce-46c2-a192-1e27c71db937 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:27.983812 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1909551-a9ce-46c2-a192-1e27c71db937 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:28.001328 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-c1909551-a9ce-46c2-a192-1e27c71db937 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:45:28.001328 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:28.001328 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:28.001328 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:28.001328 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:28.001328 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:28.001328 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:28.001328 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:28.001328 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:28.001328 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:28.001328 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:28.001328 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:28.001328 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:45:28.001328 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:45:28.001328 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:45:28.001328 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:45:28.002361 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:28.002361 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:28.002361 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:28.002361 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:28.002361 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:28.002361 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:28.002361 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:28.002361 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:28.002361 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:28.002361 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:28.002361 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:28.002361 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:28.002361 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:28.002361 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:28.002361 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:28.002361 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:28.002361 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:45:28.003248 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:45:28.003248 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:45:28.003248 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:28.007471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 522/1058] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:28.008370 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1909551-a9ce-46c2-a192-1e27c71db937 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:28.064272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65f9ff-b3f6-4816-9bf5-f5ad12eaf6fc None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:28.086635 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:28.105202 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7649c6-07d1-410c-ad57-0f276b3d2052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:28.106389 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7649c6-07d1-410c-ad57-0f276b3d2052 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:28.106702 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7649c6-07d1-410c-ad57-0f276b3d2052 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:28.107108 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7649c6-07d1-410c-ad57-0f276b3d2052 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:28.108421 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7649c6-07d1-410c-ad57-0f276b3d2052 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:28.108781 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7649c6-07d1-410c-ad57-0f276b3d2052 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:28.110169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7649c6-07d1-410c-ad57-0f276b3d2052 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:28.119337 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 537/1059] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:45:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:28.122284 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1909551-a9ce-46c2-a192-1e27c71db937 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:28.126387 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7649c6-07d1-410c-ad57-0f276b3d2052 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:28.160275 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9381f-9c5f-4044-9df8-1716eb4b8daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:28.161183 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9381f-9c5f-4044-9df8-1716eb4b8daa None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:28.161468 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9381f-9c5f-4044-9df8-1716eb4b8daa None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:28.161741 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9381f-9c5f-4044-9df8-1716eb4b8daa None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:28.162396 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9381f-9c5f-4044-9df8-1716eb4b8daa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:28.162723 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9381f-9c5f-4044-9df8-1716eb4b8daa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:28.164109 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9381f-9c5f-4044-9df8-1716eb4b8daa None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:28.165552 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:28.188743 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 523/1060] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:28.244332 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7649c6-07d1-410c-ad57-0f276b3d2052 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:28.261842 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f4ffa-5818-4993-aaa3-dba47215fe0f None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:28.262359 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f4ffa-5818-4993-aaa3-dba47215fe0f None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:28.262715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f4ffa-5818-4993-aaa3-dba47215fe0f None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:28.264596 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 524/1061] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:28.270395 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4965cd-d433-4b58-9f23-cce7d9d64366 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:28.270734 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4965cd-d433-4b58-9f23-cce7d9d64366 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:28.270954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4965cd-d433-4b58-9f23-cce7d9d64366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:28.288707 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4f8ff-f96b-47b2-ba18-c162ef45cad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:28.289418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4f8ff-f96b-47b2-ba18-c162ef45cad6 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:28.289743 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4f8ff-f96b-47b2-ba18-c162ef45cad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:28.290015 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4f8ff-f96b-47b2-ba18-c162ef45cad6 None admin] PATH_INFO: `/v3/users/e1fd08443877475ab6a76d4378991c41` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:28.291360 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-eb4965cd-d433-4b58-9f23-cce7d9d64366 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:28.292616 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-eb4965cd-d433-4b58-9f23-cce7d9d64366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:28.308494 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4f8ff-f96b-47b2-ba18-c162ef45cad6 None admin] RBAC: Authorizing `identity:get_user(user_id=e1fd08443877475ab6a76d4378991c41)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:28.310188 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4f8ff-f96b-47b2-ba18-c162ef45cad6 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:28.316766 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 538/1062] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:45:28 2022] GET /identity/v3/users/e1fd08443877475ab6a76d4378991c41 => generated 285 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:28.319325 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4f8ff-f96b-47b2-ba18-c162ef45cad6 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:28.391872 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 525/1063] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:45:28.439796 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:28.446694 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4f8ff-f96b-47b2-ba18-c162ef45cad6 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:28.495049 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45966023-4682-491c-b338-094b8eec230c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:28.495667 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45966023-4682-491c-b338-094b8eec230c None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:28.495948 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45966023-4682-491c-b338-094b8eec230c None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:28.496220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45966023-4682-491c-b338-094b8eec230c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:28.564054 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45966023-4682-491c-b338-094b8eec230c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:28.565551 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45966023-4682-491c-b338-094b8eec230c None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:28.659331 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4965cd-d433-4b58-9f23-cce7d9d64366 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:28.660871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:28.668768 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 539/1064] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:45:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 15:45:28.680201 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45966023-4682-491c-b338-094b8eec230c None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:28.724946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:28.765587 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4965cd-d433-4b58-9f23-cce7d9d64366 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:28.776575 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45966023-4682-491c-b338-094b8eec230c None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:28.801399 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1708b-5018-4791-a167-f48ddc32bd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:28.802033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1708b-5018-4791-a167-f48ddc32bd20 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:28.802309 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1708b-5018-4791-a167-f48ddc32bd20 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:28.802575 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1708b-5018-4791-a167-f48ddc32bd20 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:28.812112 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161a2be-d929-4827-859b-e751bb2fa38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:28.812782 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161a2be-d929-4827-859b-e751bb2fa38f None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:28.813068 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161a2be-d929-4827-859b-e751bb2fa38f None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:28.813347 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161a2be-d929-4827-859b-e751bb2fa38f None admin] PATH_INFO: `/v3/projects/2e25f2f57bcb439faf86162acd21ff1a` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:28.814048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e1708b-5018-4791-a167-f48ddc32bd20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:45:28.814476 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161a2be-d929-4827-859b-e751bb2fa38f None admin] RBAC: Authorizing `identity:get_project(project_id=2e25f2f57bcb439faf86162acd21ff1a)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:28.815950 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161a2be-d929-4827-859b-e751bb2fa38f None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:28.817642 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 540/1065] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:45:28 2022] GET /identity/v3/projects/2e25f2f57bcb439faf86162acd21ff1a => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:28.818777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-59e1708b-5018-4791-a167-f48ddc32bd20 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 15:45:28.818777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:28.818777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:28.818777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:28.818777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:28.818777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:28.818777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:28.818777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:28.818777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:28.818777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:28.818777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:28.818777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:28.818777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:45:28.818777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:45:28.818777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:45:28.818777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:45:28.819866 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:45:28.819866 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:45:28.819866 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:45:28.819866 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:45:28.819866 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:28.819866 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:28.819866 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:28.819866 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:28.819866 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:28.819866 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:28.819866 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:28.819866 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:28.819866 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:28.819866 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:28.819866 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:28.819866 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:28.820856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:28.820856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:28.820856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:28.820856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:28.820856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:45:28.820856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:45:28.820856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:45:28.820856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:45:28.820856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:45:28.820856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:45:28.820856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 15:45:28.820856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:28.820856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 526/1066] 10.222.0.64 () {56 vars in 1120 bytes} [Wed Aug 24 15:45:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:45:28.823849 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161a2be-d929-4827-859b-e751bb2fa38f None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:28.825540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1708b-5018-4791-a167-f48ddc32bd20 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:28.887992 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:28.927912 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161a2be-d929-4827-859b-e751bb2fa38f None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:28.940861 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1708b-5018-4791-a167-f48ddc32bd20 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:28.963659 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638d062-2da7-4444-a06d-60a7b5ddb613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:28.964094 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638d062-2da7-4444-a06d-60a7b5ddb613 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:28.964373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638d062-2da7-4444-a06d-60a7b5ddb613 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:28.964672 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638d062-2da7-4444-a06d-60a7b5ddb613 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:28.965410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f638d062-2da7-4444-a06d-60a7b5ddb613 None admin] RBAC: Adding query filter params (role.id=c6745e08f9da4a2bae8510c9983635c3, scope.project.id=2e25f2f57bcb439faf86162acd21ff1a, user.id=e1fd08443877475ab6a76d4378991c41) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:28.965666 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:28.965773 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f638d062-2da7-4444-a06d-60a7b5ddb613 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:28.967858 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f638d062-2da7-4444-a06d-60a7b5ddb613 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:28.988746 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 541/1067] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:45:28 2022] GET /identity/v3/role_assignments?user.id=e1fd08443877475ab6a76d4378991c41&scope.project.id=2e25f2f57bcb439faf86162acd21ff1a&role.id=c6745e08f9da4a2bae8510c9983635c3 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:28.988976 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98557e60-1576-40de-99f3-1e34afc90646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:28.988976 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98557e60-1576-40de-99f3-1e34afc90646 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:28.988976 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98557e60-1576-40de-99f3-1e34afc90646 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:28.988976 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98557e60-1576-40de-99f3-1e34afc90646 None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:28.989305 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98557e60-1576-40de-99f3-1e34afc90646 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:28.989305 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98557e60-1576-40de-99f3-1e34afc90646 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:28.989305 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98557e60-1576-40de-99f3-1e34afc90646 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:28.990740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 527/1068] 10.222.0.64 () {56 vars in 1115 bytes} [Wed Aug 24 15:45:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:28.996945 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638d062-2da7-4444-a06d-60a7b5ddb613 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:29.113907 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638d062-2da7-4444-a06d-60a7b5ddb613 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:29.153446 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:29.165555 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac28a1-b758-487f-931a-508c77bcfc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:29.167241 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac28a1-b758-487f-931a-508c77bcfc66 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:29.167241 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac28a1-b758-487f-931a-508c77bcfc66 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:29.167241 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac28a1-b758-487f-931a-508c77bcfc66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:29.178790 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac28a1-b758-487f-931a-508c77bcfc66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:29.180247 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac28a1-b758-487f-931a-508c77bcfc66 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:29.195483 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-58ac28a1-b758-487f-931a-508c77bcfc66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:45:29.195483 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:29.195483 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:29.195483 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:29.195483 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:29.195483 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:29.195483 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:29.195483 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:29.195483 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:29.195483 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:29.195483 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:29.195483 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:29.195483 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:45:29.195483 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:45:29.195483 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:45:29.195483 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:45:29.197880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:29.197880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:29.197880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:29.197880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:29.197880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:29.197880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:29.197880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:29.197880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:29.197880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:29.197880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:29.197880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:29.197880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:29.197880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:29.197880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:29.197880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:29.197880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:29.197880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:45:29.199790 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:45:29.199790 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:45:29.199790 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:29.199790 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 542/1069] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:45:29.202968 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98557e60-1576-40de-99f3-1e34afc90646 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:29.315818 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98557e60-1576-40de-99f3-1e34afc90646 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:29.349940 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54365813-e407-4bbe-8a7d-15cb902682c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:29.350551 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54365813-e407-4bbe-8a7d-15cb902682c7 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:29.350828 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54365813-e407-4bbe-8a7d-15cb902682c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:29.351098 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54365813-e407-4bbe-8a7d-15cb902682c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:29.351742 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54365813-e407-4bbe-8a7d-15cb902682c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:29.352074 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54365813-e407-4bbe-8a7d-15cb902682c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:29.353479 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54365813-e407-4bbe-8a7d-15cb902682c7 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:29.365256 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 528/1070] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:29.370833 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac28a1-b758-487f-931a-508c77bcfc66 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:29.473899 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac28a1-b758-487f-931a-508c77bcfc66 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:29.507403 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49781178-f101-4ba1-bf4f-cc28f1239b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:29.508025 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49781178-f101-4ba1-bf4f-cc28f1239b78 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:29.508307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49781178-f101-4ba1-bf4f-cc28f1239b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:29.508582 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49781178-f101-4ba1-bf4f-cc28f1239b78 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:29.516859 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49781178-f101-4ba1-bf4f-cc28f1239b78 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:29.518305 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49781178-f101-4ba1-bf4f-cc28f1239b78 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:29.529855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-49781178-f101-4ba1-bf4f-cc28f1239b78 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:45:29.529855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:29.529855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:29.529855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:29.529855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:29.529855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:29.529855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:29.529855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:29.529855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:29.529855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:29.529855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:29.529855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:29.529855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:45:29.529855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:45:29.529855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:45:29.529855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:45:29.530927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:29.530927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:29.530927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:45:29.530927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:45:29.530927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:45:29.530927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:45:29.530927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:29.530927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:29.530927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:29.530927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:29.530927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:29.530927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:29.530927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:29.530927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:29.530927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:29.530927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:29.530927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:29.530927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:29.531863 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:29.531863 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:29.531863 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:45:29.531863 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:45:29.531863 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:45:29.531863 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:45:29.531863 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:45:29.531863 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:45:29.531863 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:45:29.531863 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:29.531863 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 543/1071] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 24 15:45:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:45:29.536867 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54365813-e407-4bbe-8a7d-15cb902682c7 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:29.583408 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:29.638602 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54365813-e407-4bbe-8a7d-15cb902682c7 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:29.672876 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc78403-23c4-43ed-9095-e5d60ef74aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:29.673500 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc78403-23c4-43ed-9095-e5d60ef74aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:29.673780 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc78403-23c4-43ed-9095-e5d60ef74aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:29.674049 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc78403-23c4-43ed-9095-e5d60ef74aa8 None admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:29.674768 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc78403-23c4-43ed-9095-e5d60ef74aa8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:29.675073 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc78403-23c4-43ed-9095-e5d60ef74aa8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:29.676488 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc78403-23c4-43ed-9095-e5d60ef74aa8 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:29.693921 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 529/1072] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 24 15:45:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:29.699520 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49781178-f101-4ba1-bf4f-cc28f1239b78 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:29.739642 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:29.802025 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49781178-f101-4ba1-bf4f-cc28f1239b78 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:29.837182 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a3870-158e-43ff-adf9-196eecc662cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:29.837734 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a3870-158e-43ff-adf9-196eecc662cd None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:29.838074 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a3870-158e-43ff-adf9-196eecc662cd None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:29.838353 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a3870-158e-43ff-adf9-196eecc662cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:29.849493 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a3870-158e-43ff-adf9-196eecc662cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:29.850945 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a3870-158e-43ff-adf9-196eecc662cd None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:29.865754 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-998a3870-158e-43ff-adf9-196eecc662cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:45:29.865754 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:29.865754 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:29.865754 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:29.865754 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:29.865754 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:29.865754 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:29.865754 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:29.865754 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:29.865754 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:29.865754 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:29.865754 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:29.865754 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:45:29.865754 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:45:29.865754 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:45:29.865754 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:45:29.866723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:29.866723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:29.866723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:29.866723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:29.866723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:29.866723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:29.866723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:29.866723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:29.866723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:29.866723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:29.866723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:29.866723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:29.866723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:29.866723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:29.866723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:29.866723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:29.866723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:45:29.867607 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:45:29.867607 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:45:29.867607 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:29.867607 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 544/1073] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:45:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:29.872728 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc78403-23c4-43ed-9095-e5d60ef74aa8 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:29.980280 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc78403-23c4-43ed-9095-e5d60ef74aa8 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:29.981980 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:30.015194 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4b772-7e5a-422e-ae80-85dc7a7d503b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:30.015796 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4b772-7e5a-422e-ae80-85dc7a7d503b None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:30.016073 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4b772-7e5a-422e-ae80-85dc7a7d503b None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:30.016340 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4b772-7e5a-422e-ae80-85dc7a7d503b None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:30.017003 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4b772-7e5a-422e-ae80-85dc7a7d503b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:30.017306 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4b772-7e5a-422e-ae80-85dc7a7d503b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:30.018721 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4b772-7e5a-422e-ae80-85dc7a7d503b None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:30.031500 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 530/1074] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:30.037283 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a3870-158e-43ff-adf9-196eecc662cd None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:30.134657 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:30.144330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a3870-158e-43ff-adf9-196eecc662cd None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:30.180279 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ddd50-45e5-4e92-bc83-27588a1c4348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:30.180953 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ddd50-45e5-4e92-bc83-27588a1c4348 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:30.181235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ddd50-45e5-4e92-bc83-27588a1c4348 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:30.181503 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ddd50-45e5-4e92-bc83-27588a1c4348 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:30.189083 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ddd50-45e5-4e92-bc83-27588a1c4348 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:30.190375 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ddd50-45e5-4e92-bc83-27588a1c4348 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:30.201857 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-e31ddd50-45e5-4e92-bc83-27588a1c4348 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:45:30.201857 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:30.201857 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:30.201857 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:30.201857 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:30.201857 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:30.201857 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:30.201857 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:30.201857 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:30.201857 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:30.201857 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:30.201857 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:30.201857 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:45:30.201857 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:45:30.201857 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:45:30.202816 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:45:30.202816 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:30.202816 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:30.202816 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:30.202816 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:30.202816 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:30.202816 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:30.202816 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:30.202816 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:30.202816 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:30.202816 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:30.202816 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:30.202816 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:30.202816 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:30.202816 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:30.202816 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:30.202816 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:30.203723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:45:30.203723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:45:30.203723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:45:30.203723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:45:30.203723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:45:30.203723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:45:30.203723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:45:30.203723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:30.203723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 545/1075] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:45:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:30.208977 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4b772-7e5a-422e-ae80-85dc7a7d503b None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:30.315131 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4b772-7e5a-422e-ae80-85dc7a7d503b None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:30.349032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c4c92-67a4-423b-8957-fc0d0a22ca31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:30.349633 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c4c92-67a4-423b-8957-fc0d0a22ca31 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:30.349910 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c4c92-67a4-423b-8957-fc0d0a22ca31 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:30.350179 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c4c92-67a4-423b-8957-fc0d0a22ca31 None admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:30.350863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c4c92-67a4-423b-8957-fc0d0a22ca31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:30.351165 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c4c92-67a4-423b-8957-fc0d0a22ca31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:30.352588 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c4c92-67a4-423b-8957-fc0d0a22ca31 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:30.369547 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 531/1076] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:45:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:30.370656 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ddd50-45e5-4e92-bc83-27588a1c4348 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:30.474542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ddd50-45e5-4e92-bc83-27588a1c4348 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:30.510095 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba4277-5383-41a5-bc03-da157970654f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:30.510761 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba4277-5383-41a5-bc03-da157970654f None admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:30.511042 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba4277-5383-41a5-bc03-da157970654f None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:30.511316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba4277-5383-41a5-bc03-da157970654f None admin] PATH_INFO: `/v3/projects/9b25a7c01ab540ceae16dd618b848f2d/users/e5f0d8fe42e74d68bfa9a0e365bab4b6/roles/645ada3cca2e4ac49e7055528e4748d6` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:30.514023 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba4277-5383-41a5-bc03-da157970654f None admin] RBAC: Authorizing `identity:create_grant(project_id=9b25a7c01ab540ceae16dd618b848f2d, user_id=e5f0d8fe42e74d68bfa9a0e365bab4b6, role_id=645ada3cca2e4ac49e7055528e4748d6)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:30.515470 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba4277-5383-41a5-bc03-da157970654f None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:30.579850 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 546/1077] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 24 15:45:30 2022] PUT /identity/v3/projects/9b25a7c01ab540ceae16dd618b848f2d/users/e5f0d8fe42e74d68bfa9a0e365bab4b6/roles/645ada3cca2e4ac49e7055528e4748d6 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:30.917089 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb32734-1e07-43e5-be63-3d467d92b9ff None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:30.917298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb32734-1e07-43e5-be63-3d467d92b9ff None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:30.917575 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb32734-1e07-43e5-be63-3d467d92b9ff None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:30.918927 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 532/1078] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:30.924666 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b2341-8651-4a28-9c84-954ba2e86839 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:30.924959 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b2341-8651-4a28-9c84-954ba2e86839 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:30.925235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b2341-8651-4a28-9c84-954ba2e86839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:30.943995 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-060b2341-8651-4a28-9c84-954ba2e86839 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:30.945214 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-060b2341-8651-4a28-9c84-954ba2e86839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:30.948660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:31.013033 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 547/1079] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:45:31.287851 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb32734-1e07-43e5-be63-3d467d92b9ff None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:31.315631 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:31.402906 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb32734-1e07-43e5-be63-3d467d92b9ff None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:31.438250 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef9bbd-4164-41bd-b526-3b8e339c7a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:31.438883 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef9bbd-4164-41bd-b526-3b8e339c7a94 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:31.439157 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef9bbd-4164-41bd-b526-3b8e339c7a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:31.439423 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef9bbd-4164-41bd-b526-3b8e339c7a94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:31.449418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef9bbd-4164-41bd-b526-3b8e339c7a94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:45:31.454134 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-67ef9bbd-4164-41bd-b526-3b8e339c7a94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:45:31.454134 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:31.454134 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:31.454134 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:31.454134 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:31.454134 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:31.454134 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:31.454134 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:31.454134 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:31.454134 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:31.454134 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:31.454134 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:31.454134 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:45:31.454134 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:45:31.454134 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:45:31.454134 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:45:31.455195 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:45:31.455195 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:45:31.455195 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:45:31.455195 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:45:31.455195 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:31.455195 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:31.455195 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:31.455195 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:31.455195 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:31.455195 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:31.455195 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:31.455195 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:31.455195 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:31.455195 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:31.455195 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:31.455195 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:31.456526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:31.456526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:31.456526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:31.456526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:31.456526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:45:31.456526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:45:31.456526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:45:31.456526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:45:31.456526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:45:31.456526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:45:31.456526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:45:31.456526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:31.456526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 533/1080] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:45:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:31.461448 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b2341-8651-4a28-9c84-954ba2e86839 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:31.568586 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b2341-8651-4a28-9c84-954ba2e86839 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:31.603709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea8ff8-4f0c-4fa2-9e55-5105d45f5ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:31.604425 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea8ff8-4f0c-4fa2-9e55-5105d45f5ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:31.604739 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea8ff8-4f0c-4fa2-9e55-5105d45f5ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:31.605014 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea8ff8-4f0c-4fa2-9e55-5105d45f5ea2 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:31.605693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea8ff8-4f0c-4fa2-9e55-5105d45f5ea2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:31.605997 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea8ff8-4f0c-4fa2-9e55-5105d45f5ea2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:31.608036 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea8ff8-4f0c-4fa2-9e55-5105d45f5ea2 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:31.617429 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 548/1081] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:45:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:31.623434 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef9bbd-4164-41bd-b526-3b8e339c7a94 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:31.712383 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:31.730844 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef9bbd-4164-41bd-b526-3b8e339c7a94 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:31.766138 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374ff8f-5f6a-4ea2-9d1b-a637970aa815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:31.766763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374ff8f-5f6a-4ea2-9d1b-a637970aa815 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:31.767040 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374ff8f-5f6a-4ea2-9d1b-a637970aa815 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:31.767310 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374ff8f-5f6a-4ea2-9d1b-a637970aa815 None admin] PATH_INFO: `/v3/users/e1fd08443877475ab6a76d4378991c41` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:31.768426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9374ff8f-5f6a-4ea2-9d1b-a637970aa815 None admin] RBAC: Authorizing `identity:get_user(user_id=e1fd08443877475ab6a76d4378991c41)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:31.769895 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9374ff8f-5f6a-4ea2-9d1b-a637970aa815 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:31.771510 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 534/1082] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:45:31 2022] GET /identity/v3/users/e1fd08443877475ab6a76d4378991c41 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:31.778150 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea8ff8-4f0c-4fa2-9e55-5105d45f5ea2 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:31.781962 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:31.887245 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea8ff8-4f0c-4fa2-9e55-5105d45f5ea2 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:31.923343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561226eb-0054-4f49-958b-52a3bb34c5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:31.923980 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561226eb-0054-4f49-958b-52a3bb34c5f0 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:31.924256 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561226eb-0054-4f49-958b-52a3bb34c5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:31.924525 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561226eb-0054-4f49-958b-52a3bb34c5f0 None admin] PATH_INFO: `/v3/projects/2e25f2f57bcb439faf86162acd21ff1a` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:31.925677 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561226eb-0054-4f49-958b-52a3bb34c5f0 None admin] RBAC: Authorizing `identity:get_project(project_id=2e25f2f57bcb439faf86162acd21ff1a)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:31.927102 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561226eb-0054-4f49-958b-52a3bb34c5f0 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:31.933544 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 549/1083] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:45:31 2022] GET /identity/v3/projects/2e25f2f57bcb439faf86162acd21ff1a => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:31.935034 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374ff8f-5f6a-4ea2-9d1b-a637970aa815 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:32.054144 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374ff8f-5f6a-4ea2-9d1b-a637970aa815 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:32.090048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b346d3-1824-46cd-824e-42673e44103f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:32.090708 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b346d3-1824-46cd-824e-42673e44103f None admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:32.090983 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b346d3-1824-46cd-824e-42673e44103f None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:32.091250 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b346d3-1824-46cd-824e-42673e44103f None admin] PATH_INFO: `/v3/projects/2e25f2f57bcb439faf86162acd21ff1a/users/e1fd08443877475ab6a76d4378991c41/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:32.094518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b346d3-1824-46cd-824e-42673e44103f None admin] RBAC: Authorizing `identity:create_grant(project_id=2e25f2f57bcb439faf86162acd21ff1a, user_id=e1fd08443877475ab6a76d4378991c41, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:32.096152 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b346d3-1824-46cd-824e-42673e44103f None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:32.167893 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 535/1084] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 24 15:45:31 2022] PUT /identity/v3/projects/2e25f2f57bcb439faf86162acd21ff1a/users/e1fd08443877475ab6a76d4378991c41/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:32.506754 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5608bb7-91fb-42ce-83f9-934c49790fae None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:32.507310 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5608bb7-91fb-42ce-83f9-934c49790fae None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:32.507310 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5608bb7-91fb-42ce-83f9-934c49790fae None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:32.508722 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 550/1085] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:32.514096 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bd4ab-4f34-444c-959a-17e7e503eac4 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:32.514497 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bd4ab-4f34-444c-959a-17e7e503eac4 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:32.514754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bd4ab-4f34-444c-959a-17e7e503eac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:32.533225 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-9f4bd4ab-4f34-444c-959a-17e7e503eac4 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:32.534397 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-9f4bd4ab-4f34-444c-959a-17e7e503eac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:32.537143 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:32.604650 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 536/1086] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:45:32.872379 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5608bb7-91fb-42ce-83f9-934c49790fae None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:32.945293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:32.976849 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5608bb7-91fb-42ce-83f9-934c49790fae None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:33.010850 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80540ae3-f9fc-4667-b129-3822b0507654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:33.011496 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80540ae3-f9fc-4667-b129-3822b0507654 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:33.011758 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80540ae3-f9fc-4667-b129-3822b0507654 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:33.012029 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80540ae3-f9fc-4667-b129-3822b0507654 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:33.023571 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80540ae3-f9fc-4667-b129-3822b0507654 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:45:33.028491 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-80540ae3-f9fc-4667-b129-3822b0507654 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 15:45:33.028491 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:33.028491 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:33.028491 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:33.028491 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:33.028491 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:33.028491 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:33.028491 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:33.028491 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:33.028491 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:33.028491 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:33.028491 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:33.028491 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:45:33.028491 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:45:33.028491 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:45:33.028491 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:45:33.030118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:45:33.030118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:45:33.030118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:45:33.030118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:45:33.030118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:33.030118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:33.030118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:33.030118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:33.030118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:33.030118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:33.030118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:33.030118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:33.030118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:33.030118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:33.030118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:33.030118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:33.031268 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:33.031268 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:33.031268 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:33.031268 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:33.031268 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:45:33.031268 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:45:33.031268 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:45:33.031268 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:45:33.031268 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:45:33.031268 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:45:33.031268 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 15:45:33.031268 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:33.031268 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 551/1087] 10.222.0.64 () {56 vars in 1120 bytes} [Wed Aug 24 15:45:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:33.035698 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bd4ab-4f34-444c-959a-17e7e503eac4 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:33.134545 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bd4ab-4f34-444c-959a-17e7e503eac4 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:33.169244 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf3c36-23fc-41bd-a1b6-c37595d718cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:33.169879 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf3c36-23fc-41bd-a1b6-c37595d718cc None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:33.170158 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf3c36-23fc-41bd-a1b6-c37595d718cc None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:33.170425 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf3c36-23fc-41bd-a1b6-c37595d718cc None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:33.171091 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf3c36-23fc-41bd-a1b6-c37595d718cc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:33.171406 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf3c36-23fc-41bd-a1b6-c37595d718cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:33.172785 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf3c36-23fc-41bd-a1b6-c37595d718cc None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:33.181129 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 537/1088] 10.222.0.64 () {56 vars in 1115 bytes} [Wed Aug 24 15:45:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:33.187324 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80540ae3-f9fc-4667-b129-3822b0507654 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:33.291154 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80540ae3-f9fc-4667-b129-3822b0507654 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:33.320493 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:33.326253 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb038f-2bb6-473a-8d6d-e05b1d10af59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:33.326875 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb038f-2bb6-473a-8d6d-e05b1d10af59 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:33.327152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb038f-2bb6-473a-8d6d-e05b1d10af59 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:33.327421 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb038f-2bb6-473a-8d6d-e05b1d10af59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:33.338417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb038f-2bb6-473a-8d6d-e05b1d10af59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:33.339967 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb038f-2bb6-473a-8d6d-e05b1d10af59 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:33.353598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-e9fb038f-2bb6-473a-8d6d-e05b1d10af59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:45:33.353598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:33.353598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:33.353598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:33.353598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:33.353598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:33.353598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:33.353598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:33.353598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:33.353598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:33.353598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:33.353598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:33.353598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:45:33.353598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:45:33.353598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:45:33.353598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:45:33.360127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:33.360127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:33.360127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:33.360127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:33.360127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:33.360127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:33.360127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:33.360127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:33.360127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:33.360127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:33.360127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:33.360127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:33.360127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:33.360127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:33.360127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:33.360127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:33.360127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:45:33.361115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:45:33.361115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:45:33.361115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:33.361115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 552/1089] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:33.361370 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf3c36-23fc-41bd-a1b6-c37595d718cc None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:33.364056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:33.468358 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf3c36-23fc-41bd-a1b6-c37595d718cc None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:33.502347 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b37f55-d0d2-456d-84c2-9890b8d34e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:33.502946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b37f55-d0d2-456d-84c2-9890b8d34e51 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:33.503223 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b37f55-d0d2-456d-84c2-9890b8d34e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:33.503493 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b37f55-d0d2-456d-84c2-9890b8d34e51 None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:33.504127 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b37f55-d0d2-456d-84c2-9890b8d34e51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:33.504427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b37f55-d0d2-456d-84c2-9890b8d34e51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:33.505822 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b37f55-d0d2-456d-84c2-9890b8d34e51 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:33.519115 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 538/1090] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:33.524908 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb038f-2bb6-473a-8d6d-e05b1d10af59 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:33.624834 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb038f-2bb6-473a-8d6d-e05b1d10af59 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:33.658262 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f03230-1aec-4446-961c-f071c6ff7feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:33.658887 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f03230-1aec-4446-961c-f071c6ff7feb None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:33.659169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f03230-1aec-4446-961c-f071c6ff7feb None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:33.659442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f03230-1aec-4446-961c-f071c6ff7feb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:33.666787 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f03230-1aec-4446-961c-f071c6ff7feb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:33.668223 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f03230-1aec-4446-961c-f071c6ff7feb None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:33.679712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-e3f03230-1aec-4446-961c-f071c6ff7feb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:45:33.679712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:33.679712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:33.679712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:33.679712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:33.679712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:33.679712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:33.679712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:33.679712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:33.679712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:33.679712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:33.679712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:33.679712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:45:33.679712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:45:33.679712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:45:33.679712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:45:33.686345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:33.686345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:33.686345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:45:33.686345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:45:33.686345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:45:33.686345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:45:33.686345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:33.686345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:33.686345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:33.686345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:33.686345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:33.686345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:33.686345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:33.686345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:33.686345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:33.686345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:33.686345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:33.686345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:33.687303 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:33.687303 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:33.687303 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:45:33.687303 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:45:33.687303 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:45:33.687303 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:45:33.687303 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:45:33.687303 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:45:33.687303 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:45:33.687303 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:33.687303 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 553/1091] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 24 15:45:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:33.687883 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b37f55-d0d2-456d-84c2-9890b8d34e51 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:33.748716 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:33.786992 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b37f55-d0d2-456d-84c2-9890b8d34e51 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:33.819895 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8d454-e1fc-4f82-9c32-3c483d12af99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:33.820492 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8d454-e1fc-4f82-9c32-3c483d12af99 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:33.820805 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8d454-e1fc-4f82-9c32-3c483d12af99 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:33.821079 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8d454-e1fc-4f82-9c32-3c483d12af99 None admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:33.821826 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8d454-e1fc-4f82-9c32-3c483d12af99 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:33.822101 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8d454-e1fc-4f82-9c32-3c483d12af99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:33.823520 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8d454-e1fc-4f82-9c32-3c483d12af99 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:33.841068 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 539/1092] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 24 15:45:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:33.847544 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f03230-1aec-4446-961c-f071c6ff7feb None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:33.890549 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:33.947707 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f03230-1aec-4446-961c-f071c6ff7feb None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:33.981081 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082dbd59-45b1-47b5-8a20-ddf35095483e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:33.981675 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dbd59-45b1-47b5-8a20-ddf35095483e None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:33.982635 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dbd59-45b1-47b5-8a20-ddf35095483e None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:33.982960 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dbd59-45b1-47b5-8a20-ddf35095483e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:34.050794 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082dbd59-45b1-47b5-8a20-ddf35095483e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:34.052159 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082dbd59-45b1-47b5-8a20-ddf35095483e None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:34.079643 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b0e92-c356-4f64-a3ef-c7b9aefd1eed None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:34.079930 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b0e92-c356-4f64-a3ef-c7b9aefd1eed None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:34.080204 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b0e92-c356-4f64-a3ef-c7b9aefd1eed None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:34.081579 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 540/1093] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:45:34.086493 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8323727-3ca2-44d9-82a9-b53ba0be8cdf None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:34.086778 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8323727-3ca2-44d9-82a9-b53ba0be8cdf None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:34.087053 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8323727-3ca2-44d9-82a9-b53ba0be8cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:34.093997 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:34.105401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-e8323727-3ca2-44d9-82a9-b53ba0be8cdf None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:34.108034 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e8323727-3ca2-44d9-82a9-b53ba0be8cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:34.156242 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 554/1094] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:45:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 15:45:34.157317 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082dbd59-45b1-47b5-8a20-ddf35095483e None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:34.174853 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 541/1095] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:45:34.253819 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082dbd59-45b1-47b5-8a20-ddf35095483e None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:34.287745 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86276a2-56ce-4741-921e-34c7fb56dab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:34.288376 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86276a2-56ce-4741-921e-34c7fb56dab1 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:34.288677 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86276a2-56ce-4741-921e-34c7fb56dab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:34.288950 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86276a2-56ce-4741-921e-34c7fb56dab1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:34.301539 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86276a2-56ce-4741-921e-34c7fb56dab1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:34.302741 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86276a2-56ce-4741-921e-34c7fb56dab1 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:34.304461 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:34.317614 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-d86276a2-56ce-4741-921e-34c7fb56dab1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:45:34.317614 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:34.317614 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:34.317614 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:34.317614 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:34.317614 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:34.317614 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:34.317614 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:34.317614 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:34.317614 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:34.317614 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:34.317614 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:34.317614 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:45:34.317614 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:45:34.317614 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:45:34.317614 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:45:34.320422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:34.320422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:34.320422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:34.320422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:34.320422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:34.320422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:34.320422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:34.320422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:34.320422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:34.320422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:34.320422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:34.320422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:34.320422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:34.320422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:34.320422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:34.320422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:34.320422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:45:34.321465 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:45:34.321465 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:45:34.321465 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:34.321465 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 555/1096] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:45:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:45:34.324557 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8323727-3ca2-44d9-82a9-b53ba0be8cdf None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:34.373372 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:34.423203 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8323727-3ca2-44d9-82a9-b53ba0be8cdf None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:34.442172 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86276a2-56ce-4741-921e-34c7fb56dab1 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:34.461253 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6262cc-4981-4b55-89e5-ac53443a6ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:34.461862 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6262cc-4981-4b55-89e5-ac53443a6ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:34.462140 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6262cc-4981-4b55-89e5-ac53443a6ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:34.462410 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6262cc-4981-4b55-89e5-ac53443a6ca7 None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:34.463047 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6262cc-4981-4b55-89e5-ac53443a6ca7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:34.463346 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6262cc-4981-4b55-89e5-ac53443a6ca7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:34.464742 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6262cc-4981-4b55-89e5-ac53443a6ca7 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:34.475901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 542/1097] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:34.481384 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6262cc-4981-4b55-89e5-ac53443a6ca7 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:34.551724 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86276a2-56ce-4741-921e-34c7fb56dab1 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:34.581257 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6262cc-4981-4b55-89e5-ac53443a6ca7 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:34.587254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa8cb8-fb0e-4b78-9023-c0c9466249c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:34.587877 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa8cb8-fb0e-4b78-9023-c0c9466249c2 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:34.588154 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa8cb8-fb0e-4b78-9023-c0c9466249c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:34.588425 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa8cb8-fb0e-4b78-9023-c0c9466249c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:34.591690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:34.598986 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa8cb8-fb0e-4b78-9023-c0c9466249c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:45:34.603569 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-26fa8cb8-fb0e-4b78-9023-c0c9466249c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:45:34.603569 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:34.603569 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:34.603569 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:34.603569 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:34.603569 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:34.603569 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:34.603569 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:34.603569 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:34.603569 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:34.603569 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:34.603569 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:34.603569 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:45:34.603569 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:45:34.603569 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:45:34.603569 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:45:34.606294 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:45:34.606294 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:45:34.606294 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:45:34.606294 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:45:34.606294 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:34.606294 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:34.606294 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:34.606294 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:34.606294 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:34.606294 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:34.606294 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:34.606294 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:34.606294 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:34.606294 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:34.606294 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:34.606294 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:34.607919 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:34.607919 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:34.607919 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:34.607919 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:34.607919 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:45:34.607919 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:45:34.607919 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:45:34.607919 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:45:34.607919 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:45:34.607919 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:45:34.607919 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:45:34.607919 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:45:34.607919 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 556/1098] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:45:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:34.610845 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa8cb8-fb0e-4b78-9023-c0c9466249c2 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:34.615134 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46dbb6-a2ec-4762-9c66-c126793ffd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:34.615754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46dbb6-a2ec-4762-9c66-c126793ffd93 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:34.616037 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46dbb6-a2ec-4762-9c66-c126793ffd93 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:34.616309 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46dbb6-a2ec-4762-9c66-c126793ffd93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:34.624869 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa46dbb6-a2ec-4762-9c66-c126793ffd93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:34.627031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa46dbb6-a2ec-4762-9c66-c126793ffd93 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:34.639726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-aa46dbb6-a2ec-4762-9c66-c126793ffd93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:45:34.639726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:34.639726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:34.639726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:34.639726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:34.639726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:34.639726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:34.639726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:34.639726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:34.639726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:34.639726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:34.639726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:34.639726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:45:34.639726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:45:34.639726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:45:34.641189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:45:34.641189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:34.641189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:34.641189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:34.641189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:34.641189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:34.641189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:34.641189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:34.641189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:34.641189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:34.641189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:34.641189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:34.641189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:34.641189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:34.641189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:34.641189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:34.641189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:34.642289 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:45:34.642289 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:45:34.642289 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:45:34.642289 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:45:34.642289 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:45:34.642289 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:45:34.642289 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:45:34.642289 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:34.642289 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 543/1099] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:45:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:45:34.646380 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46dbb6-a2ec-4762-9c66-c126793ffd93 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:34.676033 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:34.725243 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa8cb8-fb0e-4b78-9023-c0c9466249c2 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:34.758154 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46dbb6-a2ec-4762-9c66-c126793ffd93 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:34.766396 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5006ca-a841-4486-b718-c6a58acc5e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:34.767002 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5006ca-a841-4486-b718-c6a58acc5e9e None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:34.767277 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5006ca-a841-4486-b718-c6a58acc5e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:34.767542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5006ca-a841-4486-b718-c6a58acc5e9e None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:34.768207 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5006ca-a841-4486-b718-c6a58acc5e9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:34.768504 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5006ca-a841-4486-b718-c6a58acc5e9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:34.769901 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5006ca-a841-4486-b718-c6a58acc5e9e None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:34.778757 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 557/1100] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:45:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:34.784716 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5006ca-a841-4486-b718-c6a58acc5e9e None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:34.793348 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ddea4f-c3fc-4309-ab64-bf6552394062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:34.793957 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddea4f-c3fc-4309-ab64-bf6552394062 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:34.794237 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddea4f-c3fc-4309-ab64-bf6552394062 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:34.795088 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddea4f-c3fc-4309-ab64-bf6552394062 None admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:34.795781 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ddea4f-c3fc-4309-ab64-bf6552394062 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:34.796086 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ddea4f-c3fc-4309-ab64-bf6552394062 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:34.797556 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ddea4f-c3fc-4309-ab64-bf6552394062 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:34.809488 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 544/1101] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:45:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:34.816080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ddea4f-c3fc-4309-ab64-bf6552394062 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:34.846400 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:34.897835 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5006ca-a841-4486-b718-c6a58acc5e9e None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:34.915692 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:34.923362 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ddea4f-c3fc-4309-ab64-bf6552394062 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:34.934028 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4b78f-4f3f-4497-87fc-83ca6ae76bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:34.934707 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4b78f-4f3f-4497-87fc-83ca6ae76bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:34.935559 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4b78f-4f3f-4497-87fc-83ca6ae76bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:34.935837 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4b78f-4f3f-4497-87fc-83ca6ae76bf3 None admin] PATH_INFO: `/v3/users/e1fd08443877475ab6a76d4378991c41` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:34.937077 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b4b78f-4f3f-4497-87fc-83ca6ae76bf3 None admin] RBAC: Authorizing `identity:get_user(user_id=e1fd08443877475ab6a76d4378991c41)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:34.938510 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b4b78f-4f3f-4497-87fc-83ca6ae76bf3 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:34.940258 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 558/1102] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:45:34 2022] GET /identity/v3/users/e1fd08443877475ab6a76d4378991c41 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:34.946107 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4b78f-4f3f-4497-87fc-83ca6ae76bf3 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:34.960823 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f1dca-0bac-4dd2-952e-30fdf63ea14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:34.961431 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f1dca-0bac-4dd2-952e-30fdf63ea14a None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:34.961704 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f1dca-0bac-4dd2-952e-30fdf63ea14a None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:34.961972 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f1dca-0bac-4dd2-952e-30fdf63ea14a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:34.962687 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f1dca-0bac-4dd2-952e-30fdf63ea14a None admin] RBAC: Adding query filter params (role.id=645ada3cca2e4ac49e7055528e4748d6, scope.project.id=9b25a7c01ab540ceae16dd618b848f2d, user.id=e5f0d8fe42e74d68bfa9a0e365bab4b6) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:34.962991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f1dca-0bac-4dd2-952e-30fdf63ea14a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:34.964397 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f1dca-0bac-4dd2-952e-30fdf63ea14a None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:34.970317 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 545/1103] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:45:34 2022] GET /identity/v3/role_assignments?user.id=e5f0d8fe42e74d68bfa9a0e365bab4b6&scope.project.id=9b25a7c01ab540ceae16dd618b848f2d&role.id=645ada3cca2e4ac49e7055528e4748d6 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:35.056079 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4b78f-4f3f-4497-87fc-83ca6ae76bf3 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:35.092668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70685b77-454e-44ca-b983-03c51511b1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:35.093207 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70685b77-454e-44ca-b983-03c51511b1b0 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:35.093489 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70685b77-454e-44ca-b983-03c51511b1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:35.093762 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70685b77-454e-44ca-b983-03c51511b1b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:35.150557 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:35.166809 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70685b77-454e-44ca-b983-03c51511b1b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:35.168273 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70685b77-454e-44ca-b983-03c51511b1b0 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:35.272024 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 559/1104] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:45:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 15:45:35.279186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f1dca-0bac-4dd2-952e-30fdf63ea14a None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:35.392365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:35.399048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f1dca-0bac-4dd2-952e-30fdf63ea14a None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:35.435086 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c10a5e-179f-4e3b-a472-b4543fd0fed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:35.435916 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c10a5e-179f-4e3b-a472-b4543fd0fed5 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:35.436204 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c10a5e-179f-4e3b-a472-b4543fd0fed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:35.436486 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c10a5e-179f-4e3b-a472-b4543fd0fed5 None admin] PATH_INFO: `/v3/projects/2e25f2f57bcb439faf86162acd21ff1a` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:35.437709 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c10a5e-179f-4e3b-a472-b4543fd0fed5 None admin] RBAC: Authorizing `identity:get_project(project_id=2e25f2f57bcb439faf86162acd21ff1a)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:35.439138 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c10a5e-179f-4e3b-a472-b4543fd0fed5 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:35.440800 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 546/1105] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:45:35 2022] GET /identity/v3/projects/2e25f2f57bcb439faf86162acd21ff1a => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:35.447171 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70685b77-454e-44ca-b983-03c51511b1b0 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:35.539607 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:35.556441 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70685b77-454e-44ca-b983-03c51511b1b0 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:35.594078 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339a1a6-093d-461f-88f0-4e120a2418f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:35.594726 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339a1a6-093d-461f-88f0-4e120a2418f5 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:35.595002 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339a1a6-093d-461f-88f0-4e120a2418f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:35.595273 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339a1a6-093d-461f-88f0-4e120a2418f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:35.596003 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339a1a6-093d-461f-88f0-4e120a2418f5 None admin] RBAC: Adding query filter params (role.id=c6745e08f9da4a2bae8510c9983635c3, scope.project.id=2e25f2f57bcb439faf86162acd21ff1a, user.id=e1fd08443877475ab6a76d4378991c41) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:35.596306 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339a1a6-093d-461f-88f0-4e120a2418f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:35.597783 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339a1a6-093d-461f-88f0-4e120a2418f5 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:35.603916 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 560/1106] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:45:35 2022] GET /identity/v3/role_assignments?user.id=e1fd08443877475ab6a76d4378991c41&scope.project.id=2e25f2f57bcb439faf86162acd21ff1a&role.id=c6745e08f9da4a2bae8510c9983635c3 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:37.567615 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c5484-1f13-421f-a7d6-3e81deccec3e None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:37.568125 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c5484-1f13-421f-a7d6-3e81deccec3e None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:37.568125 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c5484-1f13-421f-a7d6-3e81deccec3e None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:37.569508 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 547/1107] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:37.574947 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0400e1-36b4-4670-b798-a88c5055c9d3 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:37.575429 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0400e1-36b4-4670-b798-a88c5055c9d3 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:37.575608 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0400e1-36b4-4670-b798-a88c5055c9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:37.593948 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-0a0400e1-36b4-4670-b798-a88c5055c9d3 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:37.595139 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-0a0400e1-36b4-4670-b798-a88c5055c9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:37.662897 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 561/1108] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:45:37.937731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c5484-1f13-421f-a7d6-3e81deccec3e None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:38.039066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c5484-1f13-421f-a7d6-3e81deccec3e None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:38.072425 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3275d03-5664-4c79-921b-bc6126d3fa61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:38.073078 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3275d03-5664-4c79-921b-bc6126d3fa61 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:38.073362 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3275d03-5664-4c79-921b-bc6126d3fa61 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:38.073647 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3275d03-5664-4c79-921b-bc6126d3fa61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:38.074737 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3275d03-5664-4c79-921b-bc6126d3fa61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:38.076837 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3275d03-5664-4c79-921b-bc6126d3fa61 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:38.079771 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 548/1109] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:45:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:38.084356 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0400e1-36b4-4670-b798-a88c5055c9d3 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:38.160120 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:38.180522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0400e1-36b4-4670-b798-a88c5055c9d3 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:38.218272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575fe35-7271-4994-9a23-9bfcfbb29704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:38.218887 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575fe35-7271-4994-9a23-9bfcfbb29704 None admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:38.219168 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575fe35-7271-4994-9a23-9bfcfbb29704 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:38.219444 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575fe35-7271-4994-9a23-9bfcfbb29704 None admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:38.220114 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575fe35-7271-4994-9a23-9bfcfbb29704 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:38.221548 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575fe35-7271-4994-9a23-9bfcfbb29704 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:38.316208 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 562/1110] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 24 15:45:38 2022] POST /identity/v3/users => generated 286 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:40.252917 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad00f51-95d1-4315-bab0-203f481d97bf None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:40.253472 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad00f51-95d1-4315-bab0-203f481d97bf None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:40.253472 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad00f51-95d1-4315-bab0-203f481d97bf None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:40.254796 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 549/1111] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:40.260113 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74278c7c-3494-47b6-86eb-797522ec2496 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:40.260519 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74278c7c-3494-47b6-86eb-797522ec2496 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:40.260680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74278c7c-3494-47b6-86eb-797522ec2496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:40.278399 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-74278c7c-3494-47b6-86eb-797522ec2496 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:40.279669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-74278c7c-3494-47b6-86eb-797522ec2496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:40.344789 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 563/1112] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:45:40.616486 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad00f51-95d1-4315-bab0-203f481d97bf None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:40.645584 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:40.720044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad00f51-95d1-4315-bab0-203f481d97bf None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:40.754054 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207fb430-eb1a-4e9f-ba64-6093ffda47e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:40.754739 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fb430-eb1a-4e9f-ba64-6093ffda47e1 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:40.755016 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fb430-eb1a-4e9f-ba64-6093ffda47e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:40.755283 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fb430-eb1a-4e9f-ba64-6093ffda47e1 None admin] PATH_INFO: `/v3/roles/38df38770b21458d87720d3c4c6f1ff1` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:40.756681 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207fb430-eb1a-4e9f-ba64-6093ffda47e1 None admin] RBAC: Authorizing `identity:get_role(role_id=38df38770b21458d87720d3c4c6f1ff1)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:40.758151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207fb430-eb1a-4e9f-ba64-6093ffda47e1 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:40.759481 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 550/1113] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:45:40 2022] GET /identity/v3/roles/38df38770b21458d87720d3c4c6f1ff1 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:40.765435 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74278c7c-3494-47b6-86eb-797522ec2496 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:40.827049 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:40.871450 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74278c7c-3494-47b6-86eb-797522ec2496 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:40.906664 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7dcc07-3d7b-4333-96f9-404a267999b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:40.907489 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dcc07-3d7b-4333-96f9-404a267999b6 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:40.908184 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dcc07-3d7b-4333-96f9-404a267999b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:40.908454 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dcc07-3d7b-4333-96f9-404a267999b6 None admin] PATH_INFO: `/v3/users/7ac6445a99924edabf5c5b550e217fb0` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:40.921257 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7dcc07-3d7b-4333-96f9-404a267999b6 None admin] RBAC: Authorizing `identity:get_user(user_id=7ac6445a99924edabf5c5b550e217fb0)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:40.922735 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7dcc07-3d7b-4333-96f9-404a267999b6 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:40.924353 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 564/1114] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:45:40 2022] GET /identity/v3/users/7ac6445a99924edabf5c5b550e217fb0 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:40.930228 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207fb430-eb1a-4e9f-ba64-6093ffda47e1 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:41.024375 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:41.029030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207fb430-eb1a-4e9f-ba64-6093ffda47e1 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:41.061766 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a168a-61d4-44fa-8c47-d1da7e5a582e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:41.062360 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a168a-61d4-44fa-8c47-d1da7e5a582e None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:41.062638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a168a-61d4-44fa-8c47-d1da7e5a582e None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:41.062912 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a168a-61d4-44fa-8c47-d1da7e5a582e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:41.130332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a168a-61d4-44fa-8c47-d1da7e5a582e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:41.131695 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a168a-61d4-44fa-8c47-d1da7e5a582e None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:41.229842 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:41.234372 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 551/1115] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:45:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:45:41.240371 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7dcc07-3d7b-4333-96f9-404a267999b6 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:41.345667 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7dcc07-3d7b-4333-96f9-404a267999b6 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:41.367864 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:41.381481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf4dce-0ec8-4ca0-ac1f-7b1a07c9954c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:41.382038 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf4dce-0ec8-4ca0-ac1f-7b1a07c9954c None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:41.382371 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf4dce-0ec8-4ca0-ac1f-7b1a07c9954c None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:41.382831 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf4dce-0ec8-4ca0-ac1f-7b1a07c9954c None admin] PATH_INFO: `/v3/projects/2e25f2f57bcb439faf86162acd21ff1a` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:41.384299 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf4dce-0ec8-4ca0-ac1f-7b1a07c9954c None admin] RBAC: Authorizing `identity:get_project(project_id=2e25f2f57bcb439faf86162acd21ff1a)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:41.385802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf4dce-0ec8-4ca0-ac1f-7b1a07c9954c None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:41.387599 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 565/1116] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:45:41 2022] GET /identity/v3/projects/2e25f2f57bcb439faf86162acd21ff1a => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:41.395556 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a168a-61d4-44fa-8c47-d1da7e5a582e None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:41.505906 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a168a-61d4-44fa-8c47-d1da7e5a582e None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:41.543627 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f435ae-6d0f-4442-963a-5f8f6b82f7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:41.544780 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f435ae-6d0f-4442-963a-5f8f6b82f7d2 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:41.545066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f435ae-6d0f-4442-963a-5f8f6b82f7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:41.545557 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f435ae-6d0f-4442-963a-5f8f6b82f7d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:41.546724 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f435ae-6d0f-4442-963a-5f8f6b82f7d2 None admin] RBAC: Adding query filter params (role.id=38df38770b21458d87720d3c4c6f1ff1, scope.project.id=2e25f2f57bcb439faf86162acd21ff1a, user.id=7ac6445a99924edabf5c5b550e217fb0) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:41.547040 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f435ae-6d0f-4442-963a-5f8f6b82f7d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:41.548475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f435ae-6d0f-4442-963a-5f8f6b82f7d2 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:41.554663 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 552/1117] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:45:41 2022] GET /identity/v3/role_assignments?user.id=7ac6445a99924edabf5c5b550e217fb0&scope.project.id=2e25f2f57bcb439faf86162acd21ff1a&role.id=38df38770b21458d87720d3c4c6f1ff1 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:43.584864 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a09369-aaca-4526-ad3b-db348b99802e None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:43.585364 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a09369-aaca-4526-ad3b-db348b99802e None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:43.585364 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a09369-aaca-4526-ad3b-db348b99802e None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:43.586648 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 566/1118] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:43.591782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339f913-c337-4caa-afef-70c6b6121109 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:43.592182 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339f913-c337-4caa-afef-70c6b6121109 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:43.592328 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339f913-c337-4caa-afef-70c6b6121109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:43.609724 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-5339f913-c337-4caa-afef-70c6b6121109 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:43.610900 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-5339f913-c337-4caa-afef-70c6b6121109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:43.665384 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:43.675579 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 553/1119] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:45:43.944914 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a09369-aaca-4526-ad3b-db348b99802e None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:44.044736 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a09369-aaca-4526-ad3b-db348b99802e None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:44.078252 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17760e3-4426-4b34-aea7-8aaf24e5b372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:44.078856 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17760e3-4426-4b34-aea7-8aaf24e5b372 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:44.079130 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17760e3-4426-4b34-aea7-8aaf24e5b372 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:44.079398 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17760e3-4426-4b34-aea7-8aaf24e5b372 None admin] PATH_INFO: `/v3/roles/38df38770b21458d87720d3c4c6f1ff1` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:44.080780 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17760e3-4426-4b34-aea7-8aaf24e5b372 None admin] RBAC: Authorizing `identity:get_role(role_id=38df38770b21458d87720d3c4c6f1ff1)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:44.082306 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17760e3-4426-4b34-aea7-8aaf24e5b372 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:44.083604 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 567/1120] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:45:43 2022] GET /identity/v3/roles/38df38770b21458d87720d3c4c6f1ff1 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:44.089338 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339f913-c337-4caa-afef-70c6b6121109 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:44.186274 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339f913-c337-4caa-afef-70c6b6121109 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:44.218818 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed2be0-7463-49d2-9719-c945bb5621a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:44.219433 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed2be0-7463-49d2-9719-c945bb5621a4 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:44.219709 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed2be0-7463-49d2-9719-c945bb5621a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:44.219986 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed2be0-7463-49d2-9719-c945bb5621a4 None admin] PATH_INFO: `/v3/users/7ac6445a99924edabf5c5b550e217fb0` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:44.221108 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed2be0-7463-49d2-9719-c945bb5621a4 None admin] RBAC: Authorizing `identity:get_user(user_id=7ac6445a99924edabf5c5b550e217fb0)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:44.222600 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed2be0-7463-49d2-9719-c945bb5621a4 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:44.224151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 554/1121] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:45:44 2022] GET /identity/v3/users/7ac6445a99924edabf5c5b550e217fb0 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:44.229842 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17760e3-4426-4b34-aea7-8aaf24e5b372 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:44.287071 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:44.328804 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17760e3-4426-4b34-aea7-8aaf24e5b372 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:44.362415 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12ff74-9c1f-43e8-8785-231aa87f95fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:44.363039 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12ff74-9c1f-43e8-8785-231aa87f95fd None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:44.363317 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12ff74-9c1f-43e8-8785-231aa87f95fd None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:44.363596 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12ff74-9c1f-43e8-8785-231aa87f95fd None admin] PATH_INFO: `/v3/projects/2e25f2f57bcb439faf86162acd21ff1a` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:44.364748 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d12ff74-9c1f-43e8-8785-231aa87f95fd None admin] RBAC: Authorizing `identity:get_project(project_id=2e25f2f57bcb439faf86162acd21ff1a)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:44.366203 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d12ff74-9c1f-43e8-8785-231aa87f95fd None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:44.367825 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 568/1122] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:45:44 2022] GET /identity/v3/projects/2e25f2f57bcb439faf86162acd21ff1a => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:44.373989 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed2be0-7463-49d2-9719-c945bb5621a4 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:44.431266 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:44.470401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed2be0-7463-49d2-9719-c945bb5621a4 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:44.502579 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c282f62-fac4-4edf-8d0e-0ec3d5a7e055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:44.503213 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c282f62-fac4-4edf-8d0e-0ec3d5a7e055 None admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:44.503487 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c282f62-fac4-4edf-8d0e-0ec3d5a7e055 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:44.503756 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c282f62-fac4-4edf-8d0e-0ec3d5a7e055 None admin] PATH_INFO: `/v3/projects/2e25f2f57bcb439faf86162acd21ff1a/users/7ac6445a99924edabf5c5b550e217fb0/roles/38df38770b21458d87720d3c4c6f1ff1` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:44.506127 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c282f62-fac4-4edf-8d0e-0ec3d5a7e055 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e25f2f57bcb439faf86162acd21ff1a, user_id=7ac6445a99924edabf5c5b550e217fb0, role_id=38df38770b21458d87720d3c4c6f1ff1)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:44.507587 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c282f62-fac4-4edf-8d0e-0ec3d5a7e055 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:44.586162 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 555/1123] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 24 15:45:44 2022] PUT /identity/v3/projects/2e25f2f57bcb439faf86162acd21ff1a/users/7ac6445a99924edabf5c5b550e217fb0/roles/38df38770b21458d87720d3c4c6f1ff1 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:46.464431 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f087e-deef-4993-bf37-765d96566f6a None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:46.465020 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f087e-deef-4993-bf37-765d96566f6a None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:46.465020 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f087e-deef-4993-bf37-765d96566f6a None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:46.466861 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 569/1124] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:46.472032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4621af-f1d4-4ac5-8983-1f93140fc0eb None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:46.472427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4621af-f1d4-4ac5-8983-1f93140fc0eb None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:46.472581 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4621af-f1d4-4ac5-8983-1f93140fc0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:46.490936 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-6d4621af-f1d4-4ac5-8983-1f93140fc0eb None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:46.492091 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-6d4621af-f1d4-4ac5-8983-1f93140fc0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:46.557002 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 556/1125] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:45:46.826625 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f087e-deef-4993-bf37-765d96566f6a None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:46.926248 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f087e-deef-4993-bf37-765d96566f6a None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:46.951223 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:46.959536 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a08aa-ab5f-4f6e-bd8f-70d275923871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:46.960155 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a08aa-ab5f-4f6e-bd8f-70d275923871 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:46.960432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a08aa-ab5f-4f6e-bd8f-70d275923871 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:46.960729 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a08aa-ab5f-4f6e-bd8f-70d275923871 None admin] PATH_INFO: `/v3/roles/38df38770b21458d87720d3c4c6f1ff1` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:46.962102 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a08aa-ab5f-4f6e-bd8f-70d275923871 None admin] RBAC: Authorizing `identity:get_role(role_id=38df38770b21458d87720d3c4c6f1ff1)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:46.963463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a08aa-ab5f-4f6e-bd8f-70d275923871 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:46.964811 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 570/1126] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:45:46 2022] GET /identity/v3/roles/38df38770b21458d87720d3c4c6f1ff1 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:46.971236 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4621af-f1d4-4ac5-8983-1f93140fc0eb None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:47.019800 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:47.067862 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4621af-f1d4-4ac5-8983-1f93140fc0eb None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:47.101144 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9da05-5850-41e4-bd3a-5a0c8dc1513c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:47.101692 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9da05-5850-41e4-bd3a-5a0c8dc1513c None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:47.101965 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9da05-5850-41e4-bd3a-5a0c8dc1513c None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:47.102237 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9da05-5850-41e4-bd3a-5a0c8dc1513c None admin] PATH_INFO: `/v3/users/7ac6445a99924edabf5c5b550e217fb0` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:47.103324 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9da05-5850-41e4-bd3a-5a0c8dc1513c None admin] RBAC: Authorizing `identity:get_user(user_id=7ac6445a99924edabf5c5b550e217fb0)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:47.104762 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9da05-5850-41e4-bd3a-5a0c8dc1513c None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:47.106745 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 557/1127] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:45:46 2022] GET /identity/v3/users/7ac6445a99924edabf5c5b550e217fb0 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:47.112517 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a08aa-ab5f-4f6e-bd8f-70d275923871 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:47.209105 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a08aa-ab5f-4f6e-bd8f-70d275923871 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:47.241617 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8db78-4b95-4e3b-93ed-2e15230ce08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:47.242201 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8db78-4b95-4e3b-93ed-2e15230ce08c None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:47.242476 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8db78-4b95-4e3b-93ed-2e15230ce08c None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:47.242741 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8db78-4b95-4e3b-93ed-2e15230ce08c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:47.303453 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:47.312241 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8db78-4b95-4e3b-93ed-2e15230ce08c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:47.313734 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8db78-4b95-4e3b-93ed-2e15230ce08c None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:47.410998 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 571/1128] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:45:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:45:47.416872 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9da05-5850-41e4-bd3a-5a0c8dc1513c None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:47.513840 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9da05-5850-41e4-bd3a-5a0c8dc1513c None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:47.530179 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:47.546710 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d702412-3427-4b90-991c-0ac99b6e456e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:47.547326 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d702412-3427-4b90-991c-0ac99b6e456e None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:47.547604 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d702412-3427-4b90-991c-0ac99b6e456e None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:47.547876 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d702412-3427-4b90-991c-0ac99b6e456e None admin] PATH_INFO: `/v3/projects/2e25f2f57bcb439faf86162acd21ff1a` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:47.549000 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d702412-3427-4b90-991c-0ac99b6e456e None admin] RBAC: Authorizing `identity:get_project(project_id=2e25f2f57bcb439faf86162acd21ff1a)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:47.550417 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d702412-3427-4b90-991c-0ac99b6e456e None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:47.552017 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 558/1129] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:45:47 2022] GET /identity/v3/projects/2e25f2f57bcb439faf86162acd21ff1a => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:47.558234 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8db78-4b95-4e3b-93ed-2e15230ce08c None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:47.650949 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:47.657716 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8db78-4b95-4e3b-93ed-2e15230ce08c None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:47.691484 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeaa018-7f98-4ce6-b67f-bca4e735d8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:47.692009 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeaa018-7f98-4ce6-b67f-bca4e735d8a5 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:47.692284 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeaa018-7f98-4ce6-b67f-bca4e735d8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:47.692552 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeaa018-7f98-4ce6-b67f-bca4e735d8a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:47.693297 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeaa018-7f98-4ce6-b67f-bca4e735d8a5 None admin] RBAC: Adding query filter params (role.id=38df38770b21458d87720d3c4c6f1ff1, scope.project.id=2e25f2f57bcb439faf86162acd21ff1a, user.id=7ac6445a99924edabf5c5b550e217fb0) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:47.693597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeaa018-7f98-4ce6-b67f-bca4e735d8a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:47.695044 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeaa018-7f98-4ce6-b67f-bca4e735d8a5 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:47.701030 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 572/1130] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:45:47 2022] GET /identity/v3/role_assignments?user.id=7ac6445a99924edabf5c5b550e217fb0&scope.project.id=2e25f2f57bcb439faf86162acd21ff1a&role.id=38df38770b21458d87720d3c4c6f1ff1 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:49.644363 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c39637-da51-4470-865c-57da0a23c96d None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:49.644924 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c39637-da51-4470-865c-57da0a23c96d None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:49.644924 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c39637-da51-4470-865c-57da0a23c96d None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:49.646185 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 559/1131] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:49.651570 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f324438-7358-445d-96f9-a9bc0fde4744 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:49.652008 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f324438-7358-445d-96f9-a9bc0fde4744 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:49.652125 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f324438-7358-445d-96f9-a9bc0fde4744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:49.670821 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-5f324438-7358-445d-96f9-a9bc0fde4744 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:49.671994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-5f324438-7358-445d-96f9-a9bc0fde4744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:49.737302 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 573/1132] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:45:50.005710 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c39637-da51-4470-865c-57da0a23c96d None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:50.106943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c39637-da51-4470-865c-57da0a23c96d None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:50.140227 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1e883-f310-446a-8bfa-a1ae8d833bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:50.140867 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1e883-f310-446a-8bfa-a1ae8d833bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:50.141146 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1e883-f310-446a-8bfa-a1ae8d833bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:50.141418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1e883-f310-446a-8bfa-a1ae8d833bb4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:50.142508 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1e883-f310-446a-8bfa-a1ae8d833bb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:50.143919 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1e883-f310-446a-8bfa-a1ae8d833bb4 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:50.145477 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 560/1133] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:45:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:50.151517 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f324438-7358-445d-96f9-a9bc0fde4744 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:50.237993 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:50.250285 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f324438-7358-445d-96f9-a9bc0fde4744 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:50.284899 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b024e8-ca34-4075-861f-daf362586131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:50.285426 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b024e8-ca34-4075-861f-daf362586131 None admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:50.285705 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b024e8-ca34-4075-861f-daf362586131 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:50.285977 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b024e8-ca34-4075-861f-daf362586131 None admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:50.286635 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b024e8-ca34-4075-861f-daf362586131 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:50.288068 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b024e8-ca34-4075-861f-daf362586131 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:50.380255 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 574/1134] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 24 15:45:50 2022] POST /identity/v3/projects => generated 311 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:45:52.353026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536923d-7d26-4665-985f-9c3ad53b488b None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:52.353579 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536923d-7d26-4665-985f-9c3ad53b488b None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:52.353579 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536923d-7d26-4665-985f-9c3ad53b488b None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:52.354799 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 561/1135] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:52.361108 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64394cff-804d-4a98-b5db-846da31eca37 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:52.361540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64394cff-804d-4a98-b5db-846da31eca37 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:52.361660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64394cff-804d-4a98-b5db-846da31eca37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:52.380737 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-64394cff-804d-4a98-b5db-846da31eca37 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:52.381930 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-64394cff-804d-4a98-b5db-846da31eca37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:52.451545 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 575/1136] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:45:52.727700 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536923d-7d26-4665-985f-9c3ad53b488b None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:52.785856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:52.832299 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536923d-7d26-4665-985f-9c3ad53b488b None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:52.866377 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd5b7a-9c01-4b66-8067-c899ef14a924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:52.866985 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd5b7a-9c01-4b66-8067-c899ef14a924 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:52.867260 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd5b7a-9c01-4b66-8067-c899ef14a924 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:52.867525 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd5b7a-9c01-4b66-8067-c899ef14a924 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:52.868642 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd5b7a-9c01-4b66-8067-c899ef14a924 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:52.870059 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd5b7a-9c01-4b66-8067-c899ef14a924 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:52.871620 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 562/1137] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:45:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:52.877538 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64394cff-804d-4a98-b5db-846da31eca37 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:52.949158 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:52.980746 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64394cff-804d-4a98-b5db-846da31eca37 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:53.014695 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b0b08-4c33-4acf-9f8f-dfa9033332a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:53.015301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b0b08-4c33-4acf-9f8f-dfa9033332a3 None admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:53.015584 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b0b08-4c33-4acf-9f8f-dfa9033332a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:53.015858 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b0b08-4c33-4acf-9f8f-dfa9033332a3 None admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:53.016513 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b0b08-4c33-4acf-9f8f-dfa9033332a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:53.017984 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b0b08-4c33-4acf-9f8f-dfa9033332a3 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:53.096282 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 576/1138] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 24 15:45:52 2022] POST /identity/v3/users => generated 286 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:55.037140 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44075925-80e4-477c-970d-bf06166d2dc0 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:55.037676 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44075925-80e4-477c-970d-bf06166d2dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:55.037676 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44075925-80e4-477c-970d-bf06166d2dc0 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:55.039018 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 563/1139] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:55.044789 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7929da-5a3f-4481-87f1-089a12f17d44 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:55.045222 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7929da-5a3f-4481-87f1-089a12f17d44 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:55.045324 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7929da-5a3f-4481-87f1-089a12f17d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:55.063734 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-6c7929da-5a3f-4481-87f1-089a12f17d44 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:55.064934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-6c7929da-5a3f-4481-87f1-089a12f17d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:55.132085 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 577/1140] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:45:55.405899 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44075925-80e4-477c-970d-bf06166d2dc0 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:55.504872 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44075925-80e4-477c-970d-bf06166d2dc0 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:55.527130 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:55.538109 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0258a-6f33-4f70-8120-32939f62376e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:55.538726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0258a-6f33-4f70-8120-32939f62376e None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:55.539003 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0258a-6f33-4f70-8120-32939f62376e None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:55.539273 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0258a-6f33-4f70-8120-32939f62376e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:55.549055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0258a-6f33-4f70-8120-32939f62376e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:45:55.553863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-5ac0258a-6f33-4f70-8120-32939f62376e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:45:55.553863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:55.553863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:55.553863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:55.553863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:55.553863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:55.553863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:55.553863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:55.553863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:55.553863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:55.553863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:55.553863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:55.553863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:45:55.553863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:45:55.553863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:45:55.553863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:45:55.554960 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:45:55.554960 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:45:55.554960 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:45:55.554960 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:45:55.554960 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:55.554960 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:55.554960 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:55.554960 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:55.554960 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:55.554960 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:55.554960 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:55.554960 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:55.554960 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:55.554960 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:55.554960 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:55.554960 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:55.556031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:55.556031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:55.556031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:55.556031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:55.556031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:45:55.556031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:45:55.556031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:45:55.556031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:45:55.556031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:45:55.556031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:45:55.556031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:45:55.556031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:55.556031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 564/1141] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:45:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:55.561551 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7929da-5a3f-4481-87f1-089a12f17d44 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:55.615054 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:55.658093 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7929da-5a3f-4481-87f1-089a12f17d44 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:55.691191 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563f5db-f3a6-46ab-85b8-8e431a08dd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:55.691774 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563f5db-f3a6-46ab-85b8-8e431a08dd59 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:55.692049 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563f5db-f3a6-46ab-85b8-8e431a08dd59 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:55.692315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563f5db-f3a6-46ab-85b8-8e431a08dd59 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:55.692994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563f5db-f3a6-46ab-85b8-8e431a08dd59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:55.693291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563f5db-f3a6-46ab-85b8-8e431a08dd59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:55.694642 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563f5db-f3a6-46ab-85b8-8e431a08dd59 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:55.703306 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 578/1142] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:45:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:55.709106 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0258a-6f33-4f70-8120-32939f62376e None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:55.806085 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0258a-6f33-4f70-8120-32939f62376e None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:55.838857 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c31dcd-50ff-4335-80cc-2fcdb73b3ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:55.839474 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c31dcd-50ff-4335-80cc-2fcdb73b3ddf None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:55.843474 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c31dcd-50ff-4335-80cc-2fcdb73b3ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:55.843474 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c31dcd-50ff-4335-80cc-2fcdb73b3ddf None admin] PATH_INFO: `/v3/users/010376c180e54428be694a7d9ec98800` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:55.861185 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c31dcd-50ff-4335-80cc-2fcdb73b3ddf None admin] RBAC: Authorizing `identity:get_user(user_id=010376c180e54428be694a7d9ec98800)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:55.862600 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c31dcd-50ff-4335-80cc-2fcdb73b3ddf None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:55.864179 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 565/1143] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:45:55 2022] GET /identity/v3/users/010376c180e54428be694a7d9ec98800 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:55.870199 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563f5db-f3a6-46ab-85b8-8e431a08dd59 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:55.968786 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563f5db-f3a6-46ab-85b8-8e431a08dd59 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:55.985519 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:56.002330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf0e71-b0d0-4357-9475-89e8f05d38b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:56.002922 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf0e71-b0d0-4357-9475-89e8f05d38b2 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:56.003202 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf0e71-b0d0-4357-9475-89e8f05d38b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:56.003472 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf0e71-b0d0-4357-9475-89e8f05d38b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:56.068930 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf0e71-b0d0-4357-9475-89e8f05d38b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:56.070310 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf0e71-b0d0-4357-9475-89e8f05d38b2 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:56.165738 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 579/1144] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:45:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:45:56.172378 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c31dcd-50ff-4335-80cc-2fcdb73b3ddf None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:56.212685 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:56.267591 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c31dcd-50ff-4335-80cc-2fcdb73b3ddf None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:56.301148 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18021f-8291-4fc4-be18-a8d003454ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:56.301771 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18021f-8291-4fc4-be18-a8d003454ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:56.302048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18021f-8291-4fc4-be18-a8d003454ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:56.302318 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18021f-8291-4fc4-be18-a8d003454ca1 None admin] PATH_INFO: `/v3/projects/d1973f62ff514b3b80e029776eb912b7` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:56.303409 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f18021f-8291-4fc4-be18-a8d003454ca1 None admin] RBAC: Authorizing `identity:get_project(project_id=d1973f62ff514b3b80e029776eb912b7)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:56.304856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f18021f-8291-4fc4-be18-a8d003454ca1 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:56.306466 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 566/1145] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:45:56 2022] GET /identity/v3/projects/d1973f62ff514b3b80e029776eb912b7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:56.312570 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf0e71-b0d0-4357-9475-89e8f05d38b2 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:56.330952 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:56.410499 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf0e71-b0d0-4357-9475-89e8f05d38b2 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:56.443022 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69873a53-fdd1-47dd-9cdb-24c5275d14fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:56.443606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69873a53-fdd1-47dd-9cdb-24c5275d14fb None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:56.443881 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69873a53-fdd1-47dd-9cdb-24c5275d14fb None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:56.444150 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69873a53-fdd1-47dd-9cdb-24c5275d14fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:56.444898 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69873a53-fdd1-47dd-9cdb-24c5275d14fb None admin] RBAC: Adding query filter params (role.id=c6745e08f9da4a2bae8510c9983635c3, scope.project.id=d1973f62ff514b3b80e029776eb912b7, user.id=010376c180e54428be694a7d9ec98800) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:56.445205 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69873a53-fdd1-47dd-9cdb-24c5275d14fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:56.446620 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69873a53-fdd1-47dd-9cdb-24c5275d14fb None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:56.451907 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 580/1146] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:45:56 2022] GET /identity/v3/role_assignments?user.id=010376c180e54428be694a7d9ec98800&scope.project.id=d1973f62ff514b3b80e029776eb912b7&role.id=c6745e08f9da4a2bae8510c9983635c3 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:58.342917 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41372f92-7222-4e45-b183-bad77576de94 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:58.343405 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41372f92-7222-4e45-b183-bad77576de94 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:58.343496 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41372f92-7222-4e45-b183-bad77576de94 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:58.344825 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 567/1147] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:58.350087 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c824786-8022-48e0-81b3-d7f27b6408fd None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:58.350496 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c824786-8022-48e0-81b3-d7f27b6408fd None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:58.350666 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c824786-8022-48e0-81b3-d7f27b6408fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:58.368916 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-8c824786-8022-48e0-81b3-d7f27b6408fd None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:58.370081 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-8c824786-8022-48e0-81b3-d7f27b6408fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:58.436035 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 581/1148] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:45:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:45:58.706269 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41372f92-7222-4e45-b183-bad77576de94 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:58.806629 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41372f92-7222-4e45-b183-bad77576de94 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:58.815787 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:58.840071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db274c-c9cd-45b1-a0d0-f7d9f5dd57e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:58.841699 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db274c-c9cd-45b1-a0d0-f7d9f5dd57e3 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:58.841976 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db274c-c9cd-45b1-a0d0-f7d9f5dd57e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:58.842242 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db274c-c9cd-45b1-a0d0-f7d9f5dd57e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:58.851806 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db274c-c9cd-45b1-a0d0-f7d9f5dd57e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:45:58.857590 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-00db274c-c9cd-45b1-a0d0-f7d9f5dd57e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:45:58.857590 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:45:58.857590 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:45:58.857590 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:45:58.857590 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:45:58.857590 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:45:58.857590 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:45:58.857590 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:45:58.857590 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:45:58.857590 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:45:58.857590 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:45:58.857590 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:45:58.857590 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:45:58.857590 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:45:58.857590 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:45:58.857590 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:45:58.858704 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:45:58.858704 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:45:58.858704 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:45:58.858704 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:45:58.858704 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:45:58.858704 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:45:58.858704 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:45:58.858704 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:45:58.858704 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:45:58.858704 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:45:58.858704 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:45:58.858704 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:45:58.858704 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:45:58.858704 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:45:58.858704 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:45:58.858704 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:45:58.859763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:45:58.859763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:45:58.859763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:45:58.859763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:45:58.859763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:45:58.859763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:45:58.859763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:45:58.859763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:45:58.859763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:45:58.859763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:45:58.859763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:45:58.859763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:45:58.859763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 568/1149] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:45:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:45:58.864757 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c824786-8022-48e0-81b3-d7f27b6408fd None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:58.878659 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:58.961796 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c824786-8022-48e0-81b3-d7f27b6408fd None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:58.994494 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e9615-e981-49f6-a191-2b48cc2931b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:58.995081 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e9615-e981-49f6-a191-2b48cc2931b5 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:58.995355 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e9615-e981-49f6-a191-2b48cc2931b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:58.995620 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e9615-e981-49f6-a191-2b48cc2931b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:58.996276 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e9615-e981-49f6-a191-2b48cc2931b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:58.996709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e9615-e981-49f6-a191-2b48cc2931b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:58.998068 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e9615-e981-49f6-a191-2b48cc2931b5 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:59.005796 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 582/1150] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:45:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:59.011739 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db274c-c9cd-45b1-a0d0-f7d9f5dd57e3 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:59.110612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db274c-c9cd-45b1-a0d0-f7d9f5dd57e3 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:59.144943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb1868-7da7-41b2-ab6b-ab70f81ff18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:59.145555 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb1868-7da7-41b2-ab6b-ab70f81ff18f None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:59.145834 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb1868-7da7-41b2-ab6b-ab70f81ff18f None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:59.146105 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb1868-7da7-41b2-ab6b-ab70f81ff18f None admin] PATH_INFO: `/v3/users/010376c180e54428be694a7d9ec98800` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:59.147211 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb1868-7da7-41b2-ab6b-ab70f81ff18f None admin] RBAC: Authorizing `identity:get_user(user_id=010376c180e54428be694a7d9ec98800)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:59.148906 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb1868-7da7-41b2-ab6b-ab70f81ff18f None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:59.150466 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 569/1151] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:45:59 2022] GET /identity/v3/users/010376c180e54428be694a7d9ec98800 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:59.156837 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e9615-e981-49f6-a191-2b48cc2931b5 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:59.229934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:59.254948 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e9615-e981-49f6-a191-2b48cc2931b5 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:59.289047 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a22273-a58a-4b46-a09d-1ea1098fc873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:59.289672 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a22273-a58a-4b46-a09d-1ea1098fc873 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:59.289954 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a22273-a58a-4b46-a09d-1ea1098fc873 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:59.290229 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a22273-a58a-4b46-a09d-1ea1098fc873 None admin] PATH_INFO: `/v3/projects/d1973f62ff514b3b80e029776eb912b7` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:59.291348 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a22273-a58a-4b46-a09d-1ea1098fc873 None admin] RBAC: Authorizing `identity:get_project(project_id=d1973f62ff514b3b80e029776eb912b7)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:59.292817 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a22273-a58a-4b46-a09d-1ea1098fc873 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:59.294453 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 583/1152] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:45:59 2022] GET /identity/v3/projects/d1973f62ff514b3b80e029776eb912b7 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:59.300510 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb1868-7da7-41b2-ab6b-ab70f81ff18f None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:59.336032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:59.398186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb1868-7da7-41b2-ab6b-ab70f81ff18f None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:59.430630 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93baa33b-9436-4ad9-a3a0-531dce8d5482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:59.431276 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93baa33b-9436-4ad9-a3a0-531dce8d5482 None admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:59.431560 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93baa33b-9436-4ad9-a3a0-531dce8d5482 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:59.431833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93baa33b-9436-4ad9-a3a0-531dce8d5482 None admin] PATH_INFO: `/v3/projects/d1973f62ff514b3b80e029776eb912b7/users/010376c180e54428be694a7d9ec98800/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:59.433762 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93baa33b-9436-4ad9-a3a0-531dce8d5482 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1973f62ff514b3b80e029776eb912b7, user_id=010376c180e54428be694a7d9ec98800, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:59.435824 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93baa33b-9436-4ad9-a3a0-531dce8d5482 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:59.533920 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 570/1153] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 24 15:45:59 2022] PUT /identity/v3/projects/d1973f62ff514b3b80e029776eb912b7/users/010376c180e54428be694a7d9ec98800/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:01.424908 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd15686-1b2a-405e-b707-6898186da343 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:01.425493 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd15686-1b2a-405e-b707-6898186da343 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:01.425493 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd15686-1b2a-405e-b707-6898186da343 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:01.426814 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 584/1154] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:46:01.431988 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6345e4e-c6fd-40bd-94bd-f332a4fa393a None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:01.432529 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6345e4e-c6fd-40bd-94bd-f332a4fa393a None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:01.432529 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6345e4e-c6fd-40bd-94bd-f332a4fa393a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:01.451548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-e6345e4e-c6fd-40bd-94bd-f332a4fa393a None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:01.452766 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e6345e4e-c6fd-40bd-94bd-f332a4fa393a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:01.518534 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 571/1155] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:46:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:46:01.788920 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd15686-1b2a-405e-b707-6898186da343 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:01.894171 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd15686-1b2a-405e-b707-6898186da343 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:01.928103 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08890eab-ca36-4dc2-9e24-c6e24ded002b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:01.928751 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08890eab-ca36-4dc2-9e24-c6e24ded002b None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:01.929035 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08890eab-ca36-4dc2-9e24-c6e24ded002b None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:01.929309 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08890eab-ca36-4dc2-9e24-c6e24ded002b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:01.939741 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08890eab-ca36-4dc2-9e24-c6e24ded002b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:46:01.944381 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-08890eab-ca36-4dc2-9e24-c6e24ded002b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:46:01.944381 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:46:01.944381 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:46:01.944381 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:46:01.944381 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:46:01.944381 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:46:01.944381 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:46:01.944381 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:46:01.944381 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:46:01.944381 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:46:01.944381 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:46:01.944381 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:46:01.944381 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:46:01.944381 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:46:01.944381 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:46:01.944381 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:46:01.945806 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:46:01.945806 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:46:01.945806 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:46:01.945806 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:46:01.945806 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:46:01.945806 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:46:01.945806 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:46:01.945806 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:46:01.945806 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:46:01.945806 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:46:01.945806 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:46:01.945806 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:46:01.945806 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:46:01.945806 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:46:01.945806 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:46:01.945806 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:46:01.947152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:46:01.947152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:46:01.947152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:46:01.947152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:46:01.947152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:46:01.947152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:46:01.947152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:46:01.947152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:46:01.947152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:46:01.947152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:46:01.947152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:46:01.947152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:46:01.947152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 585/1156] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:46:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:46:01.952192 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6345e4e-c6fd-40bd-94bd-f332a4fa393a None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:01.979433 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:02.056953 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6345e4e-c6fd-40bd-94bd-f332a4fa393a None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:02.102929 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5afa5-e345-4539-b497-42202eeee7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:02.103877 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5afa5-e345-4539-b497-42202eeee7f0 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:02.104322 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5afa5-e345-4539-b497-42202eeee7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:02.104806 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5afa5-e345-4539-b497-42202eeee7f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:02.106472 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5afa5-e345-4539-b497-42202eeee7f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:46:02.107011 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5afa5-e345-4539-b497-42202eeee7f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:02.109374 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5afa5-e345-4539-b497-42202eeee7f0 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:02.122329 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 572/1157] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:46:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:46:02.129867 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08890eab-ca36-4dc2-9e24-c6e24ded002b None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:02.133235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:02.232696 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08890eab-ca36-4dc2-9e24-c6e24ded002b None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:02.268137 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edf790-7b00-461b-8b67-3cc38571f5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:02.268790 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edf790-7b00-461b-8b67-3cc38571f5fc None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:02.269070 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edf790-7b00-461b-8b67-3cc38571f5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:02.269343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edf790-7b00-461b-8b67-3cc38571f5fc None admin] PATH_INFO: `/v3/users/010376c180e54428be694a7d9ec98800` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:02.270457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93edf790-7b00-461b-8b67-3cc38571f5fc None admin] RBAC: Authorizing `identity:get_user(user_id=010376c180e54428be694a7d9ec98800)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:02.271887 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93edf790-7b00-461b-8b67-3cc38571f5fc None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:02.273747 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 586/1158] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:46:02 2022] GET /identity/v3/users/010376c180e54428be694a7d9ec98800 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:46:02.280470 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5afa5-e345-4539-b497-42202eeee7f0 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:02.369643 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:02.382262 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5afa5-e345-4539-b497-42202eeee7f0 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:02.417331 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620ff03-575c-4c36-8cc6-7aa57035ebba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:02.417937 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620ff03-575c-4c36-8cc6-7aa57035ebba None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:02.418807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620ff03-575c-4c36-8cc6-7aa57035ebba None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:02.419077 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620ff03-575c-4c36-8cc6-7aa57035ebba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:02.487087 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620ff03-575c-4c36-8cc6-7aa57035ebba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:02.488551 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620ff03-575c-4c36-8cc6-7aa57035ebba None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:02.572950 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:02.586318 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 573/1159] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:46:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:46:02.593070 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edf790-7b00-461b-8b67-3cc38571f5fc None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:02.663592 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:02.693501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edf790-7b00-461b-8b67-3cc38571f5fc None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:02.732611 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99172b65-e47a-4902-b251-ae656b4d7f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:02.733501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99172b65-e47a-4902-b251-ae656b4d7f23 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:02.733911 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99172b65-e47a-4902-b251-ae656b4d7f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:02.734329 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99172b65-e47a-4902-b251-ae656b4d7f23 None admin] PATH_INFO: `/v3/projects/d1973f62ff514b3b80e029776eb912b7` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:02.735957 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99172b65-e47a-4902-b251-ae656b4d7f23 None admin] RBAC: Authorizing `identity:get_project(project_id=d1973f62ff514b3b80e029776eb912b7)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:02.738057 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99172b65-e47a-4902-b251-ae656b4d7f23 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:02.739978 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 587/1160] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:46:02 2022] GET /identity/v3/projects/d1973f62ff514b3b80e029776eb912b7 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:46:02.746182 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620ff03-575c-4c36-8cc6-7aa57035ebba None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:02.844290 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620ff03-575c-4c36-8cc6-7aa57035ebba None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:02.877151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591bb5c-0286-4b3a-937f-b278654c35e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:02.877746 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591bb5c-0286-4b3a-937f-b278654c35e5 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:02.878021 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591bb5c-0286-4b3a-937f-b278654c35e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:02.878288 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591bb5c-0286-4b3a-937f-b278654c35e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:02.879004 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7591bb5c-0286-4b3a-937f-b278654c35e5 None admin] RBAC: Adding query filter params (role.id=c6745e08f9da4a2bae8510c9983635c3, scope.project.id=d1973f62ff514b3b80e029776eb912b7, user.id=010376c180e54428be694a7d9ec98800) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:46:02.879307 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7591bb5c-0286-4b3a-937f-b278654c35e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:02.880732 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7591bb5c-0286-4b3a-937f-b278654c35e5 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:02.888035 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 574/1161] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:46:02 2022] GET /identity/v3/role_assignments?user.id=010376c180e54428be694a7d9ec98800&scope.project.id=d1973f62ff514b3b80e029776eb912b7&role.id=c6745e08f9da4a2bae8510c9983635c3 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:46:04.815343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cedc0-31a2-474d-a3a2-ddf30df193bb None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:04.815931 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cedc0-31a2-474d-a3a2-ddf30df193bb None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:04.815931 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cedc0-31a2-474d-a3a2-ddf30df193bb None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:04.817297 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 588/1162] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:46:04.823303 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb46447-7845-4c2d-911e-4065a03d484b None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:04.823714 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb46447-7845-4c2d-911e-4065a03d484b None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:04.823874 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb46447-7845-4c2d-911e-4065a03d484b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:04.841551 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-bfb46447-7845-4c2d-911e-4065a03d484b None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:04.842732 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-bfb46447-7845-4c2d-911e-4065a03d484b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:04.890203 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:04.913993 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 575/1163] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:46:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:46:05.187187 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1cedc0-31a2-474d-a3a2-ddf30df193bb None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:05.291275 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1cedc0-31a2-474d-a3a2-ddf30df193bb None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:05.325825 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001ce01-eacb-4cb5-b62a-1ae35cde29f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:05.326423 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001ce01-eacb-4cb5-b62a-1ae35cde29f5 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:05.326703 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001ce01-eacb-4cb5-b62a-1ae35cde29f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:05.326974 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001ce01-eacb-4cb5-b62a-1ae35cde29f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:05.335454 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:05.402614 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001ce01-eacb-4cb5-b62a-1ae35cde29f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:05.404073 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001ce01-eacb-4cb5-b62a-1ae35cde29f5 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:05.501987 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 589/1164] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:46:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:46:05.508062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb46447-7845-4c2d-911e-4065a03d484b None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:05.606476 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb46447-7845-4c2d-911e-4065a03d484b None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:05.640897 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211e905-58de-4f54-8382-3461a702695c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:05.641512 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211e905-58de-4f54-8382-3461a702695c None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:05.641788 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211e905-58de-4f54-8382-3461a702695c None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:05.642048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211e905-58de-4f54-8382-3461a702695c None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:05.648758 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211e905-58de-4f54-8382-3461a702695c None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:05.650176 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211e905-58de-4f54-8382-3461a702695c None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:05.662381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-3211e905-58de-4f54-8382-3461a702695c None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 15:46:05.662381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:46:05.662381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 15:46:05.662381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 15:46:05.662381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:46:05.662381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:46:05.662381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:46:05.662381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:46:05.662381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 15:46:05.662381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:46:05.662381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:46:05.662381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:46:05.662381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:46:05.662381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:46:05.662381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:46:05.662381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:46:05.662381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:46:05.663604 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:46:05.663604 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:46:05.663604 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:46:05.663604 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:46:05.663604 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:46:05.663604 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:46:05.663604 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:46:05.663604 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:46:05.663604 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:46:05.663604 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:46:05.663604 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:46:05.663604 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:46:05.663604 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:46:05.663604 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:46:05.663604 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:46:05.663604 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:46:05.664744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:46:05.664744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:46:05.664744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:46:05.664744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:46:05.664744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:46:05.664744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:46:05.664744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:46:05.664744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:46:05.664744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:46:05.664744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:46:05.664744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 15:46:05.664744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:46:05.664744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 15:46:05.664744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:46:05.664744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 576/1165] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 24 15:46:05 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:46:05.669589 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001ce01-eacb-4cb5-b62a-1ae35cde29f5 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:05.711830 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:05.771141 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001ce01-eacb-4cb5-b62a-1ae35cde29f5 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:05.807312 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7870ea2-4240-4f0d-a326-8002e6eadf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:05.807907 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7870ea2-4240-4f0d-a326-8002e6eadf97 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:05.808186 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7870ea2-4240-4f0d-a326-8002e6eadf97 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:05.808524 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7870ea2-4240-4f0d-a326-8002e6eadf97 None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:05.809335 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7870ea2-4240-4f0d-a326-8002e6eadf97 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:46:05.809642 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7870ea2-4240-4f0d-a326-8002e6eadf97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:05.811004 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7870ea2-4240-4f0d-a326-8002e6eadf97 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:05.818087 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 590/1166] 10.222.0.64 () {56 vars in 1115 bytes} [Wed Aug 24 15:46:05 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:46:07.730777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4bffd-ca92-4464-a9c9-950baffd2a50 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:07.731301 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4bffd-ca92-4464-a9c9-950baffd2a50 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:07.731409 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4bffd-ca92-4464-a9c9-950baffd2a50 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:07.732686 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 577/1167] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:46:07.737967 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f2a0b-2ba6-4a37-a415-788060c93017 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:07.738360 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f2a0b-2ba6-4a37-a415-788060c93017 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:07.738522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f2a0b-2ba6-4a37-a415-788060c93017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:07.756733 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-c87f2a0b-2ba6-4a37-a415-788060c93017 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:07.757924 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-c87f2a0b-2ba6-4a37-a415-788060c93017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:07.827038 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 591/1168] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:46:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:46:08.100347 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4bffd-ca92-4464-a9c9-950baffd2a50 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:08.144469 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:08.206039 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4bffd-ca92-4464-a9c9-950baffd2a50 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:08.239021 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ba4a4-a399-4c9c-a3d5-e28b431f87d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:08.239625 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ba4a4-a399-4c9c-a3d5-e28b431f87d9 None admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:08.239903 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ba4a4-a399-4c9c-a3d5-e28b431f87d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:08.240176 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ba4a4-a399-4c9c-a3d5-e28b431f87d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:08.240868 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ba4a4-a399-4c9c-a3d5-e28b431f87d9 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:08.242232 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ba4a4-a399-4c9c-a3d5-e28b431f87d9 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:08.309987 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 578/1169] 10.222.0.64 () {60 vars in 1138 bytes} [Wed Aug 24 15:46:08 2022] POST /identity/v3/domains => generated 267 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:10.259111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b78945-6835-47c9-99f9-7986fb395b49 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:10.259670 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b78945-6835-47c9-99f9-7986fb395b49 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:10.259670 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b78945-6835-47c9-99f9-7986fb395b49 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:10.261102 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 592/1170] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:46:10.266966 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0ffdf-d409-4d13-8790-3eddd5a0fe51 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:10.267423 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0ffdf-d409-4d13-8790-3eddd5a0fe51 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:10.267518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0ffdf-d409-4d13-8790-3eddd5a0fe51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:10.286562 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-24f0ffdf-d409-4d13-8790-3eddd5a0fe51 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:10.287744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-24f0ffdf-d409-4d13-8790-3eddd5a0fe51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:10.356530 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 579/1171] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:46:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:46:10.625807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b78945-6835-47c9-99f9-7986fb395b49 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:10.659034 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:10.732210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b78945-6835-47c9-99f9-7986fb395b49 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:10.768100 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947aad7-6ee8-48b4-bf3f-8602686448e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:10.768720 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947aad7-6ee8-48b4-bf3f-8602686448e6 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:10.769020 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947aad7-6ee8-48b4-bf3f-8602686448e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:10.769305 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947aad7-6ee8-48b4-bf3f-8602686448e6 None admin] PATH_INFO: `/v3/domains/bc21b0078892421aa82fc4d99268c139` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:10.780252 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947aad7-6ee8-48b4-bf3f-8602686448e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=bc21b0078892421aa82fc4d99268c139)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:10.781731 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947aad7-6ee8-48b4-bf3f-8602686448e6 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:10.783348 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 593/1172] 10.222.0.64 () {56 vars in 1183 bytes} [Wed Aug 24 15:46:10 2022] GET /identity/v3/domains/bc21b0078892421aa82fc4d99268c139 => generated 267 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:46:10.789219 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0ffdf-d409-4d13-8790-3eddd5a0fe51 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:10.820088 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:10.887748 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0ffdf-d409-4d13-8790-3eddd5a0fe51 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:10.921150 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d0654-792f-4cce-aa7a-b1c7add76456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:10.921749 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d0654-792f-4cce-aa7a-b1c7add76456 None admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:10.922029 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d0654-792f-4cce-aa7a-b1c7add76456 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:10.922302 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d0654-792f-4cce-aa7a-b1c7add76456 None admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:10.922944 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d0654-792f-4cce-aa7a-b1c7add76456 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:10.924360 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d0654-792f-4cce-aa7a-b1c7add76456 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:11.014870 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 580/1173] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 24 15:46:10 2022] POST /identity/v3/projects => generated 361 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:12.952712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f929b0-baa5-42e0-88b3-cdb734c7d4da None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:12.953289 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f929b0-baa5-42e0-88b3-cdb734c7d4da None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:12.953418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f929b0-baa5-42e0-88b3-cdb734c7d4da None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:12.954831 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 594/1174] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:46:12.960479 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fb143-283a-4fb7-bc06-1a0c3e1671cb None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:12.960919 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fb143-283a-4fb7-bc06-1a0c3e1671cb None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:12.961062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fb143-283a-4fb7-bc06-1a0c3e1671cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:12.980536 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-544fb143-283a-4fb7-bc06-1a0c3e1671cb None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:12.981774 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-544fb143-283a-4fb7-bc06-1a0c3e1671cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:13.048839 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 581/1175] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:46:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:46:13.320500 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f929b0-baa5-42e0-88b3-cdb734c7d4da None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:13.413277 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:13.422925 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f929b0-baa5-42e0-88b3-cdb734c7d4da None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:13.458260 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47ddfc-64c7-4e0c-9034-6b871104c315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:13.458877 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47ddfc-64c7-4e0c-9034-6b871104c315 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:13.459154 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47ddfc-64c7-4e0c-9034-6b871104c315 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:13.459421 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47ddfc-64c7-4e0c-9034-6b871104c315 None admin] PATH_INFO: `/v3/domains/bc21b0078892421aa82fc4d99268c139` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:13.460521 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a47ddfc-64c7-4e0c-9034-6b871104c315 None admin] RBAC: Authorizing `identity:get_domain(domain_id=bc21b0078892421aa82fc4d99268c139)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:13.461978 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a47ddfc-64c7-4e0c-9034-6b871104c315 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:13.463523 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 595/1176] 10.222.0.64 () {56 vars in 1183 bytes} [Wed Aug 24 15:46:13 2022] GET /identity/v3/domains/bc21b0078892421aa82fc4d99268c139 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:46:13.469556 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544fb143-283a-4fb7-bc06-1a0c3e1671cb None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:13.483958 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:13.565702 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544fb143-283a-4fb7-bc06-1a0c3e1671cb None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:13.598358 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b3df8-11e8-48dc-ade1-5b8bcc1f4d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:13.598960 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b3df8-11e8-48dc-ade1-5b8bcc1f4d66 None admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:13.599244 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b3df8-11e8-48dc-ade1-5b8bcc1f4d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:13.599522 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b3df8-11e8-48dc-ade1-5b8bcc1f4d66 None admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:13.600171 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b3df8-11e8-48dc-ade1-5b8bcc1f4d66 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:13.601629 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b3df8-11e8-48dc-ade1-5b8bcc1f4d66 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:13.691117 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 582/1177] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 24 15:46:13 2022] POST /identity/v3/users => generated 311 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:46:15.669161 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffe51c-38dd-4f69-a74e-bb210e484f8a None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:15.669711 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffe51c-38dd-4f69-a74e-bb210e484f8a None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:15.669711 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffe51c-38dd-4f69-a74e-bb210e484f8a None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:15.670945 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 596/1178] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:46:15.676172 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5e62c-8074-4477-bd00-3e1663c31336 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:15.676598 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5e62c-8074-4477-bd00-3e1663c31336 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:15.676740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5e62c-8074-4477-bd00-3e1663c31336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:15.695032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-30d5e62c-8074-4477-bd00-3e1663c31336 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:15.696219 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-30d5e62c-8074-4477-bd00-3e1663c31336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:15.759735 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:15.765070 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 583/1179] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:46:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:46:16.033362 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffe51c-38dd-4f69-a74e-bb210e484f8a None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:16.133802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffe51c-38dd-4f69-a74e-bb210e484f8a None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:16.167598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150c268-9914-4927-b652-f79beed70f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:16.168417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150c268-9914-4927-b652-f79beed70f73 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:16.168876 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150c268-9914-4927-b652-f79beed70f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:16.169152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150c268-9914-4927-b652-f79beed70f73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:16.178856 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150c268-9914-4927-b652-f79beed70f73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:46:16.184432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-f150c268-9914-4927-b652-f79beed70f73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:46:16.184432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:46:16.184432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:46:16.184432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:46:16.184432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:46:16.184432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:46:16.184432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:46:16.184432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:46:16.184432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:46:16.184432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:46:16.184432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:46:16.184432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:46:16.184432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:46:16.184432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:46:16.184432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:46:16.184432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:46:16.186163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:46:16.186163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:46:16.186163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:46:16.186163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:46:16.186163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:46:16.186163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:46:16.186163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:46:16.186163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:46:16.186163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:46:16.186163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:46:16.186163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:46:16.186163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:46:16.186163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:46:16.186163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:46:16.186163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:46:16.186163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:46:16.187912 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:46:16.187912 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:46:16.187912 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:46:16.187912 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:46:16.187912 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:46:16.187912 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:46:16.187912 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:46:16.187912 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:46:16.187912 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:46:16.187912 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:46:16.187912 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:46:16.187912 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:46:16.187912 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 597/1180] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:46:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:46:16.191659 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d5e62c-8074-4477-bd00-3e1663c31336 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:16.288166 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d5e62c-8074-4477-bd00-3e1663c31336 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:16.322327 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952a012-30ee-46c3-a388-28b49e8b8921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:16.322935 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952a012-30ee-46c3-a388-28b49e8b8921 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:16.323321 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952a012-30ee-46c3-a388-28b49e8b8921 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:16.323596 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952a012-30ee-46c3-a388-28b49e8b8921 None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:16.324253 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952a012-30ee-46c3-a388-28b49e8b8921 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:46:16.324551 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952a012-30ee-46c3-a388-28b49e8b8921 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:16.325938 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952a012-30ee-46c3-a388-28b49e8b8921 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:16.333813 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 584/1181] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:46:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:46:16.339961 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150c268-9914-4927-b652-f79beed70f73 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:16.362683 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:16.439649 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150c268-9914-4927-b652-f79beed70f73 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:16.473227 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34101f5e-5686-4cef-9a5a-408cbcf2a921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:16.473844 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34101f5e-5686-4cef-9a5a-408cbcf2a921 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:16.474122 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34101f5e-5686-4cef-9a5a-408cbcf2a921 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:16.474389 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34101f5e-5686-4cef-9a5a-408cbcf2a921 None admin] PATH_INFO: `/v3/users/df822c71a9764f1ab0487fe5d42019b3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:16.487906 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34101f5e-5686-4cef-9a5a-408cbcf2a921 None admin] RBAC: Authorizing `identity:get_user(user_id=df822c71a9764f1ab0487fe5d42019b3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:16.489370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34101f5e-5686-4cef-9a5a-408cbcf2a921 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:16.490996 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 598/1182] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:46:16 2022] GET /identity/v3/users/df822c71a9764f1ab0487fe5d42019b3 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:46:16.497269 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952a012-30ee-46c3-a388-28b49e8b8921 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:16.557305 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:16.597890 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952a012-30ee-46c3-a388-28b49e8b8921 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:16.631031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85131a4c-880a-4db7-8105-82d8645cc529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:16.631630 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85131a4c-880a-4db7-8105-82d8645cc529 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:16.631908 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85131a4c-880a-4db7-8105-82d8645cc529 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:16.632181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85131a4c-880a-4db7-8105-82d8645cc529 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:16.698162 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85131a4c-880a-4db7-8105-82d8645cc529 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:16.699785 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85131a4c-880a-4db7-8105-82d8645cc529 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:16.757244 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:16.796731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 585/1183] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:46:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 15:46:16.802626 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34101f5e-5686-4cef-9a5a-408cbcf2a921 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:16.889721 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:16.911450 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34101f5e-5686-4cef-9a5a-408cbcf2a921 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:16.945241 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba707c9-eb5a-409e-83f0-18b5e09c6b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:16.945867 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba707c9-eb5a-409e-83f0-18b5e09c6b3d None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:16.946146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba707c9-eb5a-409e-83f0-18b5e09c6b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:16.946417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba707c9-eb5a-409e-83f0-18b5e09c6b3d None admin] PATH_INFO: `/v3/projects/9dec1d4b694c49f48dce163486acd371` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:16.947531 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba707c9-eb5a-409e-83f0-18b5e09c6b3d None admin] RBAC: Authorizing `identity:get_project(project_id=9dec1d4b694c49f48dce163486acd371)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:16.949929 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba707c9-eb5a-409e-83f0-18b5e09c6b3d None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:16.951571 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 599/1184] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:46:16 2022] GET /identity/v3/projects/9dec1d4b694c49f48dce163486acd371 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:46:16.958024 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85131a4c-880a-4db7-8105-82d8645cc529 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:17.055265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85131a4c-880a-4db7-8105-82d8645cc529 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:17.088589 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae4046-45ee-46f2-8cee-9718a93ee461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:17.090146 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae4046-45ee-46f2-8cee-9718a93ee461 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:17.090423 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae4046-45ee-46f2-8cee-9718a93ee461 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:17.090692 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae4046-45ee-46f2-8cee-9718a93ee461 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:17.091413 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae4046-45ee-46f2-8cee-9718a93ee461 None admin] RBAC: Adding query filter params (role.id=c6745e08f9da4a2bae8510c9983635c3, scope.project.id=9dec1d4b694c49f48dce163486acd371, user.id=df822c71a9764f1ab0487fe5d42019b3) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:46:17.091719 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae4046-45ee-46f2-8cee-9718a93ee461 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:17.093169 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae4046-45ee-46f2-8cee-9718a93ee461 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:17.098711 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 586/1185] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:46:16 2022] GET /identity/v3/role_assignments?user.id=df822c71a9764f1ab0487fe5d42019b3&scope.project.id=9dec1d4b694c49f48dce163486acd371&role.id=c6745e08f9da4a2bae8510c9983635c3 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:46:19.005378 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f22cea-a32e-4298-bee8-be0f8e0b0c3b None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:19.005948 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f22cea-a32e-4298-bee8-be0f8e0b0c3b None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:19.005948 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f22cea-a32e-4298-bee8-be0f8e0b0c3b None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:19.007273 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 600/1186] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:46:19.013227 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142e5f9-7063-4e07-9f9d-116df8d4a2d7 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:19.013644 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142e5f9-7063-4e07-9f9d-116df8d4a2d7 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:19.013771 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142e5f9-7063-4e07-9f9d-116df8d4a2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:19.032222 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-2142e5f9-7063-4e07-9f9d-116df8d4a2d7 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:19.033432 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-2142e5f9-7063-4e07-9f9d-116df8d4a2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:19.053337 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:19.101095 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 587/1187] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:46:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:46:19.372412 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f22cea-a32e-4298-bee8-be0f8e0b0c3b None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:19.472564 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f22cea-a32e-4298-bee8-be0f8e0b0c3b None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:19.506392 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eaf2d5-2b8b-4b2d-a3c3-e930614d0ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:19.507015 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eaf2d5-2b8b-4b2d-a3c3-e930614d0ccf None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:19.507291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eaf2d5-2b8b-4b2d-a3c3-e930614d0ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:19.507559 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eaf2d5-2b8b-4b2d-a3c3-e930614d0ccf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:19.518783 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eaf2d5-2b8b-4b2d-a3c3-e930614d0ccf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:46:19.523678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-b3eaf2d5-2b8b-4b2d-a3c3-e930614d0ccf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:46:19.523678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:46:19.523678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:46:19.523678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:46:19.523678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:46:19.523678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:46:19.523678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:46:19.523678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:46:19.523678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:46:19.523678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:46:19.523678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:46:19.523678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:46:19.523678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:46:19.523678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:46:19.523678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:46:19.523678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:46:19.524807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:46:19.524807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:46:19.524807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:46:19.524807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:46:19.524807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:46:19.524807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:46:19.524807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:46:19.524807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:46:19.524807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:46:19.524807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:46:19.524807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:46:19.524807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:46:19.524807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:46:19.524807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:46:19.524807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:46:19.524807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:46:19.525654 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:46:19.525654 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:46:19.525654 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:46:19.525654 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:46:19.525654 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:46:19.525654 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:46:19.525654 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:46:19.525654 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:46:19.525654 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:46:19.525654 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:46:19.525654 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:46:19.525654 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:46:19.525654 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 601/1188] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:46:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:46:19.531183 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142e5f9-7063-4e07-9f9d-116df8d4a2d7 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:19.629718 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142e5f9-7063-4e07-9f9d-116df8d4a2d7 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:19.663780 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b69dff-b350-48b9-a26c-99b1e3be3ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:19.664382 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b69dff-b350-48b9-a26c-99b1e3be3ada None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:19.664683 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b69dff-b350-48b9-a26c-99b1e3be3ada None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:19.664956 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b69dff-b350-48b9-a26c-99b1e3be3ada None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:19.665611 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b69dff-b350-48b9-a26c-99b1e3be3ada None admin] RBAC: Adding query filter params (name=admin) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:46:19.665911 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b69dff-b350-48b9-a26c-99b1e3be3ada None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:19.667310 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b69dff-b350-48b9-a26c-99b1e3be3ada None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:19.675265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 588/1189] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:46:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:46:19.681254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eaf2d5-2b8b-4b2d-a3c3-e930614d0ccf None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:19.691859 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:19.783112 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eaf2d5-2b8b-4b2d-a3c3-e930614d0ccf None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:19.817922 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b4055-58ad-40ea-ba63-0c56c0daf143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:19.818547 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b4055-58ad-40ea-ba63-0c56c0daf143 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:19.818824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b4055-58ad-40ea-ba63-0c56c0daf143 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:19.819092 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b4055-58ad-40ea-ba63-0c56c0daf143 None admin] PATH_INFO: `/v3/users/df822c71a9764f1ab0487fe5d42019b3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:19.820208 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b4055-58ad-40ea-ba63-0c56c0daf143 None admin] RBAC: Authorizing `identity:get_user(user_id=df822c71a9764f1ab0487fe5d42019b3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:19.821687 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b4055-58ad-40ea-ba63-0c56c0daf143 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:19.823342 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 602/1190] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:46:19 2022] GET /identity/v3/users/df822c71a9764f1ab0487fe5d42019b3 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:46:19.829278 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b69dff-b350-48b9-a26c-99b1e3be3ada None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:19.848494 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:19.927235 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b69dff-b350-48b9-a26c-99b1e3be3ada None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:19.960369 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8bc510-3396-4c0e-81e6-eef3f50d9e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:19.961014 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bc510-3396-4c0e-81e6-eef3f50d9e41 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:19.961290 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bc510-3396-4c0e-81e6-eef3f50d9e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:19.961558 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bc510-3396-4c0e-81e6-eef3f50d9e41 None admin] PATH_INFO: `/v3/projects/9dec1d4b694c49f48dce163486acd371` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:19.962662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8bc510-3396-4c0e-81e6-eef3f50d9e41 None admin] RBAC: Authorizing `identity:get_project(project_id=9dec1d4b694c49f48dce163486acd371)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:19.964755 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8bc510-3396-4c0e-81e6-eef3f50d9e41 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:19.966205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 589/1191] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:46:19 2022] GET /identity/v3/projects/9dec1d4b694c49f48dce163486acd371 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:46:19.972441 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b4055-58ad-40ea-ba63-0c56c0daf143 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:20.047739 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:20.072607 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b4055-58ad-40ea-ba63-0c56c0daf143 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:20.107685 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9599b3-ce71-414d-b9c4-3c349cd58f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:20.108354 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9599b3-ce71-414d-b9c4-3c349cd58f8c None admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:20.108614 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9599b3-ce71-414d-b9c4-3c349cd58f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:20.108918 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9599b3-ce71-414d-b9c4-3c349cd58f8c None admin] PATH_INFO: `/v3/projects/9dec1d4b694c49f48dce163486acd371/users/df822c71a9764f1ab0487fe5d42019b3/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:20.110800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9599b3-ce71-414d-b9c4-3c349cd58f8c None admin] RBAC: Authorizing `identity:create_grant(project_id=9dec1d4b694c49f48dce163486acd371, user_id=df822c71a9764f1ab0487fe5d42019b3, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:20.112222 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9599b3-ce71-414d-b9c4-3c349cd58f8c None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:20.207693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 603/1192] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 24 15:46:19 2022] PUT /identity/v3/projects/9dec1d4b694c49f48dce163486acd371/users/df822c71a9764f1ab0487fe5d42019b3/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:22.101473 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38449c29-513b-434f-80e4-76882762309b None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:22.102027 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38449c29-513b-434f-80e4-76882762309b None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:22.102027 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38449c29-513b-434f-80e4-76882762309b None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:22.103345 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 590/1193] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:46:22.109510 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd4563-f5f5-400b-af84-21c7d455231d None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:22.109936 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd4563-f5f5-400b-af84-21c7d455231d None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:22.110034 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd4563-f5f5-400b-af84-21c7d455231d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:22.128966 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-c7bd4563-f5f5-400b-af84-21c7d455231d None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:22.130145 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-c7bd4563-f5f5-400b-af84-21c7d455231d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:22.196080 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 604/1194] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:46:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:46:22.466564 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38449c29-513b-434f-80e4-76882762309b None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:22.555410 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:22.570654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38449c29-513b-434f-80e4-76882762309b None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:22.605078 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb8d4d-97d2-409c-a279-6eacd8bb9561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:22.605693 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb8d4d-97d2-409c-a279-6eacd8bb9561 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:22.605967 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb8d4d-97d2-409c-a279-6eacd8bb9561 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:22.606231 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb8d4d-97d2-409c-a279-6eacd8bb9561 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:22.616116 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb8d4d-97d2-409c-a279-6eacd8bb9561 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:46:22.620861 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-48bb8d4d-97d2-409c-a279-6eacd8bb9561 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:46:22.620861 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:46:22.620861 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:46:22.620861 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:46:22.620861 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:46:22.620861 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:46:22.620861 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:46:22.620861 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:46:22.620861 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:46:22.620861 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:46:22.620861 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:46:22.620861 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:46:22.620861 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:46:22.620861 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:46:22.620861 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:46:22.620861 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:46:22.621968 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:46:22.621968 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:46:22.621968 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:46:22.621968 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:46:22.621968 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:46:22.621968 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:46:22.621968 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:46:22.621968 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:46:22.621968 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:46:22.621968 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:46:22.621968 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:46:22.621968 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:46:22.621968 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:46:22.621968 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:46:22.621968 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:46:22.621968 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:46:22.622877 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:46:22.622877 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:46:22.622877 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:46:22.622877 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:46:22.622877 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:46:22.622877 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:46:22.622877 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:46:22.622877 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:46:22.622877 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:46:22.622877 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:46:22.622877 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:46:22.622877 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:46:22.622877 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 591/1195] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:46:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:46:22.628098 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd4563-f5f5-400b-af84-21c7d455231d None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:22.688417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:22.725365 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd4563-f5f5-400b-af84-21c7d455231d None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:22.759677 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762a9ce-a81a-4d52-b901-dc1e23fbe29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:22.761269 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762a9ce-a81a-4d52-b901-dc1e23fbe29c None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:22.761828 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762a9ce-a81a-4d52-b901-dc1e23fbe29c None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:22.761828 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762a9ce-a81a-4d52-b901-dc1e23fbe29c None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:22.762506 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762a9ce-a81a-4d52-b901-dc1e23fbe29c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:46:22.762802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762a9ce-a81a-4d52-b901-dc1e23fbe29c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:22.764155 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762a9ce-a81a-4d52-b901-dc1e23fbe29c None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:22.772839 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 605/1196] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:46:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:46:22.779570 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb8d4d-97d2-409c-a279-6eacd8bb9561 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:22.877141 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb8d4d-97d2-409c-a279-6eacd8bb9561 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:22.911383 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08946760-d6dd-43cc-bdeb-2bd13e734d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:22.912000 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08946760-d6dd-43cc-bdeb-2bd13e734d6a None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:22.912274 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08946760-d6dd-43cc-bdeb-2bd13e734d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:22.912542 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08946760-d6dd-43cc-bdeb-2bd13e734d6a None admin] PATH_INFO: `/v3/users/df822c71a9764f1ab0487fe5d42019b3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:22.913665 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08946760-d6dd-43cc-bdeb-2bd13e734d6a None admin] RBAC: Authorizing `identity:get_user(user_id=df822c71a9764f1ab0487fe5d42019b3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:22.915081 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08946760-d6dd-43cc-bdeb-2bd13e734d6a None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:22.917244 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 592/1197] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 24 15:46:22 2022] GET /identity/v3/users/df822c71a9764f1ab0487fe5d42019b3 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:46:22.923326 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762a9ce-a81a-4d52-b901-dc1e23fbe29c None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:23.022335 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762a9ce-a81a-4d52-b901-dc1e23fbe29c None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:23.047501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:23.055900 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b1486-f6d6-40e3-ab92-f8ed759de9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:23.057571 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b1486-f6d6-40e3-ab92-f8ed759de9c1 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:23.057571 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b1486-f6d6-40e3-ab92-f8ed759de9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:23.057571 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b1486-f6d6-40e3-ab92-f8ed759de9c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:23.127077 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b1486-f6d6-40e3-ab92-f8ed759de9c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:23.128519 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b1486-f6d6-40e3-ab92-f8ed759de9c1 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:23.229313 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 606/1198] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:46:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:46:23.235676 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08946760-d6dd-43cc-bdeb-2bd13e734d6a None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:23.252564 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:23.341069 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08946760-d6dd-43cc-bdeb-2bd13e734d6a None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:23.375428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c25de-57c5-49b9-8bc9-0699b8305de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:23.376042 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c25de-57c5-49b9-8bc9-0699b8305de0 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:23.376321 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c25de-57c5-49b9-8bc9-0699b8305de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:23.376592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c25de-57c5-49b9-8bc9-0699b8305de0 None admin] PATH_INFO: `/v3/projects/9dec1d4b694c49f48dce163486acd371` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:23.377725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c25de-57c5-49b9-8bc9-0699b8305de0 None admin] RBAC: Authorizing `identity:get_project(project_id=9dec1d4b694c49f48dce163486acd371)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:23.379148 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c25de-57c5-49b9-8bc9-0699b8305de0 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:23.380765 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 593/1199] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 24 15:46:23 2022] GET /identity/v3/projects/9dec1d4b694c49f48dce163486acd371 => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:46:23.387656 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b1486-f6d6-40e3-ab92-f8ed759de9c1 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:23.413815 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:23.484738 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b1486-f6d6-40e3-ab92-f8ed759de9c1 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:23.519012 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837056e-98d7-4be4-8498-28850c7a6972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:23.519615 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837056e-98d7-4be4-8498-28850c7a6972 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:23.519891 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837056e-98d7-4be4-8498-28850c7a6972 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:23.520161 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837056e-98d7-4be4-8498-28850c7a6972 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:23.520913 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837056e-98d7-4be4-8498-28850c7a6972 None admin] RBAC: Adding query filter params (role.id=c6745e08f9da4a2bae8510c9983635c3, scope.project.id=9dec1d4b694c49f48dce163486acd371, user.id=df822c71a9764f1ab0487fe5d42019b3) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:46:23.521219 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837056e-98d7-4be4-8498-28850c7a6972 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:23.522920 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837056e-98d7-4be4-8498-28850c7a6972 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:23.532955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 607/1200] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:46:23 2022] GET /identity/v3/role_assignments?user.id=df822c71a9764f1ab0487fe5d42019b3&scope.project.id=9dec1d4b694c49f48dce163486acd371&role.id=c6745e08f9da4a2bae8510c9983635c3 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:46:33.371400 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=59 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:33.526083 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=55 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:37.920962 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432e919-a6c7-4ab8-a9a8-2bd2b4d9843e None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:37.921836 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432e919-a6c7-4ab8-a9a8-2bd2b4d9843e None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:37.921836 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432e919-a6c7-4ab8-a9a8-2bd2b4d9843e None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:37.923471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 594/1201] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:47:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:47:37.928802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4c782-344a-4d3c-9f0a-aa78c86b077e None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:37.929254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4c782-344a-4d3c-9f0a-aa78c86b077e None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:37.929356 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4c782-344a-4d3c-9f0a-aa78c86b077e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:37.946892 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-00d4c782-344a-4d3c-9f0a-aa78c86b077e None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:47:37.948728 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-00d4c782-344a-4d3c-9f0a-aa78c86b077e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:38.016674 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 608/1202] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:47:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:47:38.284917 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432e919-a6c7-4ab8-a9a8-2bd2b4d9843e None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:38.389528 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432e919-a6c7-4ab8-a9a8-2bd2b4d9843e None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:38.424759 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e04f44-595f-48ea-b839-69329df70aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:38.425382 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e04f44-595f-48ea-b839-69329df70aae None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:38.425664 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e04f44-595f-48ea-b839-69329df70aae None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:38.425940 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e04f44-595f-48ea-b839-69329df70aae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:38.436719 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e04f44-595f-48ea-b839-69329df70aae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:38.438189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e04f44-595f-48ea-b839-69329df70aae None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:38.452492 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-b3e04f44-595f-48ea-b839-69329df70aae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:47:38.452492 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:47:38.452492 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:47:38.452492 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:47:38.452492 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:47:38.452492 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:47:38.452492 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:47:38.452492 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:47:38.452492 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:47:38.452492 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:47:38.452492 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:47:38.452492 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:47:38.452492 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:47:38.452492 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:47:38.452492 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:47:38.452492 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:47:38.453702 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:47:38.453702 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:47:38.453702 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:47:38.453702 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:47:38.453702 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:47:38.453702 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:47:38.453702 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:47:38.453702 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:47:38.453702 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:47:38.453702 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:47:38.453702 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:47:38.453702 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:47:38.453702 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:47:38.453702 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:47:38.453702 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:47:38.453702 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:47:38.453702 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:47:38.455113 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:47:38.455113 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:47:38.455113 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:47:38.455113 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 595/1203] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:47:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:47:38.460309 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4c782-344a-4d3c-9f0a-aa78c86b077e None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:38.558839 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4c782-344a-4d3c-9f0a-aa78c86b077e None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:38.586543 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:38.592895 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893f214-6eef-440f-8c9e-6218420e436b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:38.593499 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893f214-6eef-440f-8c9e-6218420e436b None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:38.593779 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893f214-6eef-440f-8c9e-6218420e436b None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:38.594047 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893f214-6eef-440f-8c9e-6218420e436b None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:38.594685 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893f214-6eef-440f-8c9e-6218420e436b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:47:38.594984 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893f214-6eef-440f-8c9e-6218420e436b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:38.596341 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893f214-6eef-440f-8c9e-6218420e436b None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:38.608073 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 609/1204] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:47:38.614097 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e04f44-595f-48ea-b839-69329df70aae None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:38.667646 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:38.713998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e04f44-595f-48ea-b839-69329df70aae None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:38.749021 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf300607-53ad-416a-9eac-592743f3644a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:38.749773 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf300607-53ad-416a-9eac-592743f3644a None admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:38.750063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf300607-53ad-416a-9eac-592743f3644a None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:38.750340 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf300607-53ad-416a-9eac-592743f3644a None admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:38.750999 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf300607-53ad-416a-9eac-592743f3644a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:38.752428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf300607-53ad-416a-9eac-592743f3644a None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:38.896884 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 596/1205] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 24 15:47:38 2022] POST /identity/v3/users => generated 251 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:47:40.856548 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f436d11-cbb7-40d8-922c-435b5bb187e1 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:40.857131 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f436d11-cbb7-40d8-922c-435b5bb187e1 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:40.857131 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f436d11-cbb7-40d8-922c-435b5bb187e1 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:40.858460 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 610/1206] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:47:40.865373 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b6b12-d4cd-4346-ab4d-d6fe8c569824 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:40.865831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b6b12-d4cd-4346-ab4d-d6fe8c569824 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:40.865949 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b6b12-d4cd-4346-ab4d-d6fe8c569824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:40.885297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-4c6b6b12-d4cd-4346-ab4d-d6fe8c569824 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:47:40.886688 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-4c6b6b12-d4cd-4346-ab4d-d6fe8c569824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:40.953742 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 597/1207] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:47:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:47:41.232839 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f436d11-cbb7-40d8-922c-435b5bb187e1 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:41.340060 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f436d11-cbb7-40d8-922c-435b5bb187e1 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:41.375397 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd9352-a182-4ca8-907e-d3434025af0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:41.379711 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd9352-a182-4ca8-907e-d3434025af0e None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:41.379711 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd9352-a182-4ca8-907e-d3434025af0e None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:41.379711 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd9352-a182-4ca8-907e-d3434025af0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:41.388503 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd9352-a182-4ca8-907e-d3434025af0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:47:41.393693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-09dd9352-a182-4ca8-907e-d3434025af0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:47:41.393693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:47:41.393693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:47:41.393693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:47:41.393693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:47:41.393693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:47:41.393693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:47:41.393693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:47:41.393693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:47:41.393693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:47:41.393693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:47:41.393693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:47:41.393693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:47:41.393693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:47:41.393693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:47:41.393693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:47:41.394905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:47:41.394905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:47:41.394905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:47:41.394905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:47:41.394905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:47:41.394905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:47:41.394905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:47:41.394905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:47:41.394905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:47:41.394905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:47:41.394905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:47:41.394905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:47:41.394905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:47:41.394905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:47:41.394905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:47:41.394905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:47:41.396065 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:47:41.396065 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:47:41.396065 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:47:41.396065 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:47:41.396065 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:47:41.396065 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:47:41.396065 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:47:41.396065 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:47:41.396065 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:47:41.396065 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:47:41.396065 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:47:41.396065 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:47:41.396065 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 611/1208] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 24 15:47:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:47:41.401805 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b6b12-d4cd-4346-ab4d-d6fe8c569824 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:41.440728 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:41.499604 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b6b12-d4cd-4346-ab4d-d6fe8c569824 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:41.535854 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d54a16-9244-4d6f-84d6-3e8ad77e5f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:41.536475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d54a16-9244-4d6f-84d6-3e8ad77e5f45 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:41.536925 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d54a16-9244-4d6f-84d6-3e8ad77e5f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:41.537052 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d54a16-9244-4d6f-84d6-3e8ad77e5f45 None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:41.537678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d54a16-9244-4d6f-84d6-3e8ad77e5f45 None admin] RBAC: Adding query filter params (name=service) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:47:41.537978 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d54a16-9244-4d6f-84d6-3e8ad77e5f45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:41.539344 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d54a16-9244-4d6f-84d6-3e8ad77e5f45 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:41.547247 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 598/1209] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 24 15:47:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:47:41.553132 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd9352-a182-4ca8-907e-d3434025af0e None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:41.603269 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:41.653323 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd9352-a182-4ca8-907e-d3434025af0e None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:41.686048 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2d4f7-e250-4f90-b0f0-022536928045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:41.686669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2d4f7-e250-4f90-b0f0-022536928045 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:41.686951 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2d4f7-e250-4f90-b0f0-022536928045 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:41.687221 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2d4f7-e250-4f90-b0f0-022536928045 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:41.700177 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2d4f7-e250-4f90-b0f0-022536928045 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:41.704107 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2d4f7-e250-4f90-b0f0-022536928045 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:41.716889 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-b8d2d4f7-e250-4f90-b0f0-022536928045 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:47:41.716889 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:47:41.716889 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:47:41.716889 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:47:41.716889 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:47:41.716889 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:47:41.716889 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:47:41.716889 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:47:41.716889 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:47:41.716889 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:47:41.716889 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:47:41.716889 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:47:41.716889 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:47:41.716889 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:47:41.716889 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:47:41.716889 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:47:41.718019 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:47:41.718019 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:47:41.718019 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:47:41.718019 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:47:41.718019 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:47:41.718019 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:47:41.718019 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:47:41.718019 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:47:41.718019 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:47:41.718019 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:47:41.718019 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:47:41.718019 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:47:41.718019 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:47:41.718019 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:47:41.718019 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:47:41.718019 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:47:41.718019 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:47:41.718941 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:47:41.718941 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:47:41.718941 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:47:41.718941 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 612/1210] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:47:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:47:41.724006 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d54a16-9244-4d6f-84d6-3e8ad77e5f45 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:41.827770 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:41.831300 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d54a16-9244-4d6f-84d6-3e8ad77e5f45 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:41.864844 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519043f-d4e8-463e-8112-905356fbf843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:41.865441 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519043f-d4e8-463e-8112-905356fbf843 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:41.866127 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519043f-d4e8-463e-8112-905356fbf843 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:41.866127 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519043f-d4e8-463e-8112-905356fbf843 None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:41.866592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0519043f-d4e8-463e-8112-905356fbf843 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:47:41.866890 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0519043f-d4e8-463e-8112-905356fbf843 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:41.868317 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0519043f-d4e8-463e-8112-905356fbf843 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:41.880526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 599/1211] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:47:41.887073 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2d4f7-e250-4f90-b0f0-022536928045 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:41.996368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2d4f7-e250-4f90-b0f0-022536928045 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:41.997917 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:42.035070 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9db65-e1e1-40e8-91e6-09440ee127d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:42.035697 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9db65-e1e1-40e8-91e6-09440ee127d1 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:42.035974 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9db65-e1e1-40e8-91e6-09440ee127d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:42.036242 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9db65-e1e1-40e8-91e6-09440ee127d1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:42.044516 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d9db65-e1e1-40e8-91e6-09440ee127d1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:42.045982 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d9db65-e1e1-40e8-91e6-09440ee127d1 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:42.062770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-d7d9db65-e1e1-40e8-91e6-09440ee127d1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 15:47:42.062770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:47:42.062770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:47:42.062770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:47:42.062770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:47:42.062770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:47:42.062770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:47:42.062770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:47:42.062770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:47:42.062770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:47:42.062770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:47:42.062770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:47:42.062770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:47:42.062770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:47:42.062770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:47:42.062770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:47:42.064955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:47:42.064955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:47:42.064955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:47:42.064955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:47:42.064955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:47:42.064955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:47:42.064955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:47:42.064955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:47:42.064955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:47:42.064955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:47:42.064955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:47:42.064955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:47:42.064955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:47:42.064955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:47:42.064955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:47:42.064955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:47:42.064955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:47:42.064955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:47:42.066744 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:47:42.066744 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:47:42.066744 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:47:42.066744 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:47:42.066744 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:47:42.066744 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:47:42.066744 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:47:42.066744 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:47:42.066744 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 15:47:42.066744 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:47:42.066744 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 613/1212] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:47:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:47:42.071222 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519043f-d4e8-463e-8112-905356fbf843 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:42.179207 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519043f-d4e8-463e-8112-905356fbf843 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:42.216919 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e87b6-22c6-4c65-ab1e-0fcad5608e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:42.217531 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e87b6-22c6-4c65-ab1e-0fcad5608e5a None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:42.217806 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e87b6-22c6-4c65-ab1e-0fcad5608e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:42.218073 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e87b6-22c6-4c65-ab1e-0fcad5608e5a None admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:42.218794 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e87b6-22c6-4c65-ab1e-0fcad5608e5a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:47:42.219092 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e87b6-22c6-4c65-ab1e-0fcad5608e5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:42.220566 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e87b6-22c6-4c65-ab1e-0fcad5608e5a None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:42.247043 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 600/1213] 10.222.0.64 () {56 vars in 1143 bytes} [Wed Aug 24 15:47:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:47:42.252915 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9db65-e1e1-40e8-91e6-09440ee127d1 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:42.361864 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9db65-e1e1-40e8-91e6-09440ee127d1 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:42.401001 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa8bff-d9ed-4ea0-93c0-bf585d9afde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:42.401618 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa8bff-d9ed-4ea0-93c0-bf585d9afde5 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:42.402852 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa8bff-d9ed-4ea0-93c0-bf585d9afde5 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:42.403147 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa8bff-d9ed-4ea0-93c0-bf585d9afde5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:42.436897 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:42.483416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa8bff-d9ed-4ea0-93c0-bf585d9afde5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:42.484909 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa8bff-d9ed-4ea0-93c0-bf585d9afde5 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:42.606436 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 614/1214] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:47:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:47:42.612397 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e87b6-22c6-4c65-ab1e-0fcad5608e5a None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:42.631665 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:42.723004 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e87b6-22c6-4c65-ab1e-0fcad5608e5a None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:42.768529 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b850b-56d3-4a5a-9c78-bdbff4c34776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:42.769470 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b850b-56d3-4a5a-9c78-bdbff4c34776 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:42.769470 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b850b-56d3-4a5a-9c78-bdbff4c34776 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:42.769736 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b850b-56d3-4a5a-9c78-bdbff4c34776 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:42.784705 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b850b-56d3-4a5a-9c78-bdbff4c34776 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:42.786722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b850b-56d3-4a5a-9c78-bdbff4c34776 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:42.803407 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-e50b850b-56d3-4a5a-9c78-bdbff4c34776 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:47:42.803407 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:47:42.803407 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:47:42.803407 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:47:42.803407 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:47:42.803407 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:47:42.803407 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:47:42.803407 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:47:42.803407 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:47:42.803407 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:47:42.803407 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:47:42.803407 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:47:42.803407 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:47:42.803407 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:47:42.803407 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:47:42.803407 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:47:42.809320 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:47:42.809320 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:47:42.809320 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:47:42.809320 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:47:42.809320 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:47:42.809320 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:47:42.809320 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:47:42.809320 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:47:42.809320 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:47:42.809320 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:47:42.809320 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:47:42.809320 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:47:42.809320 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:47:42.809320 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:47:42.809320 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:47:42.809320 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:47:42.809320 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:47:42.811398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:47:42.811398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:47:42.811398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:47:42.811398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 601/1215] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:47:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:47:42.813379 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa8bff-d9ed-4ea0-93c0-bf585d9afde5 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:42.890405 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:42.931924 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa8bff-d9ed-4ea0-93c0-bf585d9afde5 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:42.977184 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60111bbc-d446-4d4f-88c2-3570422ced1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:42.977741 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60111bbc-d446-4d4f-88c2-3570422ced1b None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:42.978053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60111bbc-d446-4d4f-88c2-3570422ced1b None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:42.978335 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60111bbc-d446-4d4f-88c2-3570422ced1b None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:42.979031 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60111bbc-d446-4d4f-88c2-3570422ced1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:47:42.979354 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60111bbc-d446-4d4f-88c2-3570422ced1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:42.980880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60111bbc-d446-4d4f-88c2-3570422ced1b None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:42.995127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 615/1216] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:47:43.001357 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b850b-56d3-4a5a-9c78-bdbff4c34776 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:43.070961 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:43.104140 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b850b-56d3-4a5a-9c78-bdbff4c34776 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:43.139926 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0bae56-138a-4a66-b4af-61e6db900895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:43.140543 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bae56-138a-4a66-b4af-61e6db900895 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:43.140848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bae56-138a-4a66-b4af-61e6db900895 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:43.141371 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bae56-138a-4a66-b4af-61e6db900895 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:43.147817 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0bae56-138a-4a66-b4af-61e6db900895 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:43.149328 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0bae56-138a-4a66-b4af-61e6db900895 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:43.161178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-7a0bae56-138a-4a66-b4af-61e6db900895 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:47:43.161178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:47:43.161178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:47:43.161178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:47:43.161178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:47:43.161178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:47:43.161178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:47:43.161178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:47:43.161178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:47:43.161178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:47:43.161178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:47:43.161178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:47:43.161178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:47:43.161178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:47:43.161178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:47:43.162664 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:47:43.162664 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:47:43.162664 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:47:43.162664 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:47:43.162664 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:47:43.162664 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:47:43.162664 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:47:43.162664 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:47:43.162664 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:47:43.162664 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:47:43.162664 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:47:43.162664 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:47:43.162664 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:47:43.162664 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:47:43.162664 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:47:43.162664 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:47:43.162664 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:47:43.164230 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:47:43.164230 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:47:43.164230 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:47:43.164230 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:47:43.164230 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:47:43.164230 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:47:43.164230 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:47:43.164230 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:47:43.164230 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 602/1217] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:47:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:47:43.169438 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60111bbc-d446-4d4f-88c2-3570422ced1b None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:43.278524 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60111bbc-d446-4d4f-88c2-3570422ced1b None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:43.301849 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:43.315000 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56fbec-7578-40ce-a873-e234059c7fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:43.321756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56fbec-7578-40ce-a873-e234059c7fae None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:43.321756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56fbec-7578-40ce-a873-e234059c7fae None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:43.321756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56fbec-7578-40ce-a873-e234059c7fae None admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:43.321756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee56fbec-7578-40ce-a873-e234059c7fae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:47:43.321756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee56fbec-7578-40ce-a873-e234059c7fae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:43.321756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee56fbec-7578-40ce-a873-e234059c7fae None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:43.331564 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 616/1218] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:47:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:47:43.337877 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0bae56-138a-4a66-b4af-61e6db900895 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:43.439276 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0bae56-138a-4a66-b4af-61e6db900895 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:43.468289 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:43.474004 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61ea62-6a49-4803-b7e9-dd91da38e239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:43.474599 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61ea62-6a49-4803-b7e9-dd91da38e239 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:43.474878 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61ea62-6a49-4803-b7e9-dd91da38e239 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:43.475151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61ea62-6a49-4803-b7e9-dd91da38e239 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:43.475862 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61ea62-6a49-4803-b7e9-dd91da38e239 None admin] RBAC: Adding query filter params (role.id=a74cbb295dd8432985940aa21806f970, scope.project.id=9b25a7c01ab540ceae16dd618b848f2d, user.id=4f6907dfd3254d3c97d07ca2fb648858) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:47:43.476174 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61ea62-6a49-4803-b7e9-dd91da38e239 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:43.477675 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61ea62-6a49-4803-b7e9-dd91da38e239 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:43.483043 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 603/1219] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:47:43 2022] GET /identity/v3/role_assignments?user.id=4f6907dfd3254d3c97d07ca2fb648858&scope.project.id=9b25a7c01ab540ceae16dd618b848f2d&role.id=a74cbb295dd8432985940aa21806f970 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:47:45.433317 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049ed08-3353-48f3-8d23-7f51215ef01f None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:45.433885 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049ed08-3353-48f3-8d23-7f51215ef01f None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:45.433885 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049ed08-3353-48f3-8d23-7f51215ef01f None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:45.435228 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 617/1220] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:47:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:47:45.440453 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628c74a-bba1-477b-b2e2-a38fbd49106f None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:45.440910 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628c74a-bba1-477b-b2e2-a38fbd49106f None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:45.441037 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628c74a-bba1-477b-b2e2-a38fbd49106f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:45.459326 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-4628c74a-bba1-477b-b2e2-a38fbd49106f None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:47:45.460491 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-4628c74a-bba1-477b-b2e2-a38fbd49106f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:45.532825 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 604/1221] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:47:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:47:45.812250 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049ed08-3353-48f3-8d23-7f51215ef01f None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:45.917678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049ed08-3353-48f3-8d23-7f51215ef01f None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:45.951965 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41343798-fcac-4fb0-9d1e-ff4035814571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:45.952578 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41343798-fcac-4fb0-9d1e-ff4035814571 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:45.952875 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41343798-fcac-4fb0-9d1e-ff4035814571 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:45.953141 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41343798-fcac-4fb0-9d1e-ff4035814571 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:45.966434 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41343798-fcac-4fb0-9d1e-ff4035814571 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:47:45.971789 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-41343798-fcac-4fb0-9d1e-ff4035814571 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:47:45.971789 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:47:45.971789 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:47:45.971789 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:47:45.971789 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:47:45.971789 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:47:45.971789 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:47:45.971789 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:47:45.971789 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:47:45.971789 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:47:45.971789 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:47:45.971789 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:47:45.971789 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:47:45.971789 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:47:45.971789 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:47:45.971789 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:47:45.972902 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:47:45.972902 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:47:45.972902 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:47:45.972902 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:47:45.972902 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:47:45.972902 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:47:45.972902 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:47:45.972902 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:47:45.972902 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:47:45.972902 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:47:45.972902 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:47:45.972902 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:47:45.972902 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:47:45.972902 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:47:45.972902 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:47:45.972902 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:47:45.973828 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:47:45.973828 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:47:45.973828 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:47:45.973828 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:47:45.973828 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:47:45.973828 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:47:45.973828 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:47:45.973828 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:47:45.973828 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:47:45.973828 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:47:45.973828 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:47:45.973828 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:47:45.973828 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 618/1222] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 24 15:47:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:47:45.979750 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628c74a-bba1-477b-b2e2-a38fbd49106f None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:46.078993 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628c74a-bba1-477b-b2e2-a38fbd49106f None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:46.102360 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:46.112844 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bab9b7-cd2a-416c-9459-3f730f725b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:46.113446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bab9b7-cd2a-416c-9459-3f730f725b7c None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:46.113730 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bab9b7-cd2a-416c-9459-3f730f725b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:46.114002 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bab9b7-cd2a-416c-9459-3f730f725b7c None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:46.114655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bab9b7-cd2a-416c-9459-3f730f725b7c None admin] RBAC: Adding query filter params (name=service) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:47:46.114957 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bab9b7-cd2a-416c-9459-3f730f725b7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:46.116357 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bab9b7-cd2a-416c-9459-3f730f725b7c None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:46.124022 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 605/1223] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 24 15:47:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:47:46.129868 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41343798-fcac-4fb0-9d1e-ff4035814571 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:46.175671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:46.232926 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41343798-fcac-4fb0-9d1e-ff4035814571 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:46.268440 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f72e0a-5828-4055-8c20-88d1eec40ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:46.269093 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f72e0a-5828-4055-8c20-88d1eec40ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:46.269375 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f72e0a-5828-4055-8c20-88d1eec40ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:46.269645 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f72e0a-5828-4055-8c20-88d1eec40ac0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:46.279968 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f72e0a-5828-4055-8c20-88d1eec40ac0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:46.281815 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f72e0a-5828-4055-8c20-88d1eec40ac0 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:46.296929 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-57f72e0a-5828-4055-8c20-88d1eec40ac0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:47:46.296929 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:47:46.296929 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:47:46.296929 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:47:46.296929 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:47:46.296929 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:47:46.296929 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:47:46.296929 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:47:46.296929 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:47:46.296929 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:47:46.296929 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:47:46.296929 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:47:46.296929 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:47:46.296929 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:47:46.296929 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:47:46.296929 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:47:46.298270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:47:46.298270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:47:46.298270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:47:46.298270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:47:46.298270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:47:46.298270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:47:46.298270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:47:46.298270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:47:46.298270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:47:46.298270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:47:46.298270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:47:46.298270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:47:46.298270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:47:46.298270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:47:46.298270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:47:46.298270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:47:46.298270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:47:46.299532 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:47:46.299532 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:47:46.299532 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:47:46.299532 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 619/1224] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:47:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:47:46.304033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bab9b7-cd2a-416c-9459-3f730f725b7c None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:46.408162 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bab9b7-cd2a-416c-9459-3f730f725b7c None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:46.441720 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852bb7f6-1afa-4573-aaf3-284f17e8dea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:46.442314 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852bb7f6-1afa-4573-aaf3-284f17e8dea6 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:46.442593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852bb7f6-1afa-4573-aaf3-284f17e8dea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:46.442863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852bb7f6-1afa-4573-aaf3-284f17e8dea6 None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:46.443502 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852bb7f6-1afa-4573-aaf3-284f17e8dea6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:47:46.443805 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852bb7f6-1afa-4573-aaf3-284f17e8dea6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:46.445237 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852bb7f6-1afa-4573-aaf3-284f17e8dea6 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:46.457604 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 606/1225] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:47:46.463555 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f72e0a-5828-4055-8c20-88d1eec40ac0 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:46.564270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:46.571132 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f72e0a-5828-4055-8c20-88d1eec40ac0 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:46.606694 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578fe66-96ba-4eca-97f3-43dcb5335ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:46.607323 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578fe66-96ba-4eca-97f3-43dcb5335ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:46.607606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578fe66-96ba-4eca-97f3-43dcb5335ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:46.607881 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578fe66-96ba-4eca-97f3-43dcb5335ca4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:46.615238 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578fe66-96ba-4eca-97f3-43dcb5335ca4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:46.616692 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578fe66-96ba-4eca-97f3-43dcb5335ca4 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:46.629316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-a578fe66-96ba-4eca-97f3-43dcb5335ca4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 15:47:46.629316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:47:46.629316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:47:46.629316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:47:46.629316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:47:46.629316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:47:46.629316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:47:46.629316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:47:46.629316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:47:46.629316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:47:46.629316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:47:46.629316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:47:46.629316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:47:46.629316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:47:46.629316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:47:46.629316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:47:46.630476 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:47:46.630476 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:47:46.630476 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:47:46.630476 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:47:46.630476 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:47:46.630476 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:47:46.630476 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:47:46.630476 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:47:46.630476 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:47:46.630476 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:47:46.630476 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:47:46.630476 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:47:46.630476 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:47:46.630476 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:47:46.630476 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:47:46.630476 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:47:46.630476 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:47:46.630476 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:47:46.631696 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:47:46.631696 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:47:46.631696 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:47:46.631696 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:47:46.631696 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:47:46.631696 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:47:46.631696 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:47:46.631696 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:47:46.631696 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 15:47:46.631696 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:47:46.631696 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 620/1226] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:47:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:47:46.636572 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852bb7f6-1afa-4573-aaf3-284f17e8dea6 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:46.684182 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:46.739326 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852bb7f6-1afa-4573-aaf3-284f17e8dea6 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:46.773634 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ddcb3-bb04-4602-a3bb-f966fc0330a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:46.774229 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ddcb3-bb04-4602-a3bb-f966fc0330a9 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:46.774505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ddcb3-bb04-4602-a3bb-f966fc0330a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:46.774776 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ddcb3-bb04-4602-a3bb-f966fc0330a9 None admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:46.775527 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ddcb3-bb04-4602-a3bb-f966fc0330a9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:47:46.775819 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ddcb3-bb04-4602-a3bb-f966fc0330a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:46.777283 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ddcb3-bb04-4602-a3bb-f966fc0330a9 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:46.794899 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 607/1227] 10.222.0.64 () {56 vars in 1143 bytes} [Wed Aug 24 15:47:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:47:46.800817 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578fe66-96ba-4eca-97f3-43dcb5335ca4 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:46.908754 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578fe66-96ba-4eca-97f3-43dcb5335ca4 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:46.942178 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb9b49-0a2a-42a0-a5d3-1170537a9f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:46.942720 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb9b49-0a2a-42a0-a5d3-1170537a9f10 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:46.942991 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb9b49-0a2a-42a0-a5d3-1170537a9f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:46.943256 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb9b49-0a2a-42a0-a5d3-1170537a9f10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:46.954645 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb9b49-0a2a-42a0-a5d3-1170537a9f10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:46.956146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb9b49-0a2a-42a0-a5d3-1170537a9f10 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:46.970792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-1afb9b49-0a2a-42a0-a5d3-1170537a9f10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:47:46.970792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:47:46.970792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:47:46.970792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:47:46.970792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:47:46.970792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:47:46.970792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:47:46.970792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:47:46.970792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:47:46.970792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:47:46.970792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:47:46.970792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:47:46.970792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:47:46.970792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:47:46.970792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:47:46.970792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:47:46.974235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:47:46.974235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:47:46.974235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:47:46.974235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:47:46.974235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:47:46.974235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:47:46.974235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:47:46.974235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:47:46.974235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:47:46.974235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:47:46.974235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:47:46.974235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:47:46.974235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:47:46.974235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:47:46.974235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:47:46.974235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:47:46.974235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:47:46.975400 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:47:46.975400 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:47:46.975400 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:47:46.975400 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 621/1228] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:47:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:47:46.978012 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ddcb3-bb04-4602-a3bb-f966fc0330a9 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:47.082056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ddcb3-bb04-4602-a3bb-f966fc0330a9 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:47.084371 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:47.116644 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a2589-f5ad-41b8-a693-7b1269c4bd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:47.117271 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a2589-f5ad-41b8-a693-7b1269c4bd13 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:47.117550 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a2589-f5ad-41b8-a693-7b1269c4bd13 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:47.117822 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a2589-f5ad-41b8-a693-7b1269c4bd13 None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:47.118453 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a2589-f5ad-41b8-a693-7b1269c4bd13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:47:47.119332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a2589-f5ad-41b8-a693-7b1269c4bd13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:47.120716 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a2589-f5ad-41b8-a693-7b1269c4bd13 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:47.131923 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 608/1229] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:47:47.138685 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb9b49-0a2a-42a0-a5d3-1170537a9f10 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:47.149792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:47.249857 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb9b49-0a2a-42a0-a5d3-1170537a9f10 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:47.284752 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da3645-7d7e-4997-9ad9-e3dfd0fea284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:47.285404 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da3645-7d7e-4997-9ad9-e3dfd0fea284 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:47.285684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da3645-7d7e-4997-9ad9-e3dfd0fea284 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:47.285955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da3645-7d7e-4997-9ad9-e3dfd0fea284 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:47.292571 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da3645-7d7e-4997-9ad9-e3dfd0fea284 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:47.294219 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da3645-7d7e-4997-9ad9-e3dfd0fea284 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:47.305316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-35da3645-7d7e-4997-9ad9-e3dfd0fea284 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:47:47.305316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:47:47.305316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:47:47.305316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:47:47.305316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:47:47.305316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:47:47.305316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:47:47.305316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:47:47.305316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:47:47.305316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:47:47.305316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:47:47.305316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:47:47.305316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:47:47.305316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:47:47.305316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:47:47.307052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:47:47.307052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:47:47.307052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:47:47.307052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:47:47.307052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:47:47.307052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:47:47.307052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:47:47.307052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:47:47.307052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:47:47.307052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:47:47.307052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:47:47.307052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:47:47.307052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:47:47.307052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:47:47.307052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:47:47.307052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:47:47.307052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:47:47.308346 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:47:47.308346 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:47:47.308346 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:47:47.308346 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:47:47.308346 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:47:47.308346 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:47:47.308346 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:47:47.308346 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:47:47.308346 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 622/1230] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:47:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:47:47.312961 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a2589-f5ad-41b8-a693-7b1269c4bd13 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:47.422781 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a2589-f5ad-41b8-a693-7b1269c4bd13 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:47.458749 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497ee25-89d9-49ea-9062-7155ee57ae5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:47.459775 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497ee25-89d9-49ea-9062-7155ee57ae5d None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:47.460079 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497ee25-89d9-49ea-9062-7155ee57ae5d None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:47.460463 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497ee25-89d9-49ea-9062-7155ee57ae5d None admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:47.461287 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4497ee25-89d9-49ea-9062-7155ee57ae5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:47:47.461706 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4497ee25-89d9-49ea-9062-7155ee57ae5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:47.463425 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4497ee25-89d9-49ea-9062-7155ee57ae5d None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:47.475378 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 609/1231] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:47:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:47:47.482731 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da3645-7d7e-4997-9ad9-e3dfd0fea284 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:47.551875 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:47.590869 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da3645-7d7e-4997-9ad9-e3dfd0fea284 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:47.627309 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed3298-36d5-429d-8694-afe9c4097bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:47.627955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed3298-36d5-429d-8694-afe9c4097bc1 None admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:47.628235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed3298-36d5-429d-8694-afe9c4097bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:47.628505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed3298-36d5-429d-8694-afe9c4097bc1 None admin] PATH_INFO: `/v3/projects/9b25a7c01ab540ceae16dd618b848f2d/users/4f6907dfd3254d3c97d07ca2fb648858/roles/a74cbb295dd8432985940aa21806f970` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:47.643181 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed3298-36d5-429d-8694-afe9c4097bc1 None admin] RBAC: Authorizing `identity:create_grant(project_id=9b25a7c01ab540ceae16dd618b848f2d, user_id=4f6907dfd3254d3c97d07ca2fb648858, role_id=a74cbb295dd8432985940aa21806f970)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:47.644646 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed3298-36d5-429d-8694-afe9c4097bc1 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:47.755210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 623/1232] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 24 15:47:47 2022] PUT /identity/v3/projects/9b25a7c01ab540ceae16dd618b848f2d/users/4f6907dfd3254d3c97d07ca2fb648858/roles/a74cbb295dd8432985940aa21806f970 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:47:49.719798 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f9e05-3923-412b-8f11-d11c0f62f796 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:49.720356 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f9e05-3923-412b-8f11-d11c0f62f796 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:49.720356 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f9e05-3923-412b-8f11-d11c0f62f796 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:49.721720 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 610/1233] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:47:49.727234 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00d042-015f-4892-880b-f8687b9f3687 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:49.727634 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00d042-015f-4892-880b-f8687b9f3687 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:49.727790 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00d042-015f-4892-880b-f8687b9f3687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:49.746260 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-ce00d042-015f-4892-880b-f8687b9f3687 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:47:49.747465 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-ce00d042-015f-4892-880b-f8687b9f3687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:49.814199 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 624/1234] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:47:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:47:50.090722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f9e05-3923-412b-8f11-d11c0f62f796 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:50.121763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:50.206373 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f9e05-3923-412b-8f11-d11c0f62f796 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:50.239066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749a682-7bbc-4d23-8c85-d235d0e28edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:50.239681 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749a682-7bbc-4d23-8c85-d235d0e28edb None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:50.239959 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749a682-7bbc-4d23-8c85-d235d0e28edb None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:50.240224 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749a682-7bbc-4d23-8c85-d235d0e28edb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:50.250517 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749a682-7bbc-4d23-8c85-d235d0e28edb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:47:50.255056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-a749a682-7bbc-4d23-8c85-d235d0e28edb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:47:50.255056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:47:50.255056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:47:50.255056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:47:50.255056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:47:50.255056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:47:50.255056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:47:50.255056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:47:50.255056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:47:50.255056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:47:50.255056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:47:50.255056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:47:50.255056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:47:50.255056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:47:50.255056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:47:50.255056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:47:50.259864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:47:50.259864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:47:50.259864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:47:50.259864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:47:50.259864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:47:50.259864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:47:50.259864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:47:50.259864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:47:50.259864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:47:50.259864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:47:50.259864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:47:50.259864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:47:50.259864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:47:50.259864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:47:50.259864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:47:50.259864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:47:50.262137 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:47:50.262137 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:47:50.262137 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:47:50.262137 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:47:50.262137 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:47:50.262137 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:47:50.262137 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:47:50.262137 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:47:50.262137 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:47:50.262137 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:47:50.262137 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:47:50.262137 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:47:50.262137 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 611/1235] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 24 15:47:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:47:50.263135 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00d042-015f-4892-880b-f8687b9f3687 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:50.313813 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:50.369003 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00d042-015f-4892-880b-f8687b9f3687 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:50.407121 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35324549-2527-4a15-b6ed-d91167fb6530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:50.407727 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35324549-2527-4a15-b6ed-d91167fb6530 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:50.408030 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35324549-2527-4a15-b6ed-d91167fb6530 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:50.408304 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35324549-2527-4a15-b6ed-d91167fb6530 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:50.409000 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35324549-2527-4a15-b6ed-d91167fb6530 None admin] RBAC: Adding query filter params (name=service) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:47:50.409330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35324549-2527-4a15-b6ed-d91167fb6530 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:50.410778 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35324549-2527-4a15-b6ed-d91167fb6530 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:50.418847 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 625/1236] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 24 15:47:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:47:50.424614 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749a682-7bbc-4d23-8c85-d235d0e28edb None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:50.510507 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:50.526829 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749a682-7bbc-4d23-8c85-d235d0e28edb None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:50.561037 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98173a84-04d3-4500-a9a9-f48502b49dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:50.561696 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98173a84-04d3-4500-a9a9-f48502b49dec None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:50.561977 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98173a84-04d3-4500-a9a9-f48502b49dec None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:50.562254 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98173a84-04d3-4500-a9a9-f48502b49dec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:50.573726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98173a84-04d3-4500-a9a9-f48502b49dec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:50.575315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98173a84-04d3-4500-a9a9-f48502b49dec None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:50.591455 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-98173a84-04d3-4500-a9a9-f48502b49dec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:47:50.591455 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:47:50.591455 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:47:50.591455 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:47:50.591455 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:47:50.591455 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:47:50.591455 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:47:50.591455 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:47:50.591455 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:47:50.591455 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:47:50.591455 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:47:50.591455 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:47:50.591455 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:47:50.591455 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:47:50.591455 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:47:50.591455 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:47:50.592643 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:47:50.592643 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:47:50.592643 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:47:50.592643 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:47:50.592643 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:47:50.592643 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:47:50.592643 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:47:50.592643 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:47:50.592643 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:47:50.592643 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:47:50.592643 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:47:50.592643 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:47:50.592643 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:47:50.592643 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:47:50.592643 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:47:50.592643 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:47:50.592643 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:47:50.593909 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:47:50.593909 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:47:50.593909 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:47:50.593909 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 612/1237] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:47:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:47:50.599344 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35324549-2527-4a15-b6ed-d91167fb6530 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:50.701452 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35324549-2527-4a15-b6ed-d91167fb6530 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:50.710526 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:50.736237 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8e483-f168-4c40-b199-bed16e0f903c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:50.736871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8e483-f168-4c40-b199-bed16e0f903c None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:50.737128 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8e483-f168-4c40-b199-bed16e0f903c None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:50.737394 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8e483-f168-4c40-b199-bed16e0f903c None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:50.738037 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f8e483-f168-4c40-b199-bed16e0f903c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:47:50.738327 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f8e483-f168-4c40-b199-bed16e0f903c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:50.739686 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f8e483-f168-4c40-b199-bed16e0f903c None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:50.751618 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 626/1238] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:47:50.757770 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98173a84-04d3-4500-a9a9-f48502b49dec None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:50.862326 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98173a84-04d3-4500-a9a9-f48502b49dec None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:50.896488 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75553b9d-9c4d-4dc7-82eb-b500f4f5c675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:50.897228 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75553b9d-9c4d-4dc7-82eb-b500f4f5c675 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:50.897572 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75553b9d-9c4d-4dc7-82eb-b500f4f5c675 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:50.897900 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75553b9d-9c4d-4dc7-82eb-b500f4f5c675 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:50.901277 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:50.906284 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75553b9d-9c4d-4dc7-82eb-b500f4f5c675 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:50.907844 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75553b9d-9c4d-4dc7-82eb-b500f4f5c675 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:50.919190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-75553b9d-9c4d-4dc7-82eb-b500f4f5c675 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 15:47:50.919190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:47:50.919190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:47:50.919190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:47:50.919190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:47:50.919190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:47:50.919190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:47:50.919190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:47:50.919190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:47:50.919190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:47:50.919190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:47:50.919190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:47:50.919190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:47:50.919190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:47:50.919190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:47:50.919190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:47:50.925508 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:47:50.925508 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:47:50.925508 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:47:50.925508 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:47:50.925508 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:47:50.925508 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:47:50.925508 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:47:50.925508 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:47:50.925508 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:47:50.925508 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:47:50.925508 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:47:50.925508 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:47:50.925508 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:47:50.925508 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:47:50.925508 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:47:50.925508 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:47:50.925508 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:47:50.925508 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:47:50.926658 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:47:50.926658 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:47:50.926658 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:47:50.926658 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:47:50.926658 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:47:50.926658 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:47:50.926658 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:47:50.926658 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:47:50.926658 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 15:47:50.926658 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:47:50.926658 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 613/1239] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:47:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:47:50.927345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8e483-f168-4c40-b199-bed16e0f903c None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:51.027814 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8e483-f168-4c40-b199-bed16e0f903c None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:51.063125 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e58f2-d303-4cfb-b52a-2e1d117e6237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:51.063635 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e58f2-d303-4cfb-b52a-2e1d117e6237 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:51.063913 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e58f2-d303-4cfb-b52a-2e1d117e6237 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:51.064181 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e58f2-d303-4cfb-b52a-2e1d117e6237 None admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:51.064987 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e58f2-d303-4cfb-b52a-2e1d117e6237 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:47:51.065291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e58f2-d303-4cfb-b52a-2e1d117e6237 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:51.066716 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e58f2-d303-4cfb-b52a-2e1d117e6237 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:51.083793 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 627/1240] 10.222.0.64 () {56 vars in 1143 bytes} [Wed Aug 24 15:47:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:47:51.090369 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75553b9d-9c4d-4dc7-82eb-b500f4f5c675 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:51.195971 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75553b9d-9c4d-4dc7-82eb-b500f4f5c675 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:51.235243 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6843ca-3659-44b6-8159-6fcc81ef116f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:51.235854 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6843ca-3659-44b6-8159-6fcc81ef116f None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:51.236137 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6843ca-3659-44b6-8159-6fcc81ef116f None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:51.236443 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6843ca-3659-44b6-8159-6fcc81ef116f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:51.301707 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:51.311348 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6843ca-3659-44b6-8159-6fcc81ef116f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:51.315105 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6843ca-3659-44b6-8159-6fcc81ef116f None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:51.410694 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 614/1241] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:47:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:47:51.416832 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e58f2-d303-4cfb-b52a-2e1d117e6237 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:51.443818 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:51.520791 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e58f2-d303-4cfb-b52a-2e1d117e6237 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:51.554042 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba117e70-1075-4511-b6b0-d14fb5d4abb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:51.554620 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba117e70-1075-4511-b6b0-d14fb5d4abb9 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:51.554896 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba117e70-1075-4511-b6b0-d14fb5d4abb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:51.555176 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba117e70-1075-4511-b6b0-d14fb5d4abb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:51.565612 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba117e70-1075-4511-b6b0-d14fb5d4abb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:51.567039 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba117e70-1075-4511-b6b0-d14fb5d4abb9 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:51.581979 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-ba117e70-1075-4511-b6b0-d14fb5d4abb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:47:51.581979 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:47:51.581979 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:47:51.581979 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:47:51.581979 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:47:51.581979 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:47:51.581979 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:47:51.581979 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:47:51.581979 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:47:51.581979 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:47:51.581979 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:47:51.581979 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:47:51.581979 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:47:51.581979 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:47:51.581979 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:47:51.581979 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:47:51.583502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:47:51.583502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:47:51.583502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:47:51.583502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:47:51.583502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:47:51.583502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:47:51.583502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:47:51.583502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:47:51.583502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:47:51.583502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:47:51.583502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:47:51.583502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:47:51.583502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:47:51.583502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:47:51.583502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:47:51.583502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:47:51.583502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:47:51.585209 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:47:51.585209 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:47:51.585209 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:47:51.585209 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 628/1242] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:47:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:47:51.590557 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6843ca-3659-44b6-8159-6fcc81ef116f None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:51.683007 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:51.689380 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6843ca-3659-44b6-8159-6fcc81ef116f None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:51.725459 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654231d-8d56-48c7-b7aa-2d7fa2c6f04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:51.726061 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654231d-8d56-48c7-b7aa-2d7fa2c6f04a None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:51.726340 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654231d-8d56-48c7-b7aa-2d7fa2c6f04a None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:51.726617 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654231d-8d56-48c7-b7aa-2d7fa2c6f04a None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:51.727247 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654231d-8d56-48c7-b7aa-2d7fa2c6f04a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:47:51.727549 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654231d-8d56-48c7-b7aa-2d7fa2c6f04a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:51.728993 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654231d-8d56-48c7-b7aa-2d7fa2c6f04a None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:51.740111 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 615/1243] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:47:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:47:51.746787 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba117e70-1075-4511-b6b0-d14fb5d4abb9 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:51.837076 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:51.858760 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba117e70-1075-4511-b6b0-d14fb5d4abb9 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:51.901304 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ce2f0-6c82-4841-9da9-442722c8d9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:51.902055 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ce2f0-6c82-4841-9da9-442722c8d9c5 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:51.902339 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ce2f0-6c82-4841-9da9-442722c8d9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:51.902614 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ce2f0-6c82-4841-9da9-442722c8d9c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:51.909226 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ce2f0-6c82-4841-9da9-442722c8d9c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:51.910650 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ce2f0-6c82-4841-9da9-442722c8d9c5 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:51.922587 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-b06ce2f0-6c82-4841-9da9-442722c8d9c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:47:51.922587 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:47:51.922587 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:47:51.922587 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:47:51.922587 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:47:51.922587 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:47:51.922587 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:47:51.922587 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:47:51.922587 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:47:51.922587 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:47:51.922587 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:47:51.922587 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:47:51.922587 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:47:51.922587 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:47:51.922587 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:47:51.923713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:47:51.923713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:47:51.923713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:47:51.923713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:47:51.923713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:47:51.923713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:47:51.923713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:47:51.923713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:47:51.923713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:47:51.923713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:47:51.923713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:47:51.923713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:47:51.923713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:47:51.923713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:47:51.923713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:47:51.923713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:47:51.923713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:47:51.924836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:47:51.924836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:47:51.924836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:47:51.924836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:47:51.924836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:47:51.924836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:47:51.924836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:47:51.924836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:47:51.924836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 629/1244] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:47:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:47:51.929585 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654231d-8d56-48c7-b7aa-2d7fa2c6f04a None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:52.033011 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654231d-8d56-48c7-b7aa-2d7fa2c6f04a None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:52.067294 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475d767-e8d5-4fea-b7e7-265ed8ab6d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:52.067894 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475d767-e8d5-4fea-b7e7-265ed8ab6d6f None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:52.068169 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475d767-e8d5-4fea-b7e7-265ed8ab6d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:52.068461 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475d767-e8d5-4fea-b7e7-265ed8ab6d6f None admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:52.069154 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475d767-e8d5-4fea-b7e7-265ed8ab6d6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:47:52.069455 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475d767-e8d5-4fea-b7e7-265ed8ab6d6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:52.070900 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475d767-e8d5-4fea-b7e7-265ed8ab6d6f None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:52.084987 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 616/1245] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:47:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:47:52.091308 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ce2f0-6c82-4841-9da9-442722c8d9c5 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:52.199558 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ce2f0-6c82-4841-9da9-442722c8d9c5 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:52.236969 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33e747-e41b-4eaf-97c8-54b18b3a3756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:52.237572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33e747-e41b-4eaf-97c8-54b18b3a3756 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:52.237856 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33e747-e41b-4eaf-97c8-54b18b3a3756 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:52.238129 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33e747-e41b-4eaf-97c8-54b18b3a3756 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:52.238861 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33e747-e41b-4eaf-97c8-54b18b3a3756 None admin] RBAC: Adding query filter params (role.id=a74cbb295dd8432985940aa21806f970, scope.project.id=9b25a7c01ab540ceae16dd618b848f2d, user.id=4f6907dfd3254d3c97d07ca2fb648858) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:47:52.239222 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33e747-e41b-4eaf-97c8-54b18b3a3756 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:52.240659 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33e747-e41b-4eaf-97c8-54b18b3a3756 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:52.246499 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 630/1246] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:47:52 2022] GET /identity/v3/role_assignments?user.id=4f6907dfd3254d3c97d07ca2fb648858&scope.project.id=9b25a7c01ab540ceae16dd618b848f2d&role.id=a74cbb295dd8432985940aa21806f970 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:47:54.258299 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af099a1-c9e1-49f8-8c26-08db76b088f2 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:54.258828 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af099a1-c9e1-49f8-8c26-08db76b088f2 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:54.258828 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af099a1-c9e1-49f8-8c26-08db76b088f2 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:54.260458 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 617/1247] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:47:54.265944 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695567a-8ea1-471a-99a6-f5b67f665528 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:54.266369 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695567a-8ea1-471a-99a6-f5b67f665528 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:54.266475 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695567a-8ea1-471a-99a6-f5b67f665528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:54.273775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:54.288039 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-3695567a-8ea1-471a-99a6-f5b67f665528 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:47:54.289267 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-3695567a-8ea1-471a-99a6-f5b67f665528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:54.358424 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 631/1248] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:47:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:47:54.637679 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af099a1-c9e1-49f8-8c26-08db76b088f2 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:54.656546 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:54.739136 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af099a1-c9e1-49f8-8c26-08db76b088f2 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:54.773082 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2670b5-86c6-4877-a01e-9724d725defb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:54.773705 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2670b5-86c6-4877-a01e-9724d725defb None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:54.774003 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2670b5-86c6-4877-a01e-9724d725defb None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:54.774296 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2670b5-86c6-4877-a01e-9724d725defb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:54.785003 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2670b5-86c6-4877-a01e-9724d725defb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:47:54.789816 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-8f2670b5-86c6-4877-a01e-9724d725defb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:47:54.789816 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:47:54.789816 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:47:54.789816 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:47:54.789816 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:47:54.789816 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:47:54.789816 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:47:54.789816 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:47:54.789816 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:47:54.789816 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:47:54.789816 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:47:54.789816 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:47:54.789816 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:47:54.789816 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:47:54.789816 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:47:54.789816 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:47:54.791991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:47:54.791991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:47:54.791991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:47:54.791991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:47:54.791991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:47:54.791991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:47:54.791991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:47:54.791991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:47:54.791991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:47:54.791991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:47:54.791991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:47:54.791991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:47:54.791991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:47:54.791991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:47:54.791991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:47:54.791991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:47:54.793471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:47:54.793471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:47:54.793471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:47:54.793471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:47:54.793471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:47:54.793471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:47:54.793471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:47:54.793471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:47:54.793471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:47:54.793471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:47:54.793471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:47:54.793471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:47:54.793471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 618/1249] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:47:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:47:54.797624 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695567a-8ea1-471a-99a6-f5b67f665528 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:54.901123 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695567a-8ea1-471a-99a6-f5b67f665528 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:54.930806 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:54.936060 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f632d1-59eb-4046-bb69-7f4e235c4587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:54.936698 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f632d1-59eb-4046-bb69-7f4e235c4587 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:54.936980 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f632d1-59eb-4046-bb69-7f4e235c4587 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:54.937251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f632d1-59eb-4046-bb69-7f4e235c4587 None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:54.937921 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f632d1-59eb-4046-bb69-7f4e235c4587 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:47:54.938285 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f632d1-59eb-4046-bb69-7f4e235c4587 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:54.939602 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f632d1-59eb-4046-bb69-7f4e235c4587 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:54.948317 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 632/1250] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:47:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:47:54.955717 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2670b5-86c6-4877-a01e-9724d725defb None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:55.034732 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:55.057783 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2670b5-86c6-4877-a01e-9724d725defb None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:55.091960 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0296e-8132-4341-90bd-9ed3e0a72625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:55.097722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0296e-8132-4341-90bd-9ed3e0a72625 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:55.097722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0296e-8132-4341-90bd-9ed3e0a72625 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:55.097722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0296e-8132-4341-90bd-9ed3e0a72625 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:55.103442 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0296e-8132-4341-90bd-9ed3e0a72625 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:55.104931 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0296e-8132-4341-90bd-9ed3e0a72625 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:55.120325 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-c2e0296e-8132-4341-90bd-9ed3e0a72625 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:47:55.120325 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:47:55.120325 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:47:55.120325 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:47:55.120325 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:47:55.120325 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:47:55.120325 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:47:55.120325 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:47:55.120325 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:47:55.120325 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:47:55.120325 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:47:55.120325 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:47:55.120325 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:47:55.120325 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:47:55.120325 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:47:55.120325 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:47:55.121481 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:47:55.121481 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:47:55.121481 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:47:55.121481 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:47:55.121481 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:47:55.121481 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:47:55.121481 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:47:55.121481 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:47:55.121481 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:47:55.121481 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:47:55.121481 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:47:55.121481 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:47:55.121481 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:47:55.121481 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:47:55.121481 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:47:55.121481 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:47:55.121481 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:47:55.122608 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:47:55.122608 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:47:55.122608 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:47:55.122608 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 619/1251] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:47:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:47:55.127403 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f632d1-59eb-4046-bb69-7f4e235c4587 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:55.233500 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f632d1-59eb-4046-bb69-7f4e235c4587 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:55.268327 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af766d-1c5f-4904-a30b-84566646e335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:55.269095 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af766d-1c5f-4904-a30b-84566646e335 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:55.269238 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af766d-1c5f-4904-a30b-84566646e335 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:55.269519 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af766d-1c5f-4904-a30b-84566646e335 None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:55.270160 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af766d-1c5f-4904-a30b-84566646e335 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:47:55.270458 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af766d-1c5f-4904-a30b-84566646e335 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:55.271896 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af766d-1c5f-4904-a30b-84566646e335 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:55.285880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 633/1252] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:47:55.293298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0296e-8132-4341-90bd-9ed3e0a72625 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:55.395448 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0296e-8132-4341-90bd-9ed3e0a72625 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:55.422184 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:55.429769 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686e309-dc9a-4c4f-a953-ac2017c5d52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:55.430390 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686e309-dc9a-4c4f-a953-ac2017c5d52e None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:55.430672 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686e309-dc9a-4c4f-a953-ac2017c5d52e None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:55.430972 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686e309-dc9a-4c4f-a953-ac2017c5d52e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:55.438217 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686e309-dc9a-4c4f-a953-ac2017c5d52e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:55.439629 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686e309-dc9a-4c4f-a953-ac2017c5d52e None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:55.450513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-8686e309-dc9a-4c4f-a953-ac2017c5d52e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 15:47:55.450513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:47:55.450513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:47:55.450513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:47:55.450513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:47:55.450513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:47:55.450513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:47:55.450513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:47:55.450513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:47:55.450513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:47:55.450513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:47:55.450513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:47:55.450513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:47:55.450513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:47:55.450513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:47:55.450513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:47:55.451638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:47:55.451638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:47:55.451638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:47:55.451638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:47:55.451638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:47:55.451638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:47:55.451638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:47:55.451638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:47:55.451638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:47:55.451638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:47:55.451638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:47:55.451638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:47:55.451638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:47:55.451638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:47:55.451638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:47:55.451638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:47:55.451638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:47:55.451638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:47:55.452793 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:47:55.452793 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:47:55.452793 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:47:55.452793 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:47:55.452793 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:47:55.452793 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:47:55.452793 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:47:55.452793 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:47:55.452793 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 15:47:55.452793 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:47:55.452793 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 620/1253] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:47:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:47:55.457653 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af766d-1c5f-4904-a30b-84566646e335 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:55.516234 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:55.560150 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af766d-1c5f-4904-a30b-84566646e335 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:55.593518 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9f761-7458-4551-a586-0d2e82fcc339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:55.594125 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9f761-7458-4551-a586-0d2e82fcc339 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:55.594458 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9f761-7458-4551-a586-0d2e82fcc339 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:55.594681 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9f761-7458-4551-a586-0d2e82fcc339 None admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:55.595387 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9f761-7458-4551-a586-0d2e82fcc339 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:47:55.595681 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9f761-7458-4551-a586-0d2e82fcc339 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:55.597145 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9f761-7458-4551-a586-0d2e82fcc339 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:55.615134 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 634/1254] 10.222.0.64 () {56 vars in 1143 bytes} [Wed Aug 24 15:47:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:47:55.621506 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686e309-dc9a-4c4f-a953-ac2017c5d52e None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:55.722767 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686e309-dc9a-4c4f-a953-ac2017c5d52e None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:55.756760 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fb7d6-7eb2-42ee-b360-f01020b0b9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:55.757368 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fb7d6-7eb2-42ee-b360-f01020b0b9ca None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:55.757716 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fb7d6-7eb2-42ee-b360-f01020b0b9ca None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:55.757939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fb7d6-7eb2-42ee-b360-f01020b0b9ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:55.816422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:55.829145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1fb7d6-7eb2-42ee-b360-f01020b0b9ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:55.832495 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1fb7d6-7eb2-42ee-b360-f01020b0b9ca None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:55.929701 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 621/1255] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:47:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:47:55.935919 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9f761-7458-4551-a586-0d2e82fcc339 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:56.039540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9f761-7458-4551-a586-0d2e82fcc339 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:56.054287 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:56.076850 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53ac29-2441-4cf2-9348-f0940a1539a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:56.077429 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53ac29-2441-4cf2-9348-f0940a1539a7 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:56.077712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53ac29-2441-4cf2-9348-f0940a1539a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:56.077984 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53ac29-2441-4cf2-9348-f0940a1539a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:56.088644 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53ac29-2441-4cf2-9348-f0940a1539a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:56.090376 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53ac29-2441-4cf2-9348-f0940a1539a7 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:56.105181 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-0c53ac29-2441-4cf2-9348-f0940a1539a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:47:56.105181 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:47:56.105181 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:47:56.105181 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:47:56.105181 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:47:56.105181 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:47:56.105181 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:47:56.105181 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:47:56.105181 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:47:56.105181 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:47:56.105181 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:47:56.105181 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:47:56.105181 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:47:56.105181 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:47:56.105181 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:47:56.105181 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:47:56.107037 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:47:56.107037 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:47:56.107037 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:47:56.107037 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:47:56.107037 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:47:56.107037 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:47:56.107037 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:47:56.107037 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:47:56.107037 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:47:56.107037 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:47:56.107037 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:47:56.107037 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:47:56.107037 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:47:56.107037 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:47:56.107037 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:47:56.107037 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:47:56.107037 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:47:56.109111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:47:56.109111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:47:56.109111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:47:56.109111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 635/1256] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:47:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:47:56.113616 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fb7d6-7eb2-42ee-b360-f01020b0b9ca None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:56.204733 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:56.217750 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fb7d6-7eb2-42ee-b360-f01020b0b9ca None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:56.252208 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf145e9-fdeb-4e03-9b20-4d165cd77541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:56.252836 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf145e9-fdeb-4e03-9b20-4d165cd77541 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:56.253115 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf145e9-fdeb-4e03-9b20-4d165cd77541 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:56.253384 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf145e9-fdeb-4e03-9b20-4d165cd77541 None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:56.254019 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf145e9-fdeb-4e03-9b20-4d165cd77541 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:47:56.254318 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf145e9-fdeb-4e03-9b20-4d165cd77541 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:56.255768 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf145e9-fdeb-4e03-9b20-4d165cd77541 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:56.267464 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 622/1257] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:47:56.273338 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53ac29-2441-4cf2-9348-f0940a1539a7 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:56.379124 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53ac29-2441-4cf2-9348-f0940a1539a7 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:56.412639 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b27b5-aac0-4510-8b9f-fb49f73bc682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:56.413266 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b27b5-aac0-4510-8b9f-fb49f73bc682 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:56.413543 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b27b5-aac0-4510-8b9f-fb49f73bc682 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:56.413816 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b27b5-aac0-4510-8b9f-fb49f73bc682 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:56.421044 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b27b5-aac0-4510-8b9f-fb49f73bc682 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:56.422469 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b27b5-aac0-4510-8b9f-fb49f73bc682 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:56.434254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-4b8b27b5-aac0-4510-8b9f-fb49f73bc682 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:47:56.434254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:47:56.434254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:47:56.434254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:47:56.434254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:47:56.434254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:47:56.434254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:47:56.434254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:47:56.434254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:47:56.434254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:47:56.434254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:47:56.434254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:47:56.434254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:47:56.434254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:47:56.434254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:47:56.435301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:47:56.435301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:47:56.435301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:47:56.435301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:47:56.435301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:47:56.435301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:47:56.435301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:47:56.435301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:47:56.435301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:47:56.435301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:47:56.435301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:47:56.435301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:47:56.435301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:47:56.435301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:47:56.435301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:47:56.435301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:47:56.435301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:47:56.436227 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:47:56.436227 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:47:56.436227 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:47:56.436227 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:47:56.436227 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:47:56.436227 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:47:56.436227 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:47:56.436227 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:47:56.436227 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 636/1258] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:47:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:47:56.441559 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf145e9-fdeb-4e03-9b20-4d165cd77541 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:56.543929 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf145e9-fdeb-4e03-9b20-4d165cd77541 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:56.578717 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ff668-7fcc-43ba-82dc-61eccdd1baf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:56.579323 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ff668-7fcc-43ba-82dc-61eccdd1baf7 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:56.579603 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ff668-7fcc-43ba-82dc-61eccdd1baf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:56.579876 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ff668-7fcc-43ba-82dc-61eccdd1baf7 None admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:56.580667 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ff668-7fcc-43ba-82dc-61eccdd1baf7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:47:56.581029 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ff668-7fcc-43ba-82dc-61eccdd1baf7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:56.582490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ff668-7fcc-43ba-82dc-61eccdd1baf7 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:56.594762 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 623/1259] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:47:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:47:56.601327 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b27b5-aac0-4510-8b9f-fb49f73bc682 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:56.630041 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:56.704994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b27b5-aac0-4510-8b9f-fb49f73bc682 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:56.740325 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bfe5d0-a867-4351-b22a-f4dc8fb8567a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:56.740954 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfe5d0-a867-4351-b22a-f4dc8fb8567a None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:56.741235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfe5d0-a867-4351-b22a-f4dc8fb8567a None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:56.741511 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfe5d0-a867-4351-b22a-f4dc8fb8567a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:56.742228 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bfe5d0-a867-4351-b22a-f4dc8fb8567a None admin] RBAC: Adding query filter params (role.id=c6745e08f9da4a2bae8510c9983635c3, scope.project.id=9b25a7c01ab540ceae16dd618b848f2d, user.id=4f6907dfd3254d3c97d07ca2fb648858) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:47:56.742532 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bfe5d0-a867-4351-b22a-f4dc8fb8567a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:56.744014 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bfe5d0-a867-4351-b22a-f4dc8fb8567a None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:56.749430 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 637/1260] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:47:56 2022] GET /identity/v3/role_assignments?user.id=4f6907dfd3254d3c97d07ca2fb648858&scope.project.id=9b25a7c01ab540ceae16dd618b848f2d&role.id=c6745e08f9da4a2bae8510c9983635c3 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:47:58.654533 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58047dd2-0a8f-4d33-a194-492646b9e63c None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:58.655046 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58047dd2-0a8f-4d33-a194-492646b9e63c None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:58.655046 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58047dd2-0a8f-4d33-a194-492646b9e63c None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:58.656362 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 624/1261] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:47:58.661603 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821756e-8aeb-4d1b-9e32-57e2e489c53a None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:58.662049 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821756e-8aeb-4d1b-9e32-57e2e489c53a None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:58.662186 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821756e-8aeb-4d1b-9e32-57e2e489c53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:58.680679 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-e821756e-8aeb-4d1b-9e32-57e2e489c53a None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:47:58.681856 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-e821756e-8aeb-4d1b-9e32-57e2e489c53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:58.750845 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 638/1262] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:47:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:47:59.023775 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58047dd2-0a8f-4d33-a194-492646b9e63c None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:59.034712 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:59.127551 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58047dd2-0a8f-4d33-a194-492646b9e63c None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:59.161823 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f27693-191c-4849-a2ff-15f735d7b3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:59.162440 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f27693-191c-4849-a2ff-15f735d7b3cd None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:59.162716 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f27693-191c-4849-a2ff-15f735d7b3cd None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:59.162982 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f27693-191c-4849-a2ff-15f735d7b3cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:59.173106 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f27693-191c-4849-a2ff-15f735d7b3cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:47:59.177714 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-a5f27693-191c-4849-a2ff-15f735d7b3cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:47:59.177714 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:47:59.177714 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:47:59.177714 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:47:59.177714 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:47:59.177714 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:47:59.177714 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:47:59.177714 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:47:59.177714 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:47:59.177714 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:47:59.177714 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:47:59.177714 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:47:59.177714 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:47:59.177714 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:47:59.177714 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:47:59.177714 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:47:59.178863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:47:59.178863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:47:59.178863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:47:59.178863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:47:59.178863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:47:59.178863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:47:59.178863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:47:59.178863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:47:59.178863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:47:59.178863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:47:59.178863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:47:59.178863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:47:59.178863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:47:59.178863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:47:59.178863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:47:59.178863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:47:59.179772 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:47:59.179772 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:47:59.179772 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:47:59.179772 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:47:59.179772 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:47:59.179772 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:47:59.179772 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:47:59.179772 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:47:59.179772 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:47:59.179772 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:47:59.179772 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:47:59.179772 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:47:59.179772 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 625/1263] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:47:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:47:59.186021 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821756e-8aeb-4d1b-9e32-57e2e489c53a None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:59.206127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:59.289950 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821756e-8aeb-4d1b-9e32-57e2e489c53a None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:59.327030 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d41ab-d146-48fa-9c05-8034561b79bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:59.327841 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d41ab-d146-48fa-9c05-8034561b79bd None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:59.328207 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d41ab-d146-48fa-9c05-8034561b79bd None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:59.328566 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d41ab-d146-48fa-9c05-8034561b79bd None admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:59.329349 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d41ab-d146-48fa-9c05-8034561b79bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:47:59.329798 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d41ab-d146-48fa-9c05-8034561b79bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:59.331383 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d41ab-d146-48fa-9c05-8034561b79bd None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:59.339591 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 639/1264] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:47:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:47:59.345442 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f27693-191c-4849-a2ff-15f735d7b3cd None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:59.415894 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:59.448508 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f27693-191c-4849-a2ff-15f735d7b3cd None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:59.481217 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a76beb-9c7a-423b-9549-3ff69fe9f8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:59.481841 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a76beb-9c7a-423b-9549-3ff69fe9f8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:59.482125 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a76beb-9c7a-423b-9549-3ff69fe9f8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:59.482397 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a76beb-9c7a-423b-9549-3ff69fe9f8e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:59.494233 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a76beb-9c7a-423b-9549-3ff69fe9f8e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:59.495952 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a76beb-9c7a-423b-9549-3ff69fe9f8e1 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:59.509943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-d7a76beb-9c7a-423b-9549-3ff69fe9f8e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:47:59.509943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:47:59.509943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:47:59.509943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:47:59.509943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:47:59.509943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:47:59.509943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:47:59.509943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:47:59.509943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:47:59.509943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:47:59.509943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:47:59.509943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:47:59.509943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:47:59.509943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:47:59.509943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:47:59.509943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:47:59.513814 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:47:59.513814 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:47:59.513814 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:47:59.513814 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:47:59.513814 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:47:59.513814 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:47:59.513814 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:47:59.513814 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:47:59.513814 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:47:59.513814 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:47:59.513814 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:47:59.513814 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:47:59.513814 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:47:59.513814 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:47:59.513814 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:47:59.513814 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:47:59.513814 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:47:59.515179 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:47:59.515179 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:47:59.515179 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:47:59.515179 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 626/1265] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:47:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:47:59.517400 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d41ab-d146-48fa-9c05-8034561b79bd None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:59.605031 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:59.624410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d41ab-d146-48fa-9c05-8034561b79bd None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:59.657648 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb0a05-a13a-42ab-bdc8-667f91d568a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:59.658273 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb0a05-a13a-42ab-bdc8-667f91d568a1 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:59.658552 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb0a05-a13a-42ab-bdc8-667f91d568a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:59.658823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb0a05-a13a-42ab-bdc8-667f91d568a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:59.659463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb0a05-a13a-42ab-bdc8-667f91d568a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:47:59.659765 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb0a05-a13a-42ab-bdc8-667f91d568a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:59.661186 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb0a05-a13a-42ab-bdc8-667f91d568a1 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:59.673635 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 640/1266] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:47:59.679577 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a76beb-9c7a-423b-9549-3ff69fe9f8e1 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:59.783120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a76beb-9c7a-423b-9549-3ff69fe9f8e1 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:59.805184 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:59.819973 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a0607-3483-4d7e-9cef-9f9d1f3cf2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:59.820604 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a0607-3483-4d7e-9cef-9f9d1f3cf2c9 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:59.820913 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a0607-3483-4d7e-9cef-9f9d1f3cf2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:59.821186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a0607-3483-4d7e-9cef-9f9d1f3cf2c9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:59.828885 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a0607-3483-4d7e-9cef-9f9d1f3cf2c9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:59.830325 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a0607-3483-4d7e-9cef-9f9d1f3cf2c9 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:59.841681 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-1e0a0607-3483-4d7e-9cef-9f9d1f3cf2c9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 15:47:59.841681 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:47:59.841681 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:47:59.841681 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:47:59.841681 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:47:59.841681 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:47:59.841681 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:47:59.841681 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:47:59.841681 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:47:59.841681 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:47:59.841681 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:47:59.841681 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:47:59.841681 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:47:59.841681 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:47:59.841681 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:47:59.841681 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:47:59.845257 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:47:59.845257 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:47:59.845257 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:47:59.845257 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:47:59.845257 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:47:59.845257 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:47:59.845257 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:47:59.845257 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:47:59.845257 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:47:59.845257 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:47:59.845257 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:47:59.845257 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:47:59.845257 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:47:59.845257 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:47:59.845257 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:47:59.845257 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:47:59.845257 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:47:59.845257 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:47:59.846451 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:47:59.846451 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:47:59.846451 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:47:59.846451 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:47:59.846451 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:47:59.846451 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:47:59.846451 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:47:59.846451 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:47:59.846451 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 15:47:59.846451 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:47:59.846451 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 627/1267] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:47:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:47:59.848775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb0a05-a13a-42ab-bdc8-667f91d568a1 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:59.953835 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb0a05-a13a-42ab-bdc8-667f91d568a1 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:59.990225 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e86f7-d911-45e9-abf3-2245caa40243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:59.990818 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e86f7-d911-45e9-abf3-2245caa40243 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:59.991097 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e86f7-d911-45e9-abf3-2245caa40243 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:59.991359 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e86f7-d911-45e9-abf3-2245caa40243 None admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:59.992088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e86f7-d911-45e9-abf3-2245caa40243 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:47:59.992387 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e86f7-d911-45e9-abf3-2245caa40243 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:59.994370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e86f7-d911-45e9-abf3-2245caa40243 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:48:00.003424 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:00.012214 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 641/1268] 10.222.0.64 () {56 vars in 1143 bytes} [Wed Aug 24 15:47:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:48:00.018397 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a0607-3483-4d7e-9cef-9f9d1f3cf2c9 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:48:00.119232 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a0607-3483-4d7e-9cef-9f9d1f3cf2c9 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:48:00.152357 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326195b8-a876-4c49-aa03-fc9609c1e095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:48:00.153006 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326195b8-a876-4c49-aa03-fc9609c1e095 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:00.153283 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326195b8-a876-4c49-aa03-fc9609c1e095 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:00.153551 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326195b8-a876-4c49-aa03-fc9609c1e095 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:00.163822 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326195b8-a876-4c49-aa03-fc9609c1e095 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:48:00.165678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326195b8-a876-4c49-aa03-fc9609c1e095 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:48:00.179731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-326195b8-a876-4c49-aa03-fc9609c1e095 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:48:00.179731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:48:00.179731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:48:00.179731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:48:00.179731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:48:00.179731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:48:00.179731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:48:00.179731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:48:00.179731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:48:00.179731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:48:00.179731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:48:00.179731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:48:00.179731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:48:00.179731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:48:00.179731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:48:00.179731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:48:00.181181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:48:00.181181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:48:00.181181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:48:00.181181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:48:00.181181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:48:00.181181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:48:00.181181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:48:00.181181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:48:00.181181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:48:00.181181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:48:00.181181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:48:00.181181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:48:00.181181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:48:00.181181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:48:00.181181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:48:00.181181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:48:00.181181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:48:00.182330 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:48:00.182330 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:48:00.182330 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:48:00.182330 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 628/1269] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:48:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:48:00.186858 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e86f7-d911-45e9-abf3-2245caa40243 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:48:00.294061 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e86f7-d911-45e9-abf3-2245caa40243 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:48:00.329251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d46f62-c470-4d16-93c6-d8ac11248e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:48:00.329961 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d46f62-c470-4d16-93c6-d8ac11248e0e None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:00.330238 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d46f62-c470-4d16-93c6-d8ac11248e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:00.330504 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d46f62-c470-4d16-93c6-d8ac11248e0e None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:00.331139 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d46f62-c470-4d16-93c6-d8ac11248e0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:48:00.331437 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d46f62-c470-4d16-93c6-d8ac11248e0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:48:00.332821 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d46f62-c470-4d16-93c6-d8ac11248e0e None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:48:00.344067 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 642/1270] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:48:00.350136 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326195b8-a876-4c49-aa03-fc9609c1e095 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:48:00.384429 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:00.451370 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326195b8-a876-4c49-aa03-fc9609c1e095 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:48:00.487278 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e06b1-902c-47f5-974c-24cbb4b9742d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:48:00.487902 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e06b1-902c-47f5-974c-24cbb4b9742d None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:00.488179 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e06b1-902c-47f5-974c-24cbb4b9742d None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:00.488449 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e06b1-902c-47f5-974c-24cbb4b9742d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:00.495217 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e06b1-902c-47f5-974c-24cbb4b9742d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:48:00.496665 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e06b1-902c-47f5-974c-24cbb4b9742d None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:48:00.509264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-eb5e06b1-902c-47f5-974c-24cbb4b9742d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:48:00.509264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:48:00.509264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:48:00.509264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:48:00.509264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:48:00.509264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:48:00.509264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:48:00.509264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:48:00.509264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:48:00.509264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:48:00.509264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:48:00.509264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:48:00.509264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:48:00.509264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:48:00.509264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:48:00.512062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:48:00.512062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:48:00.512062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:48:00.512062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:48:00.512062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:48:00.512062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:48:00.512062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:48:00.512062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:48:00.512062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:48:00.512062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:48:00.512062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:48:00.512062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:48:00.512062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:48:00.512062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:48:00.512062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:48:00.512062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:48:00.512062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:48:00.513272 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:48:00.513272 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:48:00.513272 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:48:00.513272 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:48:00.513272 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:48:00.513272 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:48:00.513272 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:48:00.513272 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:48:00.513272 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 629/1271] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:48:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:48:00.516932 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d46f62-c470-4d16-93c6-d8ac11248e0e None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:48:00.580592 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:00.623847 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d46f62-c470-4d16-93c6-d8ac11248e0e None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:48:00.657130 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022d783-83aa-4e78-9189-0ceda080564c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:48:00.657750 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022d783-83aa-4e78-9189-0ceda080564c None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:00.658013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022d783-83aa-4e78-9189-0ceda080564c None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:00.658283 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022d783-83aa-4e78-9189-0ceda080564c None admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:00.658969 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022d783-83aa-4e78-9189-0ceda080564c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:48:00.659272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022d783-83aa-4e78-9189-0ceda080564c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:48:00.660721 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022d783-83aa-4e78-9189-0ceda080564c None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:48:00.673905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 643/1272] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:48:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:48:00.680062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e06b1-902c-47f5-974c-24cbb4b9742d None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:48:00.771789 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:00.781100 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e06b1-902c-47f5-974c-24cbb4b9742d None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:48:00.815220 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f48f9c-56c8-4047-a41b-8398fa7cf9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:48:00.815868 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f48f9c-56c8-4047-a41b-8398fa7cf9b8 None admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:00.816152 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f48f9c-56c8-4047-a41b-8398fa7cf9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:00.816427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f48f9c-56c8-4047-a41b-8398fa7cf9b8 None admin] PATH_INFO: `/v3/projects/9b25a7c01ab540ceae16dd618b848f2d/users/4f6907dfd3254d3c97d07ca2fb648858/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:00.818413 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f48f9c-56c8-4047-a41b-8398fa7cf9b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=9b25a7c01ab540ceae16dd618b848f2d, user_id=4f6907dfd3254d3c97d07ca2fb648858, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:48:00.819944 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f48f9c-56c8-4047-a41b-8398fa7cf9b8 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:48:00.935704 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 630/1273] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 24 15:48:00 2022] PUT /identity/v3/projects/9b25a7c01ab540ceae16dd618b848f2d/users/4f6907dfd3254d3c97d07ca2fb648858/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:48:02.868747 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447284b-7c93-4192-be32-76906c82885e None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:02.869500 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447284b-7c93-4192-be32-76906c82885e None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:02.869500 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447284b-7c93-4192-be32-76906c82885e None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:02.870658 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 644/1274] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:48:02.876044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25090a-a78f-458f-91de-2b96294f877d None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:02.877133 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25090a-a78f-458f-91de-2b96294f877d None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:02.877133 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25090a-a78f-458f-91de-2b96294f877d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:02.895701 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-eb25090a-a78f-458f-91de-2b96294f877d None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:48:02.900176 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-eb25090a-a78f-458f-91de-2b96294f877d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:48:02.965545 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 631/1275] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:48:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:48:03.233736 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447284b-7c93-4192-be32-76906c82885e None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:48:03.343439 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447284b-7c93-4192-be32-76906c82885e None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:48:03.361986 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:03.379239 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce60a0-ecdd-4c6a-a341-2405b4f99688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:48:03.379861 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce60a0-ecdd-4c6a-a341-2405b4f99688 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:03.380154 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce60a0-ecdd-4c6a-a341-2405b4f99688 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:03.380407 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce60a0-ecdd-4c6a-a341-2405b4f99688 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:03.391200 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce60a0-ecdd-4c6a-a341-2405b4f99688 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:48:03.395836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-1bce60a0-ecdd-4c6a-a341-2405b4f99688 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:48:03.395836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:48:03.395836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:48:03.395836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:48:03.395836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:48:03.395836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:48:03.395836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:48:03.395836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:48:03.395836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:48:03.395836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:48:03.395836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:48:03.395836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:48:03.395836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:48:03.395836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:48:03.395836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:48:03.395836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:48:03.396908 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:48:03.396908 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:48:03.396908 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:48:03.396908 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:48:03.396908 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:48:03.396908 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:48:03.396908 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:48:03.396908 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:48:03.396908 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:48:03.396908 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:48:03.396908 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:48:03.396908 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:48:03.396908 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:48:03.396908 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:48:03.396908 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:48:03.396908 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:48:03.397871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:48:03.397871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:48:03.397871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:48:03.397871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:48:03.397871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:48:03.397871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:48:03.397871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:48:03.397871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:48:03.397871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:48:03.397871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:48:03.397871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:48:03.397871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:48:03.397871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 645/1276] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 24 15:48:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:48:03.403810 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25090a-a78f-458f-91de-2b96294f877d None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:48:03.483507 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:03.502660 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25090a-a78f-458f-91de-2b96294f877d None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:48:03.536571 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f72f7f-3ada-4204-b1b9-c11f4e191799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:48:03.537210 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f72f7f-3ada-4204-b1b9-c11f4e191799 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:03.537485 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f72f7f-3ada-4204-b1b9-c11f4e191799 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:03.537750 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f72f7f-3ada-4204-b1b9-c11f4e191799 None admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:03.538402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f72f7f-3ada-4204-b1b9-c11f4e191799 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:48:03.538698 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f72f7f-3ada-4204-b1b9-c11f4e191799 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:48:03.540405 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f72f7f-3ada-4204-b1b9-c11f4e191799 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:48:03.548387 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 632/1277] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 24 15:48:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:48:03.556918 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce60a0-ecdd-4c6a-a341-2405b4f99688 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:48:03.661040 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce60a0-ecdd-4c6a-a341-2405b4f99688 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:48:03.694913 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578dfe66-3bd6-4191-a64a-ca2abdbaf2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:48:03.695532 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578dfe66-3bd6-4191-a64a-ca2abdbaf2c6 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:03.695807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578dfe66-3bd6-4191-a64a-ca2abdbaf2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:03.696872 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578dfe66-3bd6-4191-a64a-ca2abdbaf2c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:03.707456 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578dfe66-3bd6-4191-a64a-ca2abdbaf2c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:48:03.714024 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578dfe66-3bd6-4191-a64a-ca2abdbaf2c6 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:48:03.722693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-578dfe66-3bd6-4191-a64a-ca2abdbaf2c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:48:03.722693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:48:03.722693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:48:03.722693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:48:03.722693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:48:03.722693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:48:03.722693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:48:03.722693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:48:03.722693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:48:03.722693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:48:03.722693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:48:03.722693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:48:03.722693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:48:03.722693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:48:03.722693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:48:03.722693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:48:03.723827 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:48:03.723827 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:48:03.723827 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:48:03.723827 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:48:03.723827 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:48:03.723827 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:48:03.723827 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:48:03.723827 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:48:03.723827 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:48:03.723827 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:48:03.723827 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:48:03.723827 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:48:03.723827 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:48:03.723827 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:48:03.723827 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:48:03.723827 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:48:03.723827 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:48:03.724776 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:48:03.724776 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:48:03.724776 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:48:03.724776 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 646/1278] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:48:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:48:03.730362 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f72f7f-3ada-4204-b1b9-c11f4e191799 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:48:03.832291 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f72f7f-3ada-4204-b1b9-c11f4e191799 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:48:03.865890 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298d9d9-695a-40bf-9f3d-365ba1fdce6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:48:03.866482 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298d9d9-695a-40bf-9f3d-365ba1fdce6d None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:03.866758 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298d9d9-695a-40bf-9f3d-365ba1fdce6d None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:03.867024 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298d9d9-695a-40bf-9f3d-365ba1fdce6d None admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:03.867652 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298d9d9-695a-40bf-9f3d-365ba1fdce6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:48:03.868683 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298d9d9-695a-40bf-9f3d-365ba1fdce6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:48:03.870276 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298d9d9-695a-40bf-9f3d-365ba1fdce6d None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:48:03.882318 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 633/1279] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:48:03.888050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578dfe66-3bd6-4191-a64a-ca2abdbaf2c6 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:48:03.920061 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:03.992299 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578dfe66-3bd6-4191-a64a-ca2abdbaf2c6 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:48:04.026813 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89481ea7-fdf3-4691-b230-1460d02c3ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:48:04.027439 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89481ea7-fdf3-4691-b230-1460d02c3ced None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:04.027724 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89481ea7-fdf3-4691-b230-1460d02c3ced None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:04.027998 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89481ea7-fdf3-4691-b230-1460d02c3ced None admin] PATH_INFO: `/v3/users/placement` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:04.035522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89481ea7-fdf3-4691-b230-1460d02c3ced None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:48:04.036990 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89481ea7-fdf3-4691-b230-1460d02c3ced None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:48:04.048562 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-89481ea7-fdf3-4691-b230-1460d02c3ced None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 15:48:04.048562 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:48:04.048562 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:48:04.048562 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:48:04.048562 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:48:04.048562 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:48:04.048562 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:48:04.048562 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:48:04.048562 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:48:04.048562 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:48:04.048562 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:48:04.048562 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:48:04.048562 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:48:04.048562 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:48:04.048562 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:48:04.048562 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:48:04.049800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:48:04.049800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:48:04.049800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:48:04.049800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:48:04.049800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:48:04.049800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:48:04.049800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:48:04.049800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:48:04.049800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:48:04.049800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:48:04.049800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:48:04.049800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:48:04.049800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:48:04.049800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:48:04.049800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:48:04.049800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:48:04.049800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:48:04.049800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:48:04.050800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:48:04.050800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:48:04.050800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:48:04.050800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:48:04.050800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:48:04.050800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:48:04.050800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:48:04.050800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:48:04.050800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 15:48:04.050800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:48:04.050800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 647/1280] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:48:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:48:04.056121 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298d9d9-695a-40bf-9f3d-365ba1fdce6d None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:48:04.064654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:04.157470 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298d9d9-695a-40bf-9f3d-365ba1fdce6d None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:48:04.191657 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6afb6-6f98-4e5e-97a3-f4627724f74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:48:04.192299 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6afb6-6f98-4e5e-97a3-f4627724f74f None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:04.192604 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6afb6-6f98-4e5e-97a3-f4627724f74f None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:04.192903 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6afb6-6f98-4e5e-97a3-f4627724f74f None admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:04.193662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca6afb6-6f98-4e5e-97a3-f4627724f74f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:48:04.193987 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca6afb6-6f98-4e5e-97a3-f4627724f74f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:48:04.195514 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca6afb6-6f98-4e5e-97a3-f4627724f74f None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:48:04.215280 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 634/1281] 10.222.0.64 () {56 vars in 1143 bytes} [Wed Aug 24 15:48:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:48:04.221107 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89481ea7-fdf3-4691-b230-1460d02c3ced None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:48:04.313507 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:04.323015 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89481ea7-fdf3-4691-b230-1460d02c3ced None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:48:04.357154 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff999ae-5d0e-4c75-a8ce-70d65c3d4182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:48:04.357785 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff999ae-5d0e-4c75-a8ce-70d65c3d4182 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:04.358065 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff999ae-5d0e-4c75-a8ce-70d65c3d4182 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:04.358333 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff999ae-5d0e-4c75-a8ce-70d65c3d4182 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:04.428421 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff999ae-5d0e-4c75-a8ce-70d65c3d4182 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:48:04.429821 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff999ae-5d0e-4c75-a8ce-70d65c3d4182 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:48:04.519777 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:04.530697 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 648/1282] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 24 15:48:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:48:04.536705 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6afb6-6f98-4e5e-97a3-f4627724f74f None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:48:04.602211 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:04.641158 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6afb6-6f98-4e5e-97a3-f4627724f74f None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:48:04.675745 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fded5-09b4-4626-8b3f-cd3a021252d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:48:04.676533 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fded5-09b4-4626-8b3f-cd3a021252d2 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:04.676901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fded5-09b4-4626-8b3f-cd3a021252d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:04.677426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fded5-09b4-4626-8b3f-cd3a021252d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:04.689330 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7fded5-09b4-4626-8b3f-cd3a021252d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:48:04.690712 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7fded5-09b4-4626-8b3f-cd3a021252d2 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:48:04.706286 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-8e7fded5-09b4-4626-8b3f-cd3a021252d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:48:04.706286 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:48:04.706286 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:48:04.706286 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:48:04.706286 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:48:04.706286 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:48:04.706286 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:48:04.706286 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:48:04.706286 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:48:04.706286 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:48:04.706286 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:48:04.706286 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:48:04.706286 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:48:04.706286 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:48:04.706286 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:48:04.706286 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:48:04.707715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:48:04.707715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:48:04.707715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:48:04.707715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:48:04.707715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:48:04.707715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:48:04.707715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:48:04.707715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:48:04.707715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:48:04.707715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:48:04.707715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:48:04.707715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:48:04.707715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:48:04.707715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:48:04.707715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:48:04.707715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:48:04.707715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:48:04.708895 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:48:04.708895 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:48:04.708895 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:48:04.708895 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 635/1283] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:48:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:48:04.714017 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff999ae-5d0e-4c75-a8ce-70d65c3d4182 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:48:04.817016 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff999ae-5d0e-4c75-a8ce-70d65c3d4182 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:48:04.851311 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3acf82-69b0-4f74-8279-9786864c21af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:48:04.851906 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3acf82-69b0-4f74-8279-9786864c21af None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:04.852266 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3acf82-69b0-4f74-8279-9786864c21af None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:04.852562 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3acf82-69b0-4f74-8279-9786864c21af None admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:04.853276 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3acf82-69b0-4f74-8279-9786864c21af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:48:04.853569 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3acf82-69b0-4f74-8279-9786864c21af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:48:04.854936 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3acf82-69b0-4f74-8279-9786864c21af None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:48:04.865982 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 649/1284] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 24 15:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:48:04.871696 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fded5-09b4-4626-8b3f-cd3a021252d2 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:48:04.974659 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fded5-09b4-4626-8b3f-cd3a021252d2 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:48:04.988483 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:05.009739 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c696a2-3d72-4542-8e68-ae01e6d4a784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:48:05.010365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c696a2-3d72-4542-8e68-ae01e6d4a784 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:05.010645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c696a2-3d72-4542-8e68-ae01e6d4a784 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:05.010914 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c696a2-3d72-4542-8e68-ae01e6d4a784 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:05.017758 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c696a2-3d72-4542-8e68-ae01e6d4a784 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:48:05.019185 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c696a2-3d72-4542-8e68-ae01e6d4a784 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:48:05.030665 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application [None req-44c696a2-3d72-4542-8e68-ae01e6d4a784 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:48:05.030665 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:48:05.030665 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:48:05.030665 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:48:05.030665 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:48:05.030665 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:48:05.030665 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:48:05.030665 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:48:05.030665 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:48:05.030665 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:48:05.030665 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:48:05.030665 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:48:05.030665 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:48:05.030665 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:48:05.030665 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:48:05.031779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:48:05.031779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:48:05.031779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:48:05.031779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:48:05.031779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:48:05.031779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:48:05.031779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:48:05.031779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:48:05.031779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application with Lock( Aug 24 15:48:05.031779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:48:05.031779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:48:05.031779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:48:05.031779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:48:05.031779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:48:05.031779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:48:05.031779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:48:05.031779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:48:05.032946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:48:05.032946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:48:05.032946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:48:05.032946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:48:05.032946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:48:05.032946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:48:05.032946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:48:05.032946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: ERROR keystone.server.flask.application Aug 24 15:48:05.032946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 636/1285] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 24 15:48:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:48:05.037824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3acf82-69b0-4f74-8279-9786864c21af None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:48:05.091218 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:05.143271 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3acf82-69b0-4f74-8279-9786864c21af None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:48:05.176916 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d74ad-f5f9-4f7f-a1f1-ca11ff8a63cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:48:05.177513 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d74ad-f5f9-4f7f-a1f1-ca11ff8a63cd None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:05.177900 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d74ad-f5f9-4f7f-a1f1-ca11ff8a63cd None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:05.178174 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d74ad-f5f9-4f7f-a1f1-ca11ff8a63cd None admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:05.178893 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d74ad-f5f9-4f7f-a1f1-ca11ff8a63cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:48:05.179201 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d74ad-f5f9-4f7f-a1f1-ca11ff8a63cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:48:05.181187 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d74ad-f5f9-4f7f-a1f1-ca11ff8a63cd None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:48:05.193175 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 650/1286] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 24 15:48:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:48:05.200571 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c696a2-3d72-4542-8e68-ae01e6d4a784 None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:48:05.300893 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c696a2-3d72-4542-8e68-ae01e6d4a784 None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:48:05.336610 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcafbf-5816-4380-bcd9-cb01dd24515c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:48:05.340613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcafbf-5816-4380-bcd9-cb01dd24515c None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:05.340613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcafbf-5816-4380-bcd9-cb01dd24515c None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:05.340613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcafbf-5816-4380-bcd9-cb01dd24515c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:05.340613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fcafbf-5816-4380-bcd9-cb01dd24515c None admin] RBAC: Adding query filter params (role.id=c6745e08f9da4a2bae8510c9983635c3, scope.project.id=9b25a7c01ab540ceae16dd618b848f2d, user.id=4f6907dfd3254d3c97d07ca2fb648858) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:48:05.340613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fcafbf-5816-4380-bcd9-cb01dd24515c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:48:05.340613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fcafbf-5816-4380-bcd9-cb01dd24515c None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:48:05.345894 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 637/1287] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 24 15:48:05 2022] GET /identity/v3/role_assignments?user.id=4f6907dfd3254d3c97d07ca2fb648858&scope.project.id=9b25a7c01ab540ceae16dd618b848f2d&role.id=c6745e08f9da4a2bae8510c9983635c3 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:48:07.314056 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b267636-89af-4b30-8570-77f12dbb7c04 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:07.315883 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b267636-89af-4b30-8570-77f12dbb7c04 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:07.315883 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b267636-89af-4b30-8570-77f12dbb7c04 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:07.316317 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 651/1288] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:48:07.322656 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701d155-2032-4827-a98b-33f40c9c81ab None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:07.323070 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701d155-2032-4827-a98b-33f40c9c81ab None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:07.323183 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701d155-2032-4827-a98b-33f40c9c81ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:07.341602 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-8701d155-2032-4827-a98b-33f40c9c81ab None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:48:07.342777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-8701d155-2032-4827-a98b-33f40c9c81ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:48:07.372536 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:07.409400 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 638/1289] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:48:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:48:07.677777 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b267636-89af-4b30-8570-77f12dbb7c04 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:48:07.781844 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b267636-89af-4b30-8570-77f12dbb7c04 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:48:07.794552 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:07.818848 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6686e44-e76a-4eea-9ccf-43b8e82b8a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:48:07.819506 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6686e44-e76a-4eea-9ccf-43b8e82b8a4e None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:07.819787 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6686e44-e76a-4eea-9ccf-43b8e82b8a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:07.820052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6686e44-e76a-4eea-9ccf-43b8e82b8a4e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:07.820758 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6686e44-e76a-4eea-9ccf-43b8e82b8a4e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:48:07.822058 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6686e44-e76a-4eea-9ccf-43b8e82b8a4e None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:48:07.830671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-d6686e44-e76a-4eea-9ccf-43b8e82b8a4e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 15:48:07.830671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:48:07.830671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:48:07.830671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:48:07.830671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:48:07.830671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:48:07.830671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:48:07.830671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:48:07.830671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 15:48:07.830671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:48:07.830671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:48:07.830671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:48:07.830671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:48:07.830671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:48:07.830671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:48:07.830671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:48:07.830671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:48:07.831804 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:48:07.831804 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:48:07.831804 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:48:07.831804 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:48:07.831804 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:48:07.831804 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:48:07.831804 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:48:07.831804 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:48:07.831804 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:48:07.831804 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:48:07.831804 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:48:07.831804 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:48:07.831804 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:48:07.831804 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:48:07.831804 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:48:07.831804 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:48:07.832705 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:48:07.832705 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:48:07.832705 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:48:07.832705 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:48:07.832705 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:48:07.832705 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:48:07.832705 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:48:07.832705 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:48:07.832705 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:48:07.832705 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:48:07.832705 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:48:07.832705 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:48:07.832705 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 15:48:07.832705 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:48:07.832705 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 652/1290] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 24 15:48:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:48:07.838497 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701d155-2032-4827-a98b-33f40c9c81ab None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:48:07.938435 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701d155-2032-4827-a98b-33f40c9c81ab None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:48:07.972018 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3e415-5128-4146-9fac-ea5fc830ef01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:48:07.972647 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3e415-5128-4146-9fac-ea5fc830ef01 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:07.972934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3e415-5128-4146-9fac-ea5fc830ef01 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:07.973205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3e415-5128-4146-9fac-ea5fc830ef01 None admin] PATH_INFO: `/v3/services` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:07.973824 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3e415-5128-4146-9fac-ea5fc830ef01 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:48:07.974123 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3e415-5128-4146-9fac-ea5fc830ef01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:48:07.975543 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3e415-5128-4146-9fac-ea5fc830ef01 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:48:07.981017 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 639/1291] 10.222.0.64 () {56 vars in 1116 bytes} [Wed Aug 24 15:48:07 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:48:07.987033 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6686e44-e76a-4eea-9ccf-43b8e82b8a4e None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:48:08.087136 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6686e44-e76a-4eea-9ccf-43b8e82b8a4e None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:48:08.121232 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1796b-9e20-48e7-b7c8-2b41c8ce47dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:48:08.121836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1796b-9e20-48e7-b7c8-2b41c8ce47dd None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:08.122120 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1796b-9e20-48e7-b7c8-2b41c8ce47dd None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:08.122393 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1796b-9e20-48e7-b7c8-2b41c8ce47dd None admin] PATH_INFO: `/v3/services` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:08.123020 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1796b-9e20-48e7-b7c8-2b41c8ce47dd None admin] RBAC: Adding query filter params (type=placement) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:48:08.123359 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1796b-9e20-48e7-b7c8-2b41c8ce47dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:48:08.124781 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1796b-9e20-48e7-b7c8-2b41c8ce47dd None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:48:08.129383 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 653/1292] 10.222.0.64 () {56 vars in 1116 bytes} [Wed Aug 24 15:48:07 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:48:10.038297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c143313-2b3d-4fd8-9675-6387d8c1e089 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:10.038861 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c143313-2b3d-4fd8-9675-6387d8c1e089 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:10.038861 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c143313-2b3d-4fd8-9675-6387d8c1e089 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:10.040216 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 640/1293] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:48:10.045656 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7555713-732e-4423-ae73-309188685af1 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:10.046055 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7555713-732e-4423-ae73-309188685af1 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:10.046200 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7555713-732e-4423-ae73-309188685af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:10.068335 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-f7555713-732e-4423-ae73-309188685af1 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:48:10.070094 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-f7555713-732e-4423-ae73-309188685af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:48:10.102231 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:10.141771 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 654/1294] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:48:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:48:10.414821 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c143313-2b3d-4fd8-9675-6387d8c1e089 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:48:10.447765 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:10.518038 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c143313-2b3d-4fd8-9675-6387d8c1e089 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:48:10.553214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817ce84-706b-4f9f-87d1-afb03bf546e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:48:10.553732 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817ce84-706b-4f9f-87d1-afb03bf546e1 None admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:10.554014 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817ce84-706b-4f9f-87d1-afb03bf546e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:10.554288 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817ce84-706b-4f9f-87d1-afb03bf546e1 None admin] PATH_INFO: `/v3/services` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:10.555500 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817ce84-706b-4f9f-87d1-afb03bf546e1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:48:10.556882 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817ce84-706b-4f9f-87d1-afb03bf546e1 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:48:10.631392 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 641/1295] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 24 15:48:10 2022] POST /identity/v3/services => generated 246 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:48:12.596682 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75263e59-2326-4b26-9a80-fd9581d2a209 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:12.597196 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75263e59-2326-4b26-9a80-fd9581d2a209 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:12.597196 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75263e59-2326-4b26-9a80-fd9581d2a209 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:12.598677 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 655/1296] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:48:12.604810 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e0a47-2a1f-4821-b5b9-f70ad9be9506 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:12.605473 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e0a47-2a1f-4821-b5b9-f70ad9be9506 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:12.605702 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e0a47-2a1f-4821-b5b9-f70ad9be9506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:12.624080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-e36e0a47-2a1f-4821-b5b9-f70ad9be9506 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:48:12.625285 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e36e0a47-2a1f-4821-b5b9-f70ad9be9506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:48:12.699291 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 642/1297] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:48:12 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:48:12.971182 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75263e59-2326-4b26-9a80-fd9581d2a209 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:48:13.078739 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75263e59-2326-4b26-9a80-fd9581d2a209 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:48:13.114256 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f91fb-388b-4c42-a563-19288ea549b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:48:13.114879 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f91fb-388b-4c42-a563-19288ea549b4 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:13.115157 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f91fb-388b-4c42-a563-19288ea549b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:13.115460 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f91fb-388b-4c42-a563-19288ea549b4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:13.116037 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f91fb-388b-4c42-a563-19288ea549b4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:48:13.117486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f91fb-388b-4c42-a563-19288ea549b4 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:48:13.126220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-475f91fb-388b-4c42-a563-19288ea549b4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 15:48:13.126220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:48:13.126220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:48:13.126220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:48:13.126220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:48:13.126220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:48:13.126220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:48:13.126220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:48:13.126220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 15:48:13.126220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:48:13.126220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:48:13.126220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:48:13.126220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:48:13.126220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:48:13.126220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:48:13.126220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:48:13.126220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:48:13.127501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:48:13.127501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:48:13.127501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:48:13.127501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:48:13.127501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:48:13.127501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:48:13.127501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:48:13.127501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:48:13.127501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:48:13.127501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:48:13.127501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:48:13.127501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:48:13.127501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:48:13.127501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:48:13.127501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:48:13.127501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:48:13.128529 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:48:13.128529 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:48:13.128529 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:48:13.128529 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:48:13.128529 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:48:13.128529 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:48:13.128529 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:48:13.128529 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:48:13.128529 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:48:13.128529 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:48:13.128529 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:48:13.128529 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:48:13.128529 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 15:48:13.128529 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:48:13.128529 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 656/1298] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 24 15:48:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:48:13.134287 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e0a47-2a1f-4821-b5b9-f70ad9be9506 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:48:13.154113 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:13.236712 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e0a47-2a1f-4821-b5b9-f70ad9be9506 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:48:13.272563 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dcde83-5206-42e8-b6f5-317a04db15ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:48:13.273914 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dcde83-5206-42e8-b6f5-317a04db15ac None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:13.274261 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dcde83-5206-42e8-b6f5-317a04db15ac None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:13.274693 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dcde83-5206-42e8-b6f5-317a04db15ac None admin] PATH_INFO: `/v3/services` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:13.275325 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dcde83-5206-42e8-b6f5-317a04db15ac None admin] RBAC: Adding query filter params (name=placement) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:48:13.275623 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dcde83-5206-42e8-b6f5-317a04db15ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:48:13.277035 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dcde83-5206-42e8-b6f5-317a04db15ac None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:48:13.282618 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 643/1299] 10.222.0.64 () {56 vars in 1116 bytes} [Wed Aug 24 15:48:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:48:13.289684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f91fb-388b-4c42-a563-19288ea549b4 None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:48:13.323323 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:13.395651 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f91fb-388b-4c42-a563-19288ea549b4 None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:48:13.431047 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea690f-9f03-49e4-87a4-bbc169ca44a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:48:13.431658 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea690f-9f03-49e4-87a4-bbc169ca44a2 None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:13.431940 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea690f-9f03-49e4-87a4-bbc169ca44a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:13.432211 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea690f-9f03-49e4-87a4-bbc169ca44a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:13.432942 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea690f-9f03-49e4-87a4-bbc169ca44a2 None admin] RBAC: Adding query filter params (interface=public, service_id=2034fc6d931c439590bfcad7a1163a9f, region_id=RegionOne) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:48:13.433250 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea690f-9f03-49e4-87a4-bbc169ca44a2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:48:13.434619 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea690f-9f03-49e4-87a4-bbc169ca44a2 None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:48:13.439907 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 657/1300] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Aug 24 15:48:13 2022] GET /identity/v3/endpoints?service_id=2034fc6d931c439590bfcad7a1163a9f&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:48:13.446638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dcde83-5206-42e8-b6f5-317a04db15ac None admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:48:13.530915 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:13.549636 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dcde83-5206-42e8-b6f5-317a04db15ac None admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:48:13.584743 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03665dc-5386-46fe-a741-ec7d9c8f4922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:48:13.585348 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03665dc-5386-46fe-a741-ec7d9c8f4922 None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:13.585672 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03665dc-5386-46fe-a741-ec7d9c8f4922 None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:13.586173 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03665dc-5386-46fe-a741-ec7d9c8f4922 None admin] PATH_INFO: `/v3/services` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:13.586663 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03665dc-5386-46fe-a741-ec7d9c8f4922 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:48:13.588031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03665dc-5386-46fe-a741-ec7d9c8f4922 None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:48:13.594921 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 644/1301] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 24 15:48:13 2022] GET /identity/v3/services => generated 2191 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:48:15.535852 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d09ba5-2b95-4b31-b225-768e129dddef None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:15.536432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d09ba5-2b95-4b31-b225-768e129dddef None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:15.536432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d09ba5-2b95-4b31-b225-768e129dddef None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:15.537757 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 658/1302] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:48:15.544660 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb4d9e-9860-4470-b587-c23996d75626 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:15.548898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb4d9e-9860-4470-b587-c23996d75626 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:15.548898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb4d9e-9860-4470-b587-c23996d75626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:15.563400 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-5beb4d9e-9860-4470-b587-c23996d75626 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:48:15.564509 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-5beb4d9e-9860-4470-b587-c23996d75626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:48:15.633776 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 645/1303] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:48:15 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:48:15.907780 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d09ba5-2b95-4b31-b225-768e129dddef None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:48:16.006942 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:16.014180 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d09ba5-2b95-4b31-b225-768e129dddef None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:48:16.049555 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546481a5-388f-42f8-abf7-35dd7096843a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:48:16.050181 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546481a5-388f-42f8-abf7-35dd7096843a None admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:16.050458 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546481a5-388f-42f8-abf7-35dd7096843a None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:16.050724 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546481a5-388f-42f8-abf7-35dd7096843a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:16.051299 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546481a5-388f-42f8-abf7-35dd7096843a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:48:16.052691 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546481a5-388f-42f8-abf7-35dd7096843a None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:48:16.062208 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application [None req-546481a5-388f-42f8-abf7-35dd7096843a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 15:48:16.062208 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:48:16.062208 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:48:16.062208 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:48:16.062208 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:48:16.062208 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:48:16.062208 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:48:16.062208 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:48:16.062208 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 15:48:16.062208 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:48:16.062208 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:48:16.062208 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:48:16.062208 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:48:16.062208 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:48:16.062208 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:48:16.062208 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:48:16.062208 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:48:16.064064 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:48:16.064064 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:48:16.064064 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:48:16.064064 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:48:16.064064 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:48:16.064064 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:48:16.064064 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:48:16.064064 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:48:16.064064 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:48:16.064064 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:48:16.064064 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:48:16.064064 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:48:16.064064 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:48:16.064064 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:48:16.064064 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:48:16.064064 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:48:16.065478 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:48:16.065478 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application with Lock( Aug 24 15:48:16.065478 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:48:16.065478 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:48:16.065478 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:48:16.065478 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:48:16.065478 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:48:16.065478 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:48:16.065478 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:48:16.065478 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:48:16.065478 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:48:16.065478 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:48:16.065478 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 15:48:16.065478 dv-cinder-849325-3-smb devstack@keystone.service[81716]: ERROR keystone.server.flask.application Aug 24 15:48:16.065478 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 659/1304] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 24 15:48:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:48:16.069534 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb4d9e-9860-4470-b587-c23996d75626 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:48:16.147981 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:16.171355 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb4d9e-9860-4470-b587-c23996d75626 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:48:16.206857 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd91adf-2523-4b14-bc7e-9cca5afb8c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:48:16.207466 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd91adf-2523-4b14-bc7e-9cca5afb8c3f None admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:16.207741 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd91adf-2523-4b14-bc7e-9cca5afb8c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:16.208011 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd91adf-2523-4b14-bc7e-9cca5afb8c3f None admin] PATH_INFO: `/v3/services` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:16.208663 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd91adf-2523-4b14-bc7e-9cca5afb8c3f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:48:16.208958 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd91adf-2523-4b14-bc7e-9cca5afb8c3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:48:16.210311 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd91adf-2523-4b14-bc7e-9cca5afb8c3f None admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:48:16.219237 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 646/1305] 10.222.0.64 () {56 vars in 1116 bytes} [Wed Aug 24 15:48:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:48:16.222915 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546481a5-388f-42f8-abf7-35dd7096843a None admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:48:16.326242 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546481a5-388f-42f8-abf7-35dd7096843a None admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:48:16.359309 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59212f0-2757-4413-a209-fd57b4aaa77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:48:16.359907 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59212f0-2757-4413-a209-fd57b4aaa77c None admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:16.360185 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59212f0-2757-4413-a209-fd57b4aaa77c None admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:16.360453 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59212f0-2757-4413-a209-fd57b4aaa77c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:16.361144 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59212f0-2757-4413-a209-fd57b4aaa77c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:48:16.363042 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59212f0-2757-4413-a209-fd57b4aaa77c None admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:48:16.443147 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 660/1306] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 15:48:16 2022] POST /identity/v3/endpoints => generated 331 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:48:26.218585 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=30 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:26.438313 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:26.008090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c35938-a4ec-475f-ba39-8f6f456fe33f None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:26.008546 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c35938-a4ec-475f-ba39-8f6f456fe33f None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:26.008666 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c35938-a4ec-475f-ba39-8f6f456fe33f None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:26.010384 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 647/1307] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:54:26.016385 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d93b4e-fc36-4ce7-9bb2-e0eae9f2debc None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:26.016912 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d93b4e-fc36-4ce7-9bb2-e0eae9f2debc None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:26.016997 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d93b4e-fc36-4ce7-9bb2-e0eae9f2debc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:26.109881 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-13d93b4e-fc36-4ce7-9bb2-e0eae9f2debc None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:54:26.111308 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-13d93b4e-fc36-4ce7-9bb2-e0eae9f2debc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:26.355452 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 661/1308] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:54:26.668464 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027773b4-fcb0-42fb-a501-c1e2e3d52d45 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:26.669176 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027773b4-fcb0-42fb-a501-c1e2e3d52d45 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:26.669509 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027773b4-fcb0-42fb-a501-c1e2e3d52d45 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:26.671090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 648/1309] 10.222.0.64 () {54 vars in 965 bytes} [Wed Aug 24 15:54:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:54:26.678027 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73252cb7-5f28-40cd-ad6c-67111339f3d8 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:26.678295 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73252cb7-5f28-40cd-ad6c-67111339f3d8 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:26.678598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73252cb7-5f28-40cd-ad6c-67111339f3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:26.781588 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-73252cb7-5f28-40cd-ad6c-67111339f3d8 None None] MFA Rules not processed for user `80f7e6f1af76404096d4c717cbcf20f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:54:26.782888 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-73252cb7-5f28-40cd-ad6c-67111339f3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:26.810747 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:26.893982 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 662/1310] 10.222.0.64 () {58 vars in 1062 bytes} [Wed Aug 24 15:54:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:54:26.903739 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027773b4-fcb0-42fb-a501-c1e2e3d52d45 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:54:26.905681 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-027773b4-fcb0-42fb-a501-c1e2e3d52d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:27.035712 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027773b4-fcb0-42fb-a501-c1e2e3d52d45 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:54:27.119831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97c492-9773-4db3-b8d1-bcabef6ad94f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:54:27.120476 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97c492-9773-4db3-b8d1-bcabef6ad94f service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:27.120793 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97c492-9773-4db3-b8d1-bcabef6ad94f service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:27.121071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97c492-9773-4db3-b8d1-bcabef6ad94f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:27.122695 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-1c97c492-9773-4db3-b8d1-bcabef6ad94f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:27.185719 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:27.245917 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97c492-9773-4db3-b8d1-bcabef6ad94f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:54:27.246871 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97c492-9773-4db3-b8d1-bcabef6ad94f service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:54:27.267403 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 649/1311] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:54:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:54:29.536194 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a8038-8673-4eaf-a109-7c5c6b7bc5e3 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:29.536747 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a8038-8673-4eaf-a109-7c5c6b7bc5e3 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:29.536841 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a8038-8673-4eaf-a109-7c5c6b7bc5e3 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:29.538132 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 663/1312] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:54:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:54:29.543441 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e47acb-d7d6-4aa3-90a0-759b68ca1e9e None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:29.543878 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e47acb-d7d6-4aa3-90a0-759b68ca1e9e None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:29.543988 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e47acb-d7d6-4aa3-90a0-759b68ca1e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:29.634645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-e0e47acb-d7d6-4aa3-90a0-759b68ca1e9e None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:54:29.635848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e0e47acb-d7d6-4aa3-90a0-759b68ca1e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:29.738798 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 650/1313] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:54:30.020933 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a8038-8673-4eaf-a109-7c5c6b7bc5e3 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:54:30.022610 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-1f4a8038-8673-4eaf-a109-7c5c6b7bc5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:30.136194 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a8038-8673-4eaf-a109-7c5c6b7bc5e3 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:54:30.210854 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:30.213372 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8384301-792a-4ce2-8ae9-5889f92dacea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:54:30.213988 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8384301-792a-4ce2-8ae9-5889f92dacea service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:30.214271 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8384301-792a-4ce2-8ae9-5889f92dacea service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:30.214545 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8384301-792a-4ce2-8ae9-5889f92dacea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:30.216184 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-f8384301-792a-4ce2-8ae9-5889f92dacea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:30.342645 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8384301-792a-4ce2-8ae9-5889f92dacea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:54:30.344127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8384301-792a-4ce2-8ae9-5889f92dacea service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:54:30.366555 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 664/1314] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:54:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:54:32.976544 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cc596-5e97-43be-b72a-f74eb49399db None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:32.977101 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cc596-5e97-43be-b72a-f74eb49399db None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:32.977191 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cc596-5e97-43be-b72a-f74eb49399db None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:32.978503 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 651/1315] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:54:32.983908 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42542a7d-9e44-4860-9fd4-5f0f2b9c736d None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:32.984368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42542a7d-9e44-4860-9fd4-5f0f2b9c736d None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:32.984463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42542a7d-9e44-4860-9fd4-5f0f2b9c736d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:33.055043 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-42542a7d-9e44-4860-9fd4-5f0f2b9c736d None None] MFA Rules not processed for user `da731fa9396f47948c6cb3efa385c081`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:54:33.056301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-42542a7d-9e44-4860-9fd4-5f0f2b9c736d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:33.109443 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:33.155372 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 665/1316] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:54:32 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:54:33.455468 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a9557-d364-43c5-9189-f7231ad62fbc None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:33.455774 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a9557-d364-43c5-9189-f7231ad62fbc None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:33.456018 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a9557-d364-43c5-9189-f7231ad62fbc None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:33.458035 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 652/1317] 10.222.0.64 () {54 vars in 965 bytes} [Wed Aug 24 15:54:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:54:33.464807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd024c-1a20-49bc-a286-83b6a0d26849 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:33.465121 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd024c-1a20-49bc-a286-83b6a0d26849 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:33.465585 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd024c-1a20-49bc-a286-83b6a0d26849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:33.548146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-3fcd024c-1a20-49bc-a286-83b6a0d26849 None None] MFA Rules not processed for user `80f7e6f1af76404096d4c717cbcf20f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:54:33.549405 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-3fcd024c-1a20-49bc-a286-83b6a0d26849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:33.627029 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 666/1318] 10.222.0.64 () {58 vars in 1062 bytes} [Wed Aug 24 15:54:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:54:33.636642 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a9557-d364-43c5-9189-f7231ad62fbc None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:54:33.638197 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-796a9557-d364-43c5-9189-f7231ad62fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:33.649071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:33.747732 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a9557-d364-43c5-9189-f7231ad62fbc None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:54:33.822608 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2ddf2-4b29-47ba-a83a-7616e7314d1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:54:33.823224 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2ddf2-4b29-47ba-a83a-7616e7314d1a service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:33.823498 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2ddf2-4b29-47ba-a83a-7616e7314d1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:33.823768 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2ddf2-4b29-47ba-a83a-7616e7314d1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:33.825418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-73e2ddf2-4b29-47ba-a83a-7616e7314d1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:33.888792 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:33.936843 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2ddf2-4b29-47ba-a83a-7616e7314d1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:54:33.938283 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2ddf2-4b29-47ba-a83a-7616e7314d1a service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:54:33.958154 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 653/1319] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:54:33 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:54:37.054384 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd1a2b-19f1-4f28-8ab1-e73634adbcb6 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:37.054940 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd1a2b-19f1-4f28-8ab1-e73634adbcb6 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:37.054940 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd1a2b-19f1-4f28-8ab1-e73634adbcb6 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:37.056284 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 667/1320] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:54:37.061857 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be8a09-4511-440c-9d1f-7c8e47e1c8ae None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:37.062296 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be8a09-4511-440c-9d1f-7c8e47e1c8ae None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:37.062391 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be8a09-4511-440c-9d1f-7c8e47e1c8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:37.130393 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-a0be8a09-4511-440c-9d1f-7c8e47e1c8ae None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:54:37.131613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-a0be8a09-4511-440c-9d1f-7c8e47e1c8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:37.232817 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 654/1321] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:54:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:54:37.523870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd1a2b-19f1-4f28-8ab1-e73634adbcb6 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:54:37.525464 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-e5dd1a2b-19f1-4f28-8ab1-e73634adbcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:37.576986 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:37.632884 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd1a2b-19f1-4f28-8ab1-e73634adbcb6 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:54:37.708593 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f839f96-5b3d-42b7-b957-f557daff9219 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:54:37.709242 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f839f96-5b3d-42b7-b957-f557daff9219 service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:37.709521 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f839f96-5b3d-42b7-b957-f557daff9219 service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:37.709792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f839f96-5b3d-42b7-b957-f557daff9219 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:37.711437 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-1f839f96-5b3d-42b7-b957-f557daff9219 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:37.813617 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:37.827367 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f839f96-5b3d-42b7-b957-f557daff9219 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:54:37.828833 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f839f96-5b3d-42b7-b957-f557daff9219 service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:54:37.848674 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 668/1322] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:54:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:54:41.056167 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05336ee-50cb-4ffd-908a-8142166d8a6c None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:41.056749 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05336ee-50cb-4ffd-908a-8142166d8a6c None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:41.056885 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05336ee-50cb-4ffd-908a-8142166d8a6c None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:41.058294 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 655/1323] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:54:41.063947 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd72e4-4c76-42ff-867b-f7afb514f23a None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:41.064452 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd72e4-4c76-42ff-867b-f7afb514f23a None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:41.064557 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd72e4-4c76-42ff-867b-f7afb514f23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:41.133764 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-c1cd72e4-4c76-42ff-867b-f7afb514f23a None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:54:41.134971 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-c1cd72e4-4c76-42ff-867b-f7afb514f23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:41.236240 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 669/1324] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:54:41.526635 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05336ee-50cb-4ffd-908a-8142166d8a6c None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:54:41.528212 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e05336ee-50cb-4ffd-908a-8142166d8a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:41.550747 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:41.647829 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05336ee-50cb-4ffd-908a-8142166d8a6c None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:54:41.726635 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1762910-0f47-46b8-a338-73f70b1d194a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:54:41.727246 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1762910-0f47-46b8-a338-73f70b1d194a service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:41.727532 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1762910-0f47-46b8-a338-73f70b1d194a service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:41.727843 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1762910-0f47-46b8-a338-73f70b1d194a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:41.729506 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-a1762910-0f47-46b8-a338-73f70b1d194a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:41.808885 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:41.851407 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1762910-0f47-46b8-a338-73f70b1d194a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:54:41.852901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1762910-0f47-46b8-a338-73f70b1d194a service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:54:41.872989 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 656/1325] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:54:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:54:43.903369 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33276aa6-6c61-48d4-ab52-efb09b726fa0 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:43.903975 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33276aa6-6c61-48d4-ab52-efb09b726fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:43.903975 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33276aa6-6c61-48d4-ab52-efb09b726fa0 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:43.905298 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 670/1326] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:54:43.911329 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dee5e7-5709-485d-9efd-7b76be3b285e None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:43.911843 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dee5e7-5709-485d-9efd-7b76be3b285e None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:43.911950 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dee5e7-5709-485d-9efd-7b76be3b285e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:43.981800 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-e8dee5e7-5709-485d-9efd-7b76be3b285e None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:54:43.983006 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e8dee5e7-5709-485d-9efd-7b76be3b285e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:44.086126 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 657/1327] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:54:44.387931 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33276aa6-6c61-48d4-ab52-efb09b726fa0 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:54:44.389834 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-33276aa6-6c61-48d4-ab52-efb09b726fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:44.460212 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:44.505387 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33276aa6-6c61-48d4-ab52-efb09b726fa0 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:54:44.597849 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a9cc1-6a9b-43a2-a3b8-2d8cf0e5ddaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:54:44.598463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a9cc1-6a9b-43a2-a3b8-2d8cf0e5ddaa service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:44.598744 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a9cc1-6a9b-43a2-a3b8-2d8cf0e5ddaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:44.599015 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a9cc1-6a9b-43a2-a3b8-2d8cf0e5ddaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:44.600701 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-7c4a9cc1-6a9b-43a2-a3b8-2d8cf0e5ddaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:44.727281 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:44.729852 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a9cc1-6a9b-43a2-a3b8-2d8cf0e5ddaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:54:44.731389 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a9cc1-6a9b-43a2-a3b8-2d8cf0e5ddaa service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:54:44.751500 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 671/1328] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:54:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:54:46.755862 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5095b-b9f0-47f4-bb1c-ab7dce61417a None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:46.758279 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5095b-b9f0-47f4-bb1c-ab7dce61417a None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:46.758279 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5095b-b9f0-47f4-bb1c-ab7dce61417a None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:46.758279 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 658/1329] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:54:46.763220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1a124-f931-4861-85e1-695a70f6cb8d None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:46.763945 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1a124-f931-4861-85e1-695a70f6cb8d None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:46.764109 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1a124-f931-4861-85e1-695a70f6cb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:46.843540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-99a1a124-f931-4861-85e1-695a70f6cb8d None None] MFA Rules not processed for user `da731fa9396f47948c6cb3efa385c081`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:54:46.845081 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-99a1a124-f931-4861-85e1-695a70f6cb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:46.951291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 672/1330] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:54:46 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:54:47.240615 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5095b-b9f0-47f4-bb1c-ab7dce61417a None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:54:47.243113 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e3a5095b-b9f0-47f4-bb1c-ab7dce61417a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:47.283659 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:47.389283 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5095b-b9f0-47f4-bb1c-ab7dce61417a None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:54:47.477947 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6723833-63d8-4216-ad6a-36bf15bdc44c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:54:47.478556 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6723833-63d8-4216-ad6a-36bf15bdc44c service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:47.478826 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6723833-63d8-4216-ad6a-36bf15bdc44c service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:47.479092 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6723833-63d8-4216-ad6a-36bf15bdc44c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:47.480773 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-f6723833-63d8-4216-ad6a-36bf15bdc44c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:47.575814 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:47.611055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6723833-63d8-4216-ad6a-36bf15bdc44c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:54:47.613186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6723833-63d8-4216-ad6a-36bf15bdc44c service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:54:47.641236 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 659/1331] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:54:47 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:54:50.323000 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629f40c-2a38-40d9-ac53-8d200d848cc0 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:50.323520 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629f40c-2a38-40d9-ac53-8d200d848cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:50.323882 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629f40c-2a38-40d9-ac53-8d200d848cc0 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:50.325963 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 673/1332] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:54:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:54:50.333418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45c3e5-c795-4c40-8a67-909b03361ddc None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:50.333884 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45c3e5-c795-4c40-8a67-909b03361ddc None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:50.334031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45c3e5-c795-4c40-8a67-909b03361ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:50.402538 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-6f45c3e5-c795-4c40-8a67-909b03361ddc None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:54:50.403762 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-6f45c3e5-c795-4c40-8a67-909b03361ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:50.506891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 660/1333] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:54:50.794602 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629f40c-2a38-40d9-ac53-8d200d848cc0 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:54:50.796166 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-c629f40c-2a38-40d9-ac53-8d200d848cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:50.868573 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:50.904154 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629f40c-2a38-40d9-ac53-8d200d848cc0 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:54:50.979728 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73813b6-807a-4e7f-a639-e5e9c2ce9b2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:54:50.980355 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73813b6-807a-4e7f-a639-e5e9c2ce9b2f service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:50.980612 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73813b6-807a-4e7f-a639-e5e9c2ce9b2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:50.980910 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73813b6-807a-4e7f-a639-e5e9c2ce9b2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:50.982515 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-a73813b6-807a-4e7f-a639-e5e9c2ce9b2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:51.095085 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73813b6-807a-4e7f-a639-e5e9c2ce9b2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:54:51.097290 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73813b6-807a-4e7f-a639-e5e9c2ce9b2f service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:54:51.108459 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:51.117442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 674/1334] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:54:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:54:53.120802 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6cc59-25c8-44d2-a0f8-b541ca4dbf5b None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:53.121321 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6cc59-25c8-44d2-a0f8-b541ca4dbf5b None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:53.121321 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6cc59-25c8-44d2-a0f8-b541ca4dbf5b None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:53.122623 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 661/1335] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:54:53.128805 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c08f3-be50-43de-9337-7ae96864ae59 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:53.129376 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c08f3-be50-43de-9337-7ae96864ae59 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:53.129376 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c08f3-be50-43de-9337-7ae96864ae59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:53.198719 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-e66c08f3-be50-43de-9337-7ae96864ae59 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:54:53.199932 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-e66c08f3-be50-43de-9337-7ae96864ae59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:53.302492 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 675/1336] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:54:53.586594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e6cc59-25c8-44d2-a0f8-b541ca4dbf5b None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:54:53.588115 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-75e6cc59-25c8-44d2-a0f8-b541ca4dbf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:53.634035 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:53.700291 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e6cc59-25c8-44d2-a0f8-b541ca4dbf5b None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:54:53.783281 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c14153-ff75-4c2f-8b15-76887ac77c5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:54:53.784523 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c14153-ff75-4c2f-8b15-76887ac77c5a service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:53.784832 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c14153-ff75-4c2f-8b15-76887ac77c5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:53.785108 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c14153-ff75-4c2f-8b15-76887ac77c5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:53.786782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-d8c14153-ff75-4c2f-8b15-76887ac77c5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:53.994701 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:54.024955 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c14153-ff75-4c2f-8b15-76887ac77c5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:54:54.026547 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c14153-ff75-4c2f-8b15-76887ac77c5a service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:54:54.046466 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 662/1337] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:54:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:54:56.593410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97128f-de6d-4365-a615-ad585b8d2bf2 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:56.593921 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97128f-de6d-4365-a615-ad585b8d2bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:56.593921 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97128f-de6d-4365-a615-ad585b8d2bf2 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:56.595198 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 676/1338] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:54:56.600939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70119dbb-7414-48e9-8ac5-16e218adacdd None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:56.601440 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70119dbb-7414-48e9-8ac5-16e218adacdd None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:56.601538 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70119dbb-7414-48e9-8ac5-16e218adacdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:56.670360 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-70119dbb-7414-48e9-8ac5-16e218adacdd None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:54:56.671577 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-70119dbb-7414-48e9-8ac5-16e218adacdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:56.776069 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 663/1339] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:54:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:54:57.069748 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97128f-de6d-4365-a615-ad585b8d2bf2 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:54:57.071331 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-0b97128f-de6d-4365-a615-ad585b8d2bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:57.153641 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:57.181746 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97128f-de6d-4365-a615-ad585b8d2bf2 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:54:57.257513 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a42344-a3c8-4a0f-9390-29fb1f35c73e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:54:57.258120 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a42344-a3c8-4a0f-9390-29fb1f35c73e service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:57.258398 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a42344-a3c8-4a0f-9390-29fb1f35c73e service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:57.258667 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a42344-a3c8-4a0f-9390-29fb1f35c73e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:57.260313 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-04a42344-a3c8-4a0f-9390-29fb1f35c73e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:57.380014 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a42344-a3c8-4a0f-9390-29fb1f35c73e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:54:57.381416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a42344-a3c8-4a0f-9390-29fb1f35c73e service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:54:57.402603 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 677/1340] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:54:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:55:01.857589 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87046fc-7f71-4e5e-bd06-3d9d90a04574 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:01.858177 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87046fc-7f71-4e5e-bd06-3d9d90a04574 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:01.858177 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87046fc-7f71-4e5e-bd06-3d9d90a04574 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:01.859507 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 664/1341] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:55:01.865480 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4461b-83a3-4b37-8c4f-6195416cf210 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:01.865994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4461b-83a3-4b37-8c4f-6195416cf210 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:01.866111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4461b-83a3-4b37-8c4f-6195416cf210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:01.871600 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:01.948378 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-27d4461b-83a3-4b37-8c4f-6195416cf210 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:55:01.949665 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-27d4461b-83a3-4b37-8c4f-6195416cf210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:02.060437 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 678/1342] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:55:02.351370 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87046fc-7f71-4e5e-bd06-3d9d90a04574 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:55:02.353026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e87046fc-7f71-4e5e-bd06-3d9d90a04574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:02.405035 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:02.464426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87046fc-7f71-4e5e-bd06-3d9d90a04574 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:55:02.543350 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ee508-d17a-4beb-b14a-e7422b74b175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:55:02.543970 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ee508-d17a-4beb-b14a-e7422b74b175 service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:02.544269 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ee508-d17a-4beb-b14a-e7422b74b175 service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:02.544541 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ee508-d17a-4beb-b14a-e7422b74b175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:02.546195 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-300ee508-d17a-4beb-b14a-e7422b74b175 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:02.643461 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:02.661240 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ee508-d17a-4beb-b14a-e7422b74b175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:55:02.662684 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ee508-d17a-4beb-b14a-e7422b74b175 service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:55:02.683294 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 665/1343] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:55:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:55:05.761398 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66c967-3e05-47da-93ca-6363724df90a None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:05.761984 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66c967-3e05-47da-93ca-6363724df90a None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:05.761984 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66c967-3e05-47da-93ca-6363724df90a None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:05.763564 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 679/1344] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:55:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:55:05.769992 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0e763-31b7-448e-b244-82591e3733dd None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:05.770502 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0e763-31b7-448e-b244-82591e3733dd None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:05.770599 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0e763-31b7-448e-b244-82591e3733dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:05.841499 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-85d0e763-31b7-448e-b244-82591e3733dd None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:55:05.842699 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-85d0e763-31b7-448e-b244-82591e3733dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:05.949314 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 666/1345] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:55:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:55:06.239972 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66c967-3e05-47da-93ca-6363724df90a None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:55:06.241620 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-7f66c967-3e05-47da-93ca-6363724df90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:06.338213 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:06.358426 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66c967-3e05-47da-93ca-6363724df90a None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:55:06.453048 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385a226-d49c-48e9-9456-b95186f137f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:55:06.453665 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385a226-d49c-48e9-9456-b95186f137f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:06.453946 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385a226-d49c-48e9-9456-b95186f137f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:06.454215 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385a226-d49c-48e9-9456-b95186f137f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:06.456459 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-0385a226-d49c-48e9-9456-b95186f137f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:06.585840 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385a226-d49c-48e9-9456-b95186f137f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:55:06.587195 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385a226-d49c-48e9-9456-b95186f137f9 service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:55:06.606388 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 680/1346] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:55:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:55:11.074182 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1fe66-0fe9-4673-9eff-381a88fc2751 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:11.074735 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1fe66-0fe9-4673-9eff-381a88fc2751 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:11.074735 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1fe66-0fe9-4673-9eff-381a88fc2751 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:11.076084 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 667/1347] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:55:11.081997 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d92771-90e2-4779-a7a4-55f05169992b None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:11.082744 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d92771-90e2-4779-a7a4-55f05169992b None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:11.082744 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d92771-90e2-4779-a7a4-55f05169992b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:11.099896 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:11.160495 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-c9d92771-90e2-4779-a7a4-55f05169992b None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:55:11.161850 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-c9d92771-90e2-4779-a7a4-55f05169992b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:11.273611 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 681/1348] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:55:11.565807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1fe66-0fe9-4673-9eff-381a88fc2751 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:55:11.568661 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-aae1fe66-0fe9-4673-9eff-381a88fc2751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:11.638748 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:11.704844 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1fe66-0fe9-4673-9eff-381a88fc2751 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:55:11.790886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f720a-2627-4ff3-80ef-322e95afa9f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:55:11.791545 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f720a-2627-4ff3-80ef-322e95afa9f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:11.791835 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f720a-2627-4ff3-80ef-322e95afa9f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:11.792118 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f720a-2627-4ff3-80ef-322e95afa9f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:11.793826 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-250f720a-2627-4ff3-80ef-322e95afa9f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:11.912528 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:11.916172 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f720a-2627-4ff3-80ef-322e95afa9f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:55:11.917629 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f720a-2627-4ff3-80ef-322e95afa9f2 service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:55:11.936119 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 668/1349] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:55:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:55:17.010055 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704403fc-1b28-4d8e-b2b6-f2ff01e5f562 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:17.010627 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704403fc-1b28-4d8e-b2b6-f2ff01e5f562 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:17.013307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704403fc-1b28-4d8e-b2b6-f2ff01e5f562 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:17.013638 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 682/1350] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 24 15:55:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:55:17.019465 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd91fdf-41ac-4e31-88d1-8c16958bc3e8 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:17.019952 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd91fdf-41ac-4e31-88d1-8c16958bc3e8 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:17.022546 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd91fdf-41ac-4e31-88d1-8c16958bc3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:17.137156 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-1fd91fdf-41ac-4e31-88d1-8c16958bc3e8 None None] MFA Rules not processed for user `4f6907dfd3254d3c97d07ca2fb648858`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:55:17.137156 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-1fd91fdf-41ac-4e31-88d1-8c16958bc3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:17.309580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 669/1351] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 24 15:55:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:55:21.270748 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=59 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:21.812844 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b0242-2fc8-4c03-b89a-47ba4763a52b None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:21.813244 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b0242-2fc8-4c03-b89a-47ba4763a52b None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:21.813494 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b0242-2fc8-4c03-b89a-47ba4763a52b None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:21.815052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 683/1352] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 24 15:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:55:21.820507 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83b411-05eb-4788-94ea-70dc8e6a94f4 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:21.821065 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83b411-05eb-4788-94ea-70dc8e6a94f4 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:21.821161 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83b411-05eb-4788-94ea-70dc8e6a94f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:21.879839 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:21.908668 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-bc83b411-05eb-4788-94ea-70dc8e6a94f4 None None] MFA Rules not processed for user `4f6907dfd3254d3c97d07ca2fb648858`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:55:21.910434 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-bc83b411-05eb-4788-94ea-70dc8e6a94f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:22.052668 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 670/1353] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 24 15:55:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:55:23.280024 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c933bc-3323-45ee-af3b-06407590f9c5 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:23.280584 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c933bc-3323-45ee-af3b-06407590f9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:23.280584 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c933bc-3323-45ee-af3b-06407590f9c5 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:23.282860 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 684/1354] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 24 15:55:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:55:23.288313 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5d591-6905-4c2f-8f9b-ec043f8fa9e6 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:23.288826 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5d591-6905-4c2f-8f9b-ec043f8fa9e6 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:23.288942 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5d591-6905-4c2f-8f9b-ec043f8fa9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:23.373084 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-a5f5d591-6905-4c2f-8f9b-ec043f8fa9e6 None None] MFA Rules not processed for user `4f6907dfd3254d3c97d07ca2fb648858`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:55:23.374292 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-a5f5d591-6905-4c2f-8f9b-ec043f8fa9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:23.421467 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:23.498217 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 671/1355] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 24 15:55:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:55:26.994141 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f01888-6464-41b1-9539-18c2355302cb None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:26.994743 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f01888-6464-41b1-9539-18c2355302cb None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:26.994743 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f01888-6464-41b1-9539-18c2355302cb None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:26.996023 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 685/1356] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:55:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:55:27.002477 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554bc26-7c3a-449e-aebd-27ee02906da0 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:27.002902 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554bc26-7c3a-449e-aebd-27ee02906da0 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:27.003044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554bc26-7c3a-449e-aebd-27ee02906da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:27.080457 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-d554bc26-7c3a-449e-aebd-27ee02906da0 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:55:27.081860 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-d554bc26-7c3a-449e-aebd-27ee02906da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:27.201097 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 672/1357] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:55:27.535145 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b10b24-2f19-4396-8f59-f70d756ca2df None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:27.535514 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b10b24-2f19-4396-8f59-f70d756ca2df None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:27.535684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b10b24-2f19-4396-8f59-f70d756ca2df None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:27.537074 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 686/1358] 10.222.0.64 () {54 vars in 962 bytes} [Wed Aug 24 15:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:55:27.546345 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e130b53-51e6-4eea-bd21-778f6fc4d9c2 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:27.546629 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e130b53-51e6-4eea-bd21-778f6fc4d9c2 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:27.546905 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e130b53-51e6-4eea-bd21-778f6fc4d9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:27.572228 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:27.642760 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-6e130b53-51e6-4eea-bd21-778f6fc4d9c2 None None] MFA Rules not processed for user `e5f0d8fe42e74d68bfa9a0e365bab4b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:55:27.644018 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-6e130b53-51e6-4eea-bd21-778f6fc4d9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:27.790535 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 673/1359] 10.222.0.64 () {58 vars in 1059 bytes} [Wed Aug 24 15:55:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:55:27.801614 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b10b24-2f19-4396-8f59-f70d756ca2df None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:55:27.803223 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-74b10b24-2f19-4396-8f59-f70d756ca2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:27.966901 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b10b24-2f19-4396-8f59-f70d756ca2df None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:55:28.048503 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:28.095872 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3d218-fa65-4db5-8c03-38414087e942 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:55:28.096545 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3d218-fa65-4db5-8c03-38414087e942 service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:28.096844 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3d218-fa65-4db5-8c03-38414087e942 service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:28.097081 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3d218-fa65-4db5-8c03-38414087e942 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:28.098765 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-2ce3d218-fa65-4db5-8c03-38414087e942 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:28.195185 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3d218-fa65-4db5-8c03-38414087e942 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:55:28.196750 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3d218-fa65-4db5-8c03-38414087e942 service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:55:28.216400 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 687/1360] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:55:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:55:30.460374 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c3fcc-4e52-44c1-ba4c-09e67886bade None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:30.461247 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c3fcc-4e52-44c1-ba4c-09e67886bade None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:30.461247 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c3fcc-4e52-44c1-ba4c-09e67886bade None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:30.463248 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 674/1361] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:55:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:55:30.467949 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b0919-54c7-424d-9c39-c224fb371b4a None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:30.468566 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b0919-54c7-424d-9c39-c224fb371b4a None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:30.468566 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b0919-54c7-424d-9c39-c224fb371b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:30.543716 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-de1b0919-54c7-424d-9c39-c224fb371b4a None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:55:30.544913 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-de1b0919-54c7-424d-9c39-c224fb371b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:30.586588 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:30.652665 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 688/1362] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:55:30.944663 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c3fcc-4e52-44c1-ba4c-09e67886bade None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:55:30.946382 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-d63c3fcc-4e52-44c1-ba4c-09e67886bade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:31.047098 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:31.151250 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c3fcc-4e52-44c1-ba4c-09e67886bade None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:55:31.291079 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b783795-3452-4dad-8ba8-6629d56ab215 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:55:31.291690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b783795-3452-4dad-8ba8-6629d56ab215 service nova] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:31.291965 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b783795-3452-4dad-8ba8-6629d56ab215 service nova] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:31.292235 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b783795-3452-4dad-8ba8-6629d56ab215 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:31.293930 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-8b783795-3452-4dad-8ba8-6629d56ab215 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:31.325371 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:31.411022 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b783795-3452-4dad-8ba8-6629d56ab215 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:55:31.412775 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b783795-3452-4dad-8ba8-6629d56ab215 service nova] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:55:31.434562 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 675/1363] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:55:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:55:33.872014 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b547c31-8c8d-4911-8fa6-bafed920a994 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:33.872955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b547c31-8c8d-4911-8fa6-bafed920a994 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:33.873235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b547c31-8c8d-4911-8fa6-bafed920a994 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:33.874819 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 689/1364] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:55:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:55:33.881668 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8512825-db92-4b6a-8af8-b05bf73eebda None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:33.881668 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8512825-db92-4b6a-8af8-b05bf73eebda None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:33.882269 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8512825-db92-4b6a-8af8-b05bf73eebda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:33.989472 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-a8512825-db92-4b6a-8af8-b05bf73eebda None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:55:33.991709 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-a8512825-db92-4b6a-8af8-b05bf73eebda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:34.106208 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:34.115882 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 676/1365] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:55:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:55:34.407655 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69da5c-a930-4f0e-89b4-46f81ab7469d None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:34.408436 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69da5c-a930-4f0e-89b4-46f81ab7469d None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:34.408754 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69da5c-a930-4f0e-89b4-46f81ab7469d None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:34.410191 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 690/1366] 10.222.0.64 () {54 vars in 962 bytes} [Wed Aug 24 15:55:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:55:34.416083 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b262ae1-808e-41ef-8249-01166a4d8dfe None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:34.416542 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b262ae1-808e-41ef-8249-01166a4d8dfe None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:34.416866 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b262ae1-808e-41ef-8249-01166a4d8dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:34.497667 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-3b262ae1-808e-41ef-8249-01166a4d8dfe None None] MFA Rules not processed for user `e5f0d8fe42e74d68bfa9a0e365bab4b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:55:34.498898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-3b262ae1-808e-41ef-8249-01166a4d8dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:34.633462 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 677/1367] 10.222.0.64 () {58 vars in 1059 bytes} [Wed Aug 24 15:55:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:55:34.643570 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69da5c-a930-4f0e-89b4-46f81ab7469d None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:55:34.646114 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-9f69da5c-a930-4f0e-89b4-46f81ab7469d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:34.824175 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69da5c-a930-4f0e-89b4-46f81ab7469d None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:55:34.850314 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:34.959251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c276618-66b8-4919-8a71-80459dd20eba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:55:34.960034 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c276618-66b8-4919-8a71-80459dd20eba service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:34.960470 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c276618-66b8-4919-8a71-80459dd20eba service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:34.961025 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c276618-66b8-4919-8a71-80459dd20eba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:34.962795 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-0c276618-66b8-4919-8a71-80459dd20eba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:35.077091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c276618-66b8-4919-8a71-80459dd20eba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:55:35.079215 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c276618-66b8-4919-8a71-80459dd20eba service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:55:35.099533 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 691/1368] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:55:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:55:35.752463 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b35845-f122-41ce-a432-a2d6bc9792c3 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:35.753006 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b35845-f122-41ce-a432-a2d6bc9792c3 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:35.753089 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b35845-f122-41ce-a432-a2d6bc9792c3 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:35.754714 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 678/1369] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:55:35.760360 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e37f0-779a-4b25-920f-65e1fcc06485 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:35.760729 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e37f0-779a-4b25-920f-65e1fcc06485 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:35.760961 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e37f0-779a-4b25-920f-65e1fcc06485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:35.799244 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:35.839061 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-a05e37f0-779a-4b25-920f-65e1fcc06485 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:55:35.840284 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-a05e37f0-779a-4b25-920f-65e1fcc06485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:35.963124 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 692/1370] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:55:36.570432 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f741dee-7219-4ed5-a0b7-c2e61ae099fe None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:36.570724 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f741dee-7219-4ed5-a0b7-c2e61ae099fe None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:36.571047 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f741dee-7219-4ed5-a0b7-c2e61ae099fe None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:36.572379 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 679/1371] 10.222.0.64 () {54 vars in 964 bytes} [Wed Aug 24 15:55:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:55:36.578760 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31227cb1-f877-44d3-b77f-0549a45d6ead None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:36.579300 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31227cb1-f877-44d3-b77f-0549a45d6ead None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:36.580884 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31227cb1-f877-44d3-b77f-0549a45d6ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:36.669508 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-31227cb1-f877-44d3-b77f-0549a45d6ead None None] MFA Rules not processed for user `89d937fedccb484a8a494cd686361fac`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:55:36.670872 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-31227cb1-f877-44d3-b77f-0549a45d6ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:36.728269 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:36.779358 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 693/1372] 10.222.0.64 () {58 vars in 1061 bytes} [Wed Aug 24 15:55:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:55:36.780644 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f741dee-7219-4ed5-a0b7-c2e61ae099fe None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:55:36.783532 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-5f741dee-7219-4ed5-a0b7-c2e61ae099fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:36.845002 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:36.908725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f741dee-7219-4ed5-a0b7-c2e61ae099fe None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:55:36.998120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92af1d-80a8-48f9-a9a3-d48f840accad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:55:36.998812 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92af1d-80a8-48f9-a9a3-d48f840accad service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:36.998999 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92af1d-80a8-48f9-a9a3-d48f840accad service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:36.999351 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92af1d-80a8-48f9-a9a3-d48f840accad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:37.002791 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-fc92af1d-80a8-48f9-a9a3-d48f840accad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:37.128040 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:37.145091 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92af1d-80a8-48f9-a9a3-d48f840accad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:55:37.146735 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92af1d-80a8-48f9-a9a3-d48f840accad service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:55:37.169899 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 680/1373] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:55:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:55:37.274101 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cc040-8745-4b71-aa16-02503f23c32a None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:37.274826 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cc040-8745-4b71-aa16-02503f23c32a None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:37.274826 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cc040-8745-4b71-aa16-02503f23c32a None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:37.275951 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 694/1374] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:55:37.285182 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405c422-5c49-428a-b621-61df48cf50a6 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:37.285182 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405c422-5c49-428a-b621-61df48cf50a6 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:37.285182 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405c422-5c49-428a-b621-61df48cf50a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:37.372605 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-d405c422-5c49-428a-b621-61df48cf50a6 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:55:37.373815 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-d405c422-5c49-428a-b621-61df48cf50a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:37.491689 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 681/1375] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:55:37.792691 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cc040-8745-4b71-aa16-02503f23c32a None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:55:37.794589 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-6c6cc040-8745-4b71-aa16-02503f23c32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:37.975089 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cc040-8745-4b71-aa16-02503f23c32a None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:55:38.041581 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:38.104381 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6adedc-9d29-4021-9704-41655beae20e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:55:38.105016 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6adedc-9d29-4021-9704-41655beae20e service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:38.105311 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6adedc-9d29-4021-9704-41655beae20e service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:38.105580 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6adedc-9d29-4021-9704-41655beae20e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:38.107227 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-1a6adedc-9d29-4021-9704-41655beae20e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:38.212027 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6adedc-9d29-4021-9704-41655beae20e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:55:38.213660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6adedc-9d29-4021-9704-41655beae20e service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:55:38.232803 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 695/1376] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:55:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:55:40.350239 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cef528-cf9a-4543-8ffa-7ea5a995c687 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:40.350790 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cef528-cf9a-4543-8ffa-7ea5a995c687 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:40.350790 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cef528-cf9a-4543-8ffa-7ea5a995c687 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:40.352257 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 682/1377] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:55:40.357692 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761908b-f09d-46d8-b727-1ecfd5ad35be None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:40.358132 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761908b-f09d-46d8-b727-1ecfd5ad35be None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:40.358225 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761908b-f09d-46d8-b727-1ecfd5ad35be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:40.447943 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-b761908b-f09d-46d8-b727-1ecfd5ad35be None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:55:40.449205 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-b761908b-f09d-46d8-b727-1ecfd5ad35be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:40.457017 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:40.557779 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 696/1378] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:55:40.863495 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cef528-cf9a-4543-8ffa-7ea5a995c687 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:55:40.868686 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-59cef528-cf9a-4543-8ffa-7ea5a995c687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:40.952083 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:41.070461 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cef528-cf9a-4543-8ffa-7ea5a995c687 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:55:41.211892 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b73b1-9911-43f9-ab72-0585d4b8525f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:55:41.212496 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b73b1-9911-43f9-ab72-0585d4b8525f service nova] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:41.212820 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b73b1-9911-43f9-ab72-0585d4b8525f service nova] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:41.213095 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b73b1-9911-43f9-ab72-0585d4b8525f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:41.214763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-bd0b73b1-9911-43f9-ab72-0585d4b8525f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:41.236096 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:41.326194 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b73b1-9911-43f9-ab72-0585d4b8525f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:55:41.329114 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b73b1-9911-43f9-ab72-0585d4b8525f service nova] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:55:41.353032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 683/1379] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:55:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:55:43.509583 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf795a-5d3b-4e30-9234-6b163fb55650 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:43.510299 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf795a-5d3b-4e30-9234-6b163fb55650 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:43.510552 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf795a-5d3b-4e30-9234-6b163fb55650 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:43.512593 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 697/1380] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:55:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:55:43.520341 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320e4c8-7d57-40be-a237-b2e987158bc7 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:43.521039 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320e4c8-7d57-40be-a237-b2e987158bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:43.521039 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320e4c8-7d57-40be-a237-b2e987158bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:43.599715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-d320e4c8-7d57-40be-a237-b2e987158bc7 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:55:43.601002 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-d320e4c8-7d57-40be-a237-b2e987158bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:43.702253 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:43.709197 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 684/1381] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:55:44.010682 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf795a-5d3b-4e30-9234-6b163fb55650 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:55:44.012533 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-e3cf795a-5d3b-4e30-9234-6b163fb55650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:44.197075 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:44.208646 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf795a-5d3b-4e30-9234-6b163fb55650 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:55:44.356471 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260a18c-0055-4037-9170-c29628ad2f7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:55:44.357121 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260a18c-0055-4037-9170-c29628ad2f7e service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:44.357401 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260a18c-0055-4037-9170-c29628ad2f7e service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:44.357860 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260a18c-0055-4037-9170-c29628ad2f7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:44.361523 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-1260a18c-0055-4037-9170-c29628ad2f7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:44.468165 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1260a18c-0055-4037-9170-c29628ad2f7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:55:44.469823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1260a18c-0055-4037-9170-c29628ad2f7e service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:55:44.484292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:44.493828 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 698/1382] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:55:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:55:46.917530 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebde8f-94fd-40b8-ba1a-295ca2fa6a0e None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:46.918109 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebde8f-94fd-40b8-ba1a-295ca2fa6a0e None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:46.918109 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebde8f-94fd-40b8-ba1a-295ca2fa6a0e None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:46.919505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 685/1383] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:55:46.925586 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4ddfd-8ffc-4d09-bbc2-d91ce8944a2f None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:46.926048 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4ddfd-8ffc-4d09-bbc2-d91ce8944a2f None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:46.926311 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4ddfd-8ffc-4d09-bbc2-d91ce8944a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:47.011141 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-2ed4ddfd-8ffc-4d09-bbc2-d91ce8944a2f None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:55:47.013971 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-2ed4ddfd-8ffc-4d09-bbc2-d91ce8944a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:47.148289 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 699/1384] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:55:47.445250 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebde8f-94fd-40b8-ba1a-295ca2fa6a0e None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:55:47.446788 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-72ebde8f-94fd-40b8-ba1a-295ca2fa6a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:47.612731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebde8f-94fd-40b8-ba1a-295ca2fa6a0e None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:55:47.693950 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:47.745644 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea69a8d-fe55-4787-8ac0-df50a08b9720 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:55:47.746264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea69a8d-fe55-4787-8ac0-df50a08b9720 service nova] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:47.746544 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea69a8d-fe55-4787-8ac0-df50a08b9720 service nova] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:47.746809 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea69a8d-fe55-4787-8ac0-df50a08b9720 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:47.748432 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-dea69a8d-fe55-4787-8ac0-df50a08b9720 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:47.857996 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea69a8d-fe55-4787-8ac0-df50a08b9720 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:55:47.860371 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea69a8d-fe55-4787-8ac0-df50a08b9720 service nova] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:55:47.886553 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 686/1385] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:55:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:55:50.188870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf655c-ca00-42c5-88ae-4ad9483b4767 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:50.189436 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf655c-ca00-42c5-88ae-4ad9483b4767 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:50.189870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf655c-ca00-42c5-88ae-4ad9483b4767 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:50.191636 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 700/1386] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:55:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:55:50.200504 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab90415-0e73-471c-9276-15d6bb696607 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:50.201074 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab90415-0e73-471c-9276-15d6bb696607 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:50.201566 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab90415-0e73-471c-9276-15d6bb696607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:50.288856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-6ab90415-0e73-471c-9276-15d6bb696607 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:55:50.290459 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-6ab90415-0e73-471c-9276-15d6bb696607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:50.334799 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:50.409472 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 687/1387] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:55:50.713846 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf655c-ca00-42c5-88ae-4ad9483b4767 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:55:50.715907 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-1bdf655c-ca00-42c5-88ae-4ad9483b4767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:50.808002 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:50.892198 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf655c-ca00-42c5-88ae-4ad9483b4767 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:55:51.025337 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2876f4e-8c6e-49d0-9726-244e50284e3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:55:51.025958 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2876f4e-8c6e-49d0-9726-244e50284e3e service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:51.026238 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2876f4e-8c6e-49d0-9726-244e50284e3e service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:51.026510 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2876f4e-8c6e-49d0-9726-244e50284e3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:51.028175 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-e2876f4e-8c6e-49d0-9726-244e50284e3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:51.073416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:51.131351 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2876f4e-8c6e-49d0-9726-244e50284e3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:55:51.133457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2876f4e-8c6e-49d0-9726-244e50284e3e service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:55:51.154451 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 701/1388] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:55:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:55:52.847391 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565862d-2610-44f5-887f-8c2868661f71 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:52.848094 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565862d-2610-44f5-887f-8c2868661f71 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:52.848094 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565862d-2610-44f5-887f-8c2868661f71 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:52.849634 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 688/1389] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:55:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:55:52.855603 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a097143-d276-499b-9307-9e19c3c866e0 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:52.855603 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a097143-d276-499b-9307-9e19c3c866e0 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:52.856201 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a097143-d276-499b-9307-9e19c3c866e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:52.953723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-2a097143-d276-499b-9307-9e19c3c866e0 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:55:52.955431 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-2a097143-d276-499b-9307-9e19c3c866e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:53.084785 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 702/1390] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:55:53.205639 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2ddc6-4295-40c8-b63c-8e45e17c2bb9 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:53.206007 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2ddc6-4295-40c8-b63c-8e45e17c2bb9 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:53.206194 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2ddc6-4295-40c8-b63c-8e45e17c2bb9 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:53.207559 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 689/1391] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:55:53.215015 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572925a-06ad-4321-a83b-b7021742aaed None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:53.215015 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572925a-06ad-4321-a83b-b7021742aaed None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:53.215015 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572925a-06ad-4321-a83b-b7021742aaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:53.232538 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:53.290344 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-3572925a-06ad-4321-a83b-b7021742aaed None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:55:53.292276 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-3572925a-06ad-4321-a83b-b7021742aaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:53.400972 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce48e8-53d1-472f-b26e-68758ace591b None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:53.401638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce48e8-53d1-472f-b26e-68758ace591b None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:53.401941 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce48e8-53d1-472f-b26e-68758ace591b None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:53.403419 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 690/1392] 10.222.0.64 () {54 vars in 967 bytes} [Wed Aug 24 15:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:55:53.409122 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3126a-12eb-4fb2-b97a-105438015688 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:53.409488 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3126a-12eb-4fb2-b97a-105438015688 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:53.409761 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 703/1393] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:55:53.409874 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3126a-12eb-4fb2-b97a-105438015688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:53.491509 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-48f3126a-12eb-4fb2-b97a-105438015688 None None] MFA Rules not processed for user `f21fda517a384dc5a6a9f36d68ac1a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:55:53.492753 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-48f3126a-12eb-4fb2-b97a-105438015688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:53.574612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 691/1394] 10.222.0.64 () {58 vars in 1064 bytes} [Wed Aug 24 15:55:53 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:55:53.582231 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572925a-06ad-4321-a83b-b7021742aaed None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:55:53.583583 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-3572925a-06ad-4321-a83b-b7021742aaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:53.676737 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572925a-06ad-4321-a83b-b7021742aaed None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:55:53.684273 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:53.705201 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3126a-12eb-4fb2-b97a-105438015688 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:55:53.706403 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-48f3126a-12eb-4fb2-b97a-105438015688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:53.740173 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:53.758567 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e5849-c5b9-4ed1-bdd6-301ebf20be02 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21fda517a384dc5a6a9f36d68ac1a2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:55:53.759184 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e5849-c5b9-4ed1-bdd6-301ebf20be02 service glance] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:53.759466 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e5849-c5b9-4ed1-bdd6-301ebf20be02 service glance] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:53.759779 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e5849-c5b9-4ed1-bdd6-301ebf20be02 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:53.761731 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-0b4e5849-c5b9-4ed1-bdd6-301ebf20be02 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:53.843905 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3126a-12eb-4fb2-b97a-105438015688 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:55:53.893201 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e5849-c5b9-4ed1-bdd6-301ebf20be02 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:55:53.894678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e5849-c5b9-4ed1-bdd6-301ebf20be02 service glance] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:55:53.914673 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 704/1395] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:55:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:55:53.980344 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c67faa-540c-46fc-aa69-6f7959d70b63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:55:53.981011 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c67faa-540c-46fc-aa69-6f7959d70b63 service nova] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:53.981286 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c67faa-540c-46fc-aa69-6f7959d70b63 service nova] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:53.981551 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c67faa-540c-46fc-aa69-6f7959d70b63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:53.983200 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-52c67faa-540c-46fc-aa69-6f7959d70b63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:54.004746 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:54.081276 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c67faa-540c-46fc-aa69-6f7959d70b63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:55:54.082879 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c67faa-540c-46fc-aa69-6f7959d70b63 service nova] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:55:54.101555 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 692/1396] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:55:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:55:54.827552 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f29657-3427-4233-a99c-e1ac921aa0ae None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:54.827880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f29657-3427-4233-a99c-e1ac921aa0ae None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:54.828157 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f29657-3427-4233-a99c-e1ac921aa0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:54.878028 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:54.902624 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-c9f29657-3427-4233-a99c-e1ac921aa0ae None None] MFA Rules not processed for user `eaf3821dd57a4d8f9ca6385c202bb0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:55:54.903869 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-c9f29657-3427-4233-a99c-e1ac921aa0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:54.994792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 705/1397] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 24 15:55:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:55:55.039994 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab0396-14f1-4431-beca-949f96d652dd None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:55.040764 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab0396-14f1-4431-beca-949f96d652dd None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:55.040764 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab0396-14f1-4431-beca-949f96d652dd None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:55.042088 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 693/1398] 10.222.0.64 () {54 vars in 943 bytes} [Wed Aug 24 15:55:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:55:55.050016 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e2991-c560-4e8f-b8ea-161440d0d388 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:55.050404 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e2991-c560-4e8f-b8ea-161440d0d388 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:55.050744 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e2991-c560-4e8f-b8ea-161440d0d388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:55.131834 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-aa2e2991-c560-4e8f-b8ea-161440d0d388 None None] MFA Rules not processed for user `b3a0a84e4c4e47fc930881109fc07039`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:55:55.133067 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-aa2e2991-c560-4e8f-b8ea-161440d0d388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:55.204348 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:55.252217 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 706/1399] 10.222.0.64 () {58 vars in 1040 bytes} [Wed Aug 24 15:55:55 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:55:55.262410 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab0396-14f1-4431-beca-949f96d652dd None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:55:55.264104 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-daab0396-14f1-4431-beca-949f96d652dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:55.429447 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab0396-14f1-4431-beca-949f96d652dd None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:55:55.440389 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:55.546497 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431ca63-43a0-4f00-8c91-f81c68c9754f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a0a84e4c4e47fc930881109fc07039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:55:55.547116 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431ca63-43a0-4f00-8c91-f81c68c9754f service swift] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:55.547392 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431ca63-43a0-4f00-8c91-f81c68c9754f service swift] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:55.547660 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431ca63-43a0-4f00-8c91-f81c68c9754f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:55.549327 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-2431ca63-43a0-4f00-8c91-f81c68c9754f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:55.635533 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431ca63-43a0-4f00-8c91-f81c68c9754f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:55:55.637424 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431ca63-43a0-4f00-8c91-f81c68c9754f service swift] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:55:55.647383 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 694/1400] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 24 15:55:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 15:55:56.228112 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e71f1-192f-4173-9335-a20c18925c2d None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:56.228697 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e71f1-192f-4173-9335-a20c18925c2d None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:56.228697 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e71f1-192f-4173-9335-a20c18925c2d None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:56.230112 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 707/1401] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:55:56.236482 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58799f98-15bc-4342-83e7-1fb15a8d6695 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:56.237128 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58799f98-15bc-4342-83e7-1fb15a8d6695 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:56.237128 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58799f98-15bc-4342-83e7-1fb15a8d6695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:56.323582 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:56.348455 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-58799f98-15bc-4342-83e7-1fb15a8d6695 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:55:56.349738 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-58799f98-15bc-4342-83e7-1fb15a8d6695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:56.476917 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 695/1402] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:55:56.769566 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e71f1-192f-4173-9335-a20c18925c2d None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:55:56.771107 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-b21e71f1-192f-4173-9335-a20c18925c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:56.957294 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e71f1-192f-4173-9335-a20c18925c2d None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:55:57.004336 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:57.096067 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa6cdb9-6c8c-4d37-90fa-d64f9857f44b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:55:57.096595 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6cdb9-6c8c-4d37-90fa-d64f9857f44b service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:57.096910 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6cdb9-6c8c-4d37-90fa-d64f9857f44b service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:57.097188 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6cdb9-6c8c-4d37-90fa-d64f9857f44b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:57.098910 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-daa6cdb9-6c8c-4d37-90fa-d64f9857f44b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:57.209156 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa6cdb9-6c8c-4d37-90fa-d64f9857f44b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:55:57.210937 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa6cdb9-6c8c-4d37-90fa-d64f9857f44b service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:55:57.232343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 708/1403] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:55:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:55:59.491773 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070093f6-4a4c-433c-8294-38da8c67fd28 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:59.492367 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070093f6-4a4c-433c-8294-38da8c67fd28 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:59.492367 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070093f6-4a4c-433c-8294-38da8c67fd28 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:59.493970 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 696/1404] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:55:59.502508 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ac78f-0c88-4b74-9a21-7a28c9293ec8 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:59.503036 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ac78f-0c88-4b74-9a21-7a28c9293ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:59.503036 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ac78f-0c88-4b74-9a21-7a28c9293ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:59.586921 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:59.598483 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-a44ac78f-0c88-4b74-9a21-7a28c9293ec8 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:55:59.599782 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-a44ac78f-0c88-4b74-9a21-7a28c9293ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:59.724652 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 709/1405] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:56:00.020391 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070093f6-4a4c-433c-8294-38da8c67fd28 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:56:00.021973 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-070093f6-4a4c-433c-8294-38da8c67fd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:00.149876 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:00.183416 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070093f6-4a4c-433c-8294-38da8c67fd28 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:56:00.315503 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92817fb0-e964-45d7-ad85-d9e1ac5961bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:56:00.316146 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92817fb0-e964-45d7-ad85-d9e1ac5961bd service nova] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:00.316397 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92817fb0-e964-45d7-ad85-d9e1ac5961bd service nova] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:00.316698 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92817fb0-e964-45d7-ad85-d9e1ac5961bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:00.318322 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-92817fb0-e964-45d7-ad85-d9e1ac5961bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:00.408683 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:00.422179 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92817fb0-e964-45d7-ad85-d9e1ac5961bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:56:00.427755 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92817fb0-e964-45d7-ad85-d9e1ac5961bd service nova] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:56:00.443665 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 697/1406] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:56:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:56:02.547603 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b110bd9-04ea-485b-8b46-c85854b637d9 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:02.548156 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b110bd9-04ea-485b-8b46-c85854b637d9 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:02.548156 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b110bd9-04ea-485b-8b46-c85854b637d9 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:02.549517 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 710/1407] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:56:02.554958 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823fcc3-4b96-4c5a-b1de-dc8b83e624c8 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:02.555435 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823fcc3-4b96-4c5a-b1de-dc8b83e624c8 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:02.555435 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823fcc3-4b96-4c5a-b1de-dc8b83e624c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:02.625200 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-f823fcc3-4b96-4c5a-b1de-dc8b83e624c8 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:56:02.626548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-f823fcc3-4b96-4c5a-b1de-dc8b83e624c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:02.742611 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 698/1408] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:56:03.046339 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b110bd9-04ea-485b-8b46-c85854b637d9 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:56:03.047880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-1b110bd9-04ea-485b-8b46-c85854b637d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:03.178335 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:03.207793 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b110bd9-04ea-485b-8b46-c85854b637d9 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:56:03.346913 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf0bdd-a0a0-467d-b729-a6cbf4fc8de5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:56:03.347558 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf0bdd-a0a0-467d-b729-a6cbf4fc8de5 service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:03.347838 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf0bdd-a0a0-467d-b729-a6cbf4fc8de5 service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:03.348136 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf0bdd-a0a0-467d-b729-a6cbf4fc8de5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:03.350065 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-5ecf0bdd-a0a0-467d-b729-a6cbf4fc8de5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:03.446153 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:03.449968 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf0bdd-a0a0-467d-b729-a6cbf4fc8de5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:56:03.451970 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf0bdd-a0a0-467d-b729-a6cbf4fc8de5 service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:56:03.473610 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 711/1409] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:56:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:56:12.740794 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=74 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:13.475049 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=7 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:19.792097 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd362d-3ddf-4534-9ad5-2ce1f98e19ae None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:19.799129 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd362d-3ddf-4534-9ad5-2ce1f98e19ae None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:19.799129 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd362d-3ddf-4534-9ad5-2ce1f98e19ae None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:19.799129 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 699/1410] 10.222.0.64 () {54 vars in 918 bytes} [Wed Aug 24 15:56:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:56:19.805030 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bb604-d05a-41c2-881b-e31d126e608d None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:19.805030 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bb604-d05a-41c2-881b-e31d126e608d None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:19.805030 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bb604-d05a-41c2-881b-e31d126e608d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:19.883283 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-6b1bb604-d05a-41c2-881b-e31d126e608d None None] MFA Rules not processed for user `4f6907dfd3254d3c97d07ca2fb648858`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:56:19.884523 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-6b1bb604-d05a-41c2-881b-e31d126e608d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:19.993620 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 712/1411] 10.222.0.64 () {58 vars in 1015 bytes} [Wed Aug 24 15:56:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:56:20.009049 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c665b1-a0c3-4288-a4f0-efab5b863863 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:20.009331 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c665b1-a0c3-4288-a4f0-efab5b863863 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:20.009604 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c665b1-a0c3-4288-a4f0-efab5b863863 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:20.011194 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 700/1412] 10.222.0.64 () {54 vars in 918 bytes} [Wed Aug 24 15:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:56:20.016008 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d59389-f728-4baa-bf2f-5f6a6c56c2b0 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:20.016298 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d59389-f728-4baa-bf2f-5f6a6c56c2b0 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:20.016571 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d59389-f728-4baa-bf2f-5f6a6c56c2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:20.095645 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:20.098834 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-64d59389-f728-4baa-bf2f-5f6a6c56c2b0 None None] MFA Rules not processed for user `e5f0d8fe42e74d68bfa9a0e365bab4b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:56:20.100071 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-64d59389-f728-4baa-bf2f-5f6a6c56c2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:20.221484 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 713/1413] 10.222.0.64 () {58 vars in 1015 bytes} [Wed Aug 24 15:56:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:56:22.672938 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0cf97-94de-496e-b15e-1d7b2e9d7d2f None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:22.681375 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0cf97-94de-496e-b15e-1d7b2e9d7d2f None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:22.681375 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0cf97-94de-496e-b15e-1d7b2e9d7d2f None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:22.681375 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 701/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 15:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:56:22.688046 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50f99c-0227-497e-b7c7-9416ff12bbf6 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:22.688586 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50f99c-0227-497e-b7c7-9416ff12bbf6 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:22.688586 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50f99c-0227-497e-b7c7-9416ff12bbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:22.763768 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-ee50f99c-0227-497e-b7c7-9416ff12bbf6 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:56:22.765176 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-ee50f99c-0227-497e-b7c7-9416ff12bbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:22.823881 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:22.870368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 714/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 15:56:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:56:23.162070 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0cf97-94de-496e-b15e-1d7b2e9d7d2f None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:56:23.163645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-0ab0cf97-94de-496e-b15e-1d7b2e9d7d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:23.314804 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0cf97-94de-496e-b15e-1d7b2e9d7d2f None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:56:23.391470 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:23.433562 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6950e-4b9a-4173-ba99-f46d5527095a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:56:23.434274 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6950e-4b9a-4173-ba99-f46d5527095a service nova] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:23.435203 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6950e-4b9a-4173-ba99-f46d5527095a service nova] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:23.435579 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6950e-4b9a-4173-ba99-f46d5527095a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:23.437955 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-8ef6950e-4b9a-4173-ba99-f46d5527095a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:23.531956 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef6950e-4b9a-4173-ba99-f46d5527095a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:56:23.533590 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef6950e-4b9a-4173-ba99-f46d5527095a service nova] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:56:23.552410 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 702/1416] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:56:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:56:24.473061 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597aaf5-6832-4908-bb9e-df9c93545e80 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:24.473602 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597aaf5-6832-4908-bb9e-df9c93545e80 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:24.473602 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597aaf5-6832-4908-bb9e-df9c93545e80 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:24.475031 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 15:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:56:24.480321 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cec61-c24c-43df-86b4-e009d5296e4e None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:24.480823 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cec61-c24c-43df-86b4-e009d5296e4e None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:24.480928 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cec61-c24c-43df-86b4-e009d5296e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:24.560118 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-048cec61-c24c-43df-86b4-e009d5296e4e None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:56:24.561320 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-048cec61-c24c-43df-86b4-e009d5296e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:24.589810 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:24.662723 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 15:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:56:24.816285 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597aaf5-6832-4908-bb9e-df9c93545e80 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:56:24.817803 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-8597aaf5-6832-4908-bb9e-df9c93545e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:24.968097 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597aaf5-6832-4908-bb9e-df9c93545e80 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:56:25.009968 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:25.087922 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9ccf7-3c80-4615-843f-04ec18cd27ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:56:25.088444 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9ccf7-3c80-4615-843f-04ec18cd27ce service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:25.088791 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9ccf7-3c80-4615-843f-04ec18cd27ce service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:25.089064 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9ccf7-3c80-4615-843f-04ec18cd27ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:25.090766 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-cfb9ccf7-3c80-4615-843f-04ec18cd27ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:25.185622 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9ccf7-3c80-4615-843f-04ec18cd27ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:56:25.187049 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9ccf7-3c80-4615-843f-04ec18cd27ce service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:56:25.206051 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 716/1419] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:56:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:56:26.115218 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c271bd-25b4-4a04-b4b3-833450bc3710 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:26.115821 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c271bd-25b4-4a04-b4b3-833450bc3710 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:26.115821 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c271bd-25b4-4a04-b4b3-833450bc3710 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:26.117210 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 15:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:56:26.123407 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f9f55-234c-4cfc-b014-af4e8d95272f None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:26.123910 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f9f55-234c-4cfc-b014-af4e8d95272f None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:26.124005 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f9f55-234c-4cfc-b014-af4e8d95272f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:26.180092 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:26.203781 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-555f9f55-234c-4cfc-b014-af4e8d95272f None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:56:26.205364 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-555f9f55-234c-4cfc-b014-af4e8d95272f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:26.306982 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 15:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:56:26.468895 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c271bd-25b4-4a04-b4b3-833450bc3710 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:56:26.470577 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-48c271bd-25b4-4a04-b4b3-833450bc3710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:26.619327 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c271bd-25b4-4a04-b4b3-833450bc3710 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:56:26.632683 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:26.735676 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668513d7-9f7e-4f79-a12b-d0ac2d79e415 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:56:26.736313 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668513d7-9f7e-4f79-a12b-d0ac2d79e415 service nova] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:26.736589 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668513d7-9f7e-4f79-a12b-d0ac2d79e415 service nova] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:26.736895 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668513d7-9f7e-4f79-a12b-d0ac2d79e415 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:26.738475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-668513d7-9f7e-4f79-a12b-d0ac2d79e415 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:26.831344 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668513d7-9f7e-4f79-a12b-d0ac2d79e415 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:56:26.832984 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668513d7-9f7e-4f79-a12b-d0ac2d79e415 service nova] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:56:26.851962 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 705/1422] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:56:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:56:27.727592 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45a454-062e-4163-a422-bdc05d0f745c None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:27.728159 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45a454-062e-4163-a422-bdc05d0f745c None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:27.728159 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45a454-062e-4163-a422-bdc05d0f745c None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:27.729690 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 15:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:56:27.735762 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a53795-d3d8-454e-ab52-3b1c95cf9e8e None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:27.736327 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a53795-d3d8-454e-ab52-3b1c95cf9e8e None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:27.736462 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a53795-d3d8-454e-ab52-3b1c95cf9e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:27.758031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:27.817511 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-e9a53795-d3d8-454e-ab52-3b1c95cf9e8e None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:56:27.823627 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e9a53795-d3d8-454e-ab52-3b1c95cf9e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:27.925040 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 15:56:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:56:28.077028 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45a454-062e-4163-a422-bdc05d0f745c None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:56:28.078642 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-0c45a454-062e-4163-a422-bdc05d0f745c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:28.198608 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:28.236854 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45a454-062e-4163-a422-bdc05d0f745c None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:56:28.359277 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e5abe-b5fb-4145-b6d9-f8df1076af99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:56:28.359837 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e5abe-b5fb-4145-b6d9-f8df1076af99 service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:28.360088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e5abe-b5fb-4145-b6d9-f8df1076af99 service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:28.360360 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e5abe-b5fb-4145-b6d9-f8df1076af99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:28.362027 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-b80e5abe-b5fb-4145-b6d9-f8df1076af99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:28.441719 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:28.456300 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80e5abe-b5fb-4145-b6d9-f8df1076af99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:56:28.459776 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80e5abe-b5fb-4145-b6d9-f8df1076af99 service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:56:28.479403 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 719/1425] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:56:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:56:29.368459 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a6f1c-083f-405b-be54-03958b6605d7 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:29.369148 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a6f1c-083f-405b-be54-03958b6605d7 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:29.369148 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a6f1c-083f-405b-be54-03958b6605d7 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:29.370392 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 15:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:56:29.377341 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d0df4-84c4-4c2e-9f72-ab6c53de3e6f None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:29.377814 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d0df4-84c4-4c2e-9f72-ab6c53de3e6f None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:29.378345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d0df4-84c4-4c2e-9f72-ab6c53de3e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:29.461580 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-516d0df4-84c4-4c2e-9f72-ab6c53de3e6f None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:56:29.462816 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-516d0df4-84c4-4c2e-9f72-ab6c53de3e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:29.568180 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 15:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:56:29.728297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a6f1c-083f-405b-be54-03958b6605d7 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:56:29.729876 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-847a6f1c-083f-405b-be54-03958b6605d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:29.819234 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:29.890201 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a6f1c-083f-405b-be54-03958b6605d7 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:56:30.009885 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3e7fc-ad54-49a1-aefb-63f2ddf70042 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:56:30.010495 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3e7fc-ad54-49a1-aefb-63f2ddf70042 service nova] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:30.010772 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3e7fc-ad54-49a1-aefb-63f2ddf70042 service nova] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:30.011042 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3e7fc-ad54-49a1-aefb-63f2ddf70042 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:30.012676 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-96e3e7fc-ad54-49a1-aefb-63f2ddf70042 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:30.065873 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:30.110486 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3e7fc-ad54-49a1-aefb-63f2ddf70042 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:56:30.111993 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3e7fc-ad54-49a1-aefb-63f2ddf70042 service nova] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:56:30.134676 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 708/1428] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:56:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:56:31.035516 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bc2d7-3deb-47b8-9d55-a56ee49fa5e8 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:31.036153 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bc2d7-3deb-47b8-9d55-a56ee49fa5e8 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:31.036153 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bc2d7-3deb-47b8-9d55-a56ee49fa5e8 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:31.037384 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 15:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:56:31.042480 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89785b-3ba6-4f7e-b8a6-cba2dd78fce8 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:31.042942 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89785b-3ba6-4f7e-b8a6-cba2dd78fce8 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:31.043050 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89785b-3ba6-4f7e-b8a6-cba2dd78fce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:31.122300 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-9c89785b-3ba6-4f7e-b8a6-cba2dd78fce8 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:56:31.123472 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-9c89785b-3ba6-4f7e-b8a6-cba2dd78fce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:31.224498 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 15:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:56:31.382866 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676bc2d7-3deb-47b8-9d55-a56ee49fa5e8 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:56:31.384578 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-676bc2d7-3deb-47b8-9d55-a56ee49fa5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:31.435764 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:31.546113 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676bc2d7-3deb-47b8-9d55-a56ee49fa5e8 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:56:31.673613 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae229af1-e44d-4eaa-a709-1c89cc86b129 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:56:31.674132 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae229af1-e44d-4eaa-a709-1c89cc86b129 service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:31.674410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae229af1-e44d-4eaa-a709-1c89cc86b129 service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:31.674680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae229af1-e44d-4eaa-a709-1c89cc86b129 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:31.676269 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-ae229af1-e44d-4eaa-a709-1c89cc86b129 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:31.683046 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:31.775118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae229af1-e44d-4eaa-a709-1c89cc86b129 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:56:31.776798 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae229af1-e44d-4eaa-a709-1c89cc86b129 service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:56:31.796887 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 722/1431] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:56:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:56:32.694609 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7d593-e1e9-4b94-9be4-a0a7f132c394 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:32.695180 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7d593-e1e9-4b94-9be4-a0a7f132c394 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:32.695180 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7d593-e1e9-4b94-9be4-a0a7f132c394 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:32.696381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 15:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:56:32.701647 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2373565-5252-46aa-a0a3-82645e2a6aa2 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:32.702347 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2373565-5252-46aa-a0a3-82645e2a6aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:32.702583 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2373565-5252-46aa-a0a3-82645e2a6aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:32.782274 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-c2373565-5252-46aa-a0a3-82645e2a6aa2 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:56:32.783487 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-c2373565-5252-46aa-a0a3-82645e2a6aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:32.866268 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:32.897160 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 15:56:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:56:33.051089 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7d593-e1e9-4b94-9be4-a0a7f132c394 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:56:33.052647 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-a9e7d593-e1e9-4b94-9be4-a0a7f132c394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:33.072012 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:33.208335 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7d593-e1e9-4b94-9be4-a0a7f132c394 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:56:33.298761 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:33.326506 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fd80d-fd49-4ffe-99ab-14308a704755 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:56:33.327113 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fd80d-fd49-4ffe-99ab-14308a704755 service nova] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:33.327388 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fd80d-fd49-4ffe-99ab-14308a704755 service nova] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:33.327652 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fd80d-fd49-4ffe-99ab-14308a704755 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:33.329278 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-832fd80d-fd49-4ffe-99ab-14308a704755 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:33.422986 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832fd80d-fd49-4ffe-99ab-14308a704755 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:56:33.424588 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832fd80d-fd49-4ffe-99ab-14308a704755 service nova] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:56:33.443452 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 711/1434] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:56:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:56:34.325496 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cc7d1-335b-4d77-9f0a-518f2be86112 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:34.326042 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cc7d1-335b-4d77-9f0a-518f2be86112 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:34.326042 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cc7d1-335b-4d77-9f0a-518f2be86112 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:34.327426 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 15:56:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:56:34.332603 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f475a3-4987-4b47-977b-80d989d2a5ca None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:34.333120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f475a3-4987-4b47-977b-80d989d2a5ca None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:34.333218 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f475a3-4987-4b47-977b-80d989d2a5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:34.415834 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-80f475a3-4987-4b47-977b-80d989d2a5ca None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:56:34.417083 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-80f475a3-4987-4b47-977b-80d989d2a5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:34.467189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:34.524584 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 15:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:56:34.679291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71cc7d1-335b-4d77-9f0a-518f2be86112 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:56:34.680776 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-e71cc7d1-335b-4d77-9f0a-518f2be86112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:34.838881 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71cc7d1-335b-4d77-9f0a-518f2be86112 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:56:34.898146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:34.962460 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952a47b-eeec-4642-8551-d353fb272323 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:56:34.963086 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952a47b-eeec-4642-8551-d353fb272323 service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:34.963371 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952a47b-eeec-4642-8551-d353fb272323 service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:34.963646 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952a47b-eeec-4642-8551-d353fb272323 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:34.965896 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-4952a47b-eeec-4642-8551-d353fb272323 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:35.075091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952a47b-eeec-4642-8551-d353fb272323 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:56:35.076761 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952a47b-eeec-4642-8551-d353fb272323 service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:56:35.096731 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 725/1437] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:56:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:56:35.991490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf64ae-5c59-4b7a-bc44-4bf3e4c7ae9d None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:35.992069 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf64ae-5c59-4b7a-bc44-4bf3e4c7ae9d None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:35.992069 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf64ae-5c59-4b7a-bc44-4bf3e4c7ae9d None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:35.993398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 15:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:56:35.998696 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56599db8-bdac-4add-9a7a-65e76e10826a None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:35.999181 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56599db8-bdac-4add-9a7a-65e76e10826a None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:35.999283 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56599db8-bdac-4add-9a7a-65e76e10826a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:36.079451 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-56599db8-bdac-4add-9a7a-65e76e10826a None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:56:36.080697 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-56599db8-bdac-4add-9a7a-65e76e10826a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:36.082843 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:36.181452 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 15:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:56:36.336459 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf64ae-5c59-4b7a-bc44-4bf3e4c7ae9d None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:56:36.338032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-8aaf64ae-5c59-4b7a-bc44-4bf3e4c7ae9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:36.490258 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf64ae-5c59-4b7a-bc44-4bf3e4c7ae9d None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:56:36.518366 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:36.607033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b4288-d1ed-4879-9b5d-4b1cd2f0b9e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:56:36.607549 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b4288-d1ed-4879-9b5d-4b1cd2f0b9e8 service nova] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:36.607827 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b4288-d1ed-4879-9b5d-4b1cd2f0b9e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:36.608097 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b4288-d1ed-4879-9b5d-4b1cd2f0b9e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:36.609758 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-ca3b4288-d1ed-4879-9b5d-4b1cd2f0b9e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:36.701660 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b4288-d1ed-4879-9b5d-4b1cd2f0b9e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:56:36.703286 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b4288-d1ed-4879-9b5d-4b1cd2f0b9e8 service nova] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:56:36.727732 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 714/1440] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:56:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:56:38.617921 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58619e85-fddc-4de0-89eb-f9982579609c None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:38.618443 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58619e85-fddc-4de0-89eb-f9982579609c None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:38.618443 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58619e85-fddc-4de0-89eb-f9982579609c None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:38.619760 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 15:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:56:38.625488 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18c217-db5f-40f0-b0c7-77430d2972a2 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:38.625940 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18c217-db5f-40f0-b0c7-77430d2972a2 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:38.626046 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18c217-db5f-40f0-b0c7-77430d2972a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:38.669082 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:38.693570 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-2c18c217-db5f-40f0-b0c7-77430d2972a2 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:56:38.694784 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-2c18c217-db5f-40f0-b0c7-77430d2972a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:38.797024 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 15:56:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:56:39.090528 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58619e85-fddc-4de0-89eb-f9982579609c None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:56:39.092339 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-58619e85-fddc-4de0-89eb-f9982579609c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:39.200574 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58619e85-fddc-4de0-89eb-f9982579609c None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:56:39.234133 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:39.282674 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f1e26-225e-4fcd-9e85-2d5140127158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:56:39.283294 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f1e26-225e-4fcd-9e85-2d5140127158 service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:39.283578 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f1e26-225e-4fcd-9e85-2d5140127158 service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:39.283851 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f1e26-225e-4fcd-9e85-2d5140127158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:39.285524 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-cc4f1e26-225e-4fcd-9e85-2d5140127158 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:39.397681 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f1e26-225e-4fcd-9e85-2d5140127158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:56:39.399128 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f1e26-225e-4fcd-9e85-2d5140127158 service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:56:39.418807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 728/1443] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:56:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:56:41.572250 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cba5b8-5bc9-4ecc-a593-605586673019 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:41.572834 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cba5b8-5bc9-4ecc-a593-605586673019 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:41.572834 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cba5b8-5bc9-4ecc-a593-605586673019 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:41.574595 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 15:56:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:56:41.580489 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ba8f3-cfd7-4886-9ec6-55951f38f4d7 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:41.583931 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ba8f3-cfd7-4886-9ec6-55951f38f4d7 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:41.583931 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ba8f3-cfd7-4886-9ec6-55951f38f4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:41.655411 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-dd3ba8f3-cfd7-4886-9ec6-55951f38f4d7 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:56:41.656651 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-dd3ba8f3-cfd7-4886-9ec6-55951f38f4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:41.670107 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:41.762675 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 15:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:56:42.050145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cba5b8-5bc9-4ecc-a593-605586673019 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:56:42.051737 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-52cba5b8-5bc9-4ecc-a593-605586673019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:42.171246 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cba5b8-5bc9-4ecc-a593-605586673019 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:56:42.184436 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:42.248610 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d42800-447e-4b45-8554-3c233290d37b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:56:42.249237 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d42800-447e-4b45-8554-3c233290d37b service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:42.249513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d42800-447e-4b45-8554-3c233290d37b service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:42.249783 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d42800-447e-4b45-8554-3c233290d37b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:42.251373 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-39d42800-447e-4b45-8554-3c233290d37b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:42.376192 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d42800-447e-4b45-8554-3c233290d37b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:56:42.377667 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d42800-447e-4b45-8554-3c233290d37b service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:56:42.398033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 717/1446] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:56:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:56:44.730929 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ec1be-adb1-4d21-94a1-7288625750ac None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:44.731503 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ec1be-adb1-4d21-94a1-7288625750ac None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:44.731503 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ec1be-adb1-4d21-94a1-7288625750ac None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:44.732895 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 15:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:56:44.738415 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd2fd8-46f7-4a23-8da7-a8a0dd1ff54e None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:44.738867 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd2fd8-46f7-4a23-8da7-a8a0dd1ff54e None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:44.738983 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd2fd8-46f7-4a23-8da7-a8a0dd1ff54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:44.787399 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:44.806629 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-89cd2fd8-46f7-4a23-8da7-a8a0dd1ff54e None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:56:44.807856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-89cd2fd8-46f7-4a23-8da7-a8a0dd1ff54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:44.910697 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 15:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:56:45.200386 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ec1be-adb1-4d21-94a1-7288625750ac None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:56:45.201978 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-497ec1be-adb1-4d21-94a1-7288625750ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:45.314232 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ec1be-adb1-4d21-94a1-7288625750ac None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:56:45.356547 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:45.392233 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d177128-dc76-47d1-8486-04bba498f051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:56:45.393078 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d177128-dc76-47d1-8486-04bba498f051 service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:45.393572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d177128-dc76-47d1-8486-04bba498f051 service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:45.394087 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d177128-dc76-47d1-8486-04bba498f051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:45.396079 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-4d177128-dc76-47d1-8486-04bba498f051 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:45.517166 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d177128-dc76-47d1-8486-04bba498f051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:56:45.518613 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d177128-dc76-47d1-8486-04bba498f051 service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:56:45.538398 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 731/1449] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:56:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:56:47.705982 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1473a-bf62-48eb-9ba7-b899c218d364 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:47.706537 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1473a-bf62-48eb-9ba7-b899c218d364 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:47.706643 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1473a-bf62-48eb-9ba7-b899c218d364 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:47.708186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 15:56:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:56:47.714000 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0480662-7e93-4eb2-a55e-da9c4a557be0 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:47.714665 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0480662-7e93-4eb2-a55e-da9c4a557be0 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:47.717287 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0480662-7e93-4eb2-a55e-da9c4a557be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:47.785340 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-e0480662-7e93-4eb2-a55e-da9c4a557be0 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:56:47.787624 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-e0480662-7e93-4eb2-a55e-da9c4a557be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:47.809147 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:47.888976 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 15:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:56:48.179865 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1473a-bf62-48eb-9ba7-b899c218d364 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:56:48.181551 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-a9d1473a-bf62-48eb-9ba7-b899c218d364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:48.288902 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1473a-bf62-48eb-9ba7-b899c218d364 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:56:48.315036 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:48.371332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f87f64-8246-4d33-aaa6-3b54dcce4e4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:56:48.371940 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f87f64-8246-4d33-aaa6-3b54dcce4e4b service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:48.372216 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f87f64-8246-4d33-aaa6-3b54dcce4e4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:48.372486 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f87f64-8246-4d33-aaa6-3b54dcce4e4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:48.374121 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-82f87f64-8246-4d33-aaa6-3b54dcce4e4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:48.483935 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f87f64-8246-4d33-aaa6-3b54dcce4e4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:56:48.485415 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f87f64-8246-4d33-aaa6-3b54dcce4e4b service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:56:48.504063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 720/1452] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:56:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:56:50.520893 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc305f0-5873-4c4d-a8eb-84de212de892 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:50.521463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc305f0-5873-4c4d-a8eb-84de212de892 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:50.521463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc305f0-5873-4c4d-a8eb-84de212de892 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:50.522807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 15:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:56:50.528772 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83123e3-01a1-47d4-8da9-41a92e01c7d8 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:50.529271 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83123e3-01a1-47d4-8da9-41a92e01c7d8 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:50.529375 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83123e3-01a1-47d4-8da9-41a92e01c7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:50.600509 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:50.603756 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-c83123e3-01a1-47d4-8da9-41a92e01c7d8 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:56:50.605759 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-c83123e3-01a1-47d4-8da9-41a92e01c7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:50.711543 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 15:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:56:51.005793 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc305f0-5873-4c4d-a8eb-84de212de892 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:56:51.007330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-9bc305f0-5873-4c4d-a8eb-84de212de892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:51.130207 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc305f0-5873-4c4d-a8eb-84de212de892 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:56:51.183902 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:51.211869 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a5e36-0fa8-4ac0-8d89-a21e378194b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:56:51.212488 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a5e36-0fa8-4ac0-8d89-a21e378194b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:51.212804 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a5e36-0fa8-4ac0-8d89-a21e378194b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:51.213077 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a5e36-0fa8-4ac0-8d89-a21e378194b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:51.216080 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-059a5e36-0fa8-4ac0-8d89-a21e378194b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:51.332889 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a5e36-0fa8-4ac0-8d89-a21e378194b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:56:51.334343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a5e36-0fa8-4ac0-8d89-a21e378194b4 service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:56:51.354143 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 734/1455] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:56:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:56:53.386971 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d2771-434b-44af-9169-27b4628fff35 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:53.387511 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d2771-434b-44af-9169-27b4628fff35 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:53.387511 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d2771-434b-44af-9169-27b4628fff35 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:53.388906 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 15:56:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:56:53.394674 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02caa6bf-7f6b-40ca-96ca-c9c00cee6008 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:53.395160 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02caa6bf-7f6b-40ca-96ca-c9c00cee6008 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:53.395258 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02caa6bf-7f6b-40ca-96ca-c9c00cee6008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:53.462295 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-02caa6bf-7f6b-40ca-96ca-c9c00cee6008 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:56:53.463506 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-02caa6bf-7f6b-40ca-96ca-c9c00cee6008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:53.494886 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:53.566552 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 15:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:56:53.851921 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d2771-434b-44af-9169-27b4628fff35 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:56:53.853486 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-8a4d2771-434b-44af-9169-27b4628fff35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:53.963247 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d2771-434b-44af-9169-27b4628fff35 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:56:53.996673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:54.046868 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7908d6-f91e-4675-b350-50c172f6a80e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:56:54.047487 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7908d6-f91e-4675-b350-50c172f6a80e service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:54.047767 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7908d6-f91e-4675-b350-50c172f6a80e service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:54.048038 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7908d6-f91e-4675-b350-50c172f6a80e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:54.050516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-7f7908d6-f91e-4675-b350-50c172f6a80e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:54.167358 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7908d6-f91e-4675-b350-50c172f6a80e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:56:54.168721 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7908d6-f91e-4675-b350-50c172f6a80e service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:56:54.188346 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 723/1458] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:56:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:56:56.178446 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf824c0-e3ed-46b8-b3f7-99f2ebc2ea94 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:56.178995 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf824c0-e3ed-46b8-b3f7-99f2ebc2ea94 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:56.179225 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf824c0-e3ed-46b8-b3f7-99f2ebc2ea94 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:56.180590 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 15:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:56:56.186805 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece7576-cb2c-4f6d-a2c5-83e33ce36463 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:56.187354 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece7576-cb2c-4f6d-a2c5-83e33ce36463 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:56.187354 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece7576-cb2c-4f6d-a2c5-83e33ce36463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:56.256849 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-cece7576-cb2c-4f6d-a2c5-83e33ce36463 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:56:56.258059 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-cece7576-cb2c-4f6d-a2c5-83e33ce36463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:56.268968 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:56.370729 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 15:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:56:56.658792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf824c0-e3ed-46b8-b3f7-99f2ebc2ea94 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:56:56.660362 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-aaf824c0-e3ed-46b8-b3f7-99f2ebc2ea94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:56.772020 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf824c0-e3ed-46b8-b3f7-99f2ebc2ea94 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:56:56.832313 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:56.853655 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55faee0-d719-486c-b013-d41cdfea5b80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:56:56.854139 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55faee0-d719-486c-b013-d41cdfea5b80 service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:56.855956 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55faee0-d719-486c-b013-d41cdfea5b80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:56.855956 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55faee0-d719-486c-b013-d41cdfea5b80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:56.857229 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-a55faee0-d719-486c-b013-d41cdfea5b80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:56.983104 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55faee0-d719-486c-b013-d41cdfea5b80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:56:56.984557 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55faee0-d719-486c-b013-d41cdfea5b80 service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:56:57.004263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 737/1461] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:56:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:56:58.997268 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281caa80-c3fd-4c7c-89cf-b50ed2c7fa41 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:58.997809 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281caa80-c3fd-4c7c-89cf-b50ed2c7fa41 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:58.997941 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281caa80-c3fd-4c7c-89cf-b50ed2c7fa41 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:58.999266 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 15:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:56:59.005169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495bbc6-dbd5-405c-ba59-e74b84eaf5ff None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:59.005580 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495bbc6-dbd5-405c-ba59-e74b84eaf5ff None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:59.005770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495bbc6-dbd5-405c-ba59-e74b84eaf5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:59.084448 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-c495bbc6-dbd5-405c-ba59-e74b84eaf5ff None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:56:59.085721 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-c495bbc6-dbd5-405c-ba59-e74b84eaf5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:59.125800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:59.198867 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 15:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:56:59.487893 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281caa80-c3fd-4c7c-89cf-b50ed2c7fa41 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:56:59.489456 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-281caa80-c3fd-4c7c-89cf-b50ed2c7fa41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:59.598124 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281caa80-c3fd-4c7c-89cf-b50ed2c7fa41 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:56:59.637669 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:59.676401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4bcb8-c908-4a2f-954b-0c33e8d19e63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:56:59.677672 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4bcb8-c908-4a2f-954b-0c33e8d19e63 service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:59.677951 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4bcb8-c908-4a2f-954b-0c33e8d19e63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:59.678220 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4bcb8-c908-4a2f-954b-0c33e8d19e63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:59.679840 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-4fa4bcb8-c908-4a2f-954b-0c33e8d19e63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:59.800897 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa4bcb8-c908-4a2f-954b-0c33e8d19e63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:56:59.804013 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa4bcb8-c908-4a2f-954b-0c33e8d19e63 service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:56:59.822178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 726/1464] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:56:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:57:01.794956 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a6d34-ef81-40ac-903f-bd49ec17a1be None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:57:01.795574 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a6d34-ef81-40ac-903f-bd49ec17a1be None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:57:01.795574 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a6d34-ef81-40ac-903f-bd49ec17a1be None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:57:01.796895 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 15:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:57:01.802749 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2acf1-e2d6-4a0a-8242-f7cdfb0c0f4c None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:57:01.809906 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2acf1-e2d6-4a0a-8242-f7cdfb0c0f4c None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:57:01.809906 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2acf1-e2d6-4a0a-8242-f7cdfb0c0f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:57:01.873651 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-02d2acf1-e2d6-4a0a-8242-f7cdfb0c0f4c None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:57:01.874899 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-02d2acf1-e2d6-4a0a-8242-f7cdfb0c0f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:57:01.896299 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:01.980805 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 15:57:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:57:02.278259 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a6d34-ef81-40ac-903f-bd49ec17a1be None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:57:02.278259 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-628a6d34-ef81-40ac-903f-bd49ec17a1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:57:02.383782 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a6d34-ef81-40ac-903f-bd49ec17a1be None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:57:02.451266 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:02.458018 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f36e9e-f4a4-4588-b944-a61a0a85e0f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:57:02.458641 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f36e9e-f4a4-4588-b944-a61a0a85e0f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:57:02.458923 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f36e9e-f4a4-4588-b944-a61a0a85e0f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:57:02.459198 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f36e9e-f4a4-4588-b944-a61a0a85e0f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:57:02.460858 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-30f36e9e-f4a4-4588-b944-a61a0a85e0f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:57:02.570082 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f36e9e-f4a4-4588-b944-a61a0a85e0f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:57:02.571424 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f36e9e-f4a4-4588-b944-a61a0a85e0f3 service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:57:02.591426 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 740/1467] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:57:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:57:04.613202 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d55690-514a-4ae7-b7f7-d5a5a3f075ce None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:57:04.613732 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d55690-514a-4ae7-b7f7-d5a5a3f075ce None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:57:04.613732 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d55690-514a-4ae7-b7f7-d5a5a3f075ce None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:57:04.615022 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 15:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:57:04.621249 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e42f4-8224-431c-b98a-ccdda20299fc None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:57:04.621706 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e42f4-8224-431c-b98a-ccdda20299fc None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:57:04.621819 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e42f4-8224-431c-b98a-ccdda20299fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:57:04.689147 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-a16e42f4-8224-431c-b98a-ccdda20299fc None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:57:04.690362 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-a16e42f4-8224-431c-b98a-ccdda20299fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:57:04.741383 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:04.791617 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 15:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:57:05.076269 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d55690-514a-4ae7-b7f7-d5a5a3f075ce None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:57:05.077868 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-a7d55690-514a-4ae7-b7f7-d5a5a3f075ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:57:05.186189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d55690-514a-4ae7-b7f7-d5a5a3f075ce None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:57:05.234298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:05.262280 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac72dad-8db6-4d7d-b48d-cd20fff4e0cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:57:05.262888 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac72dad-8db6-4d7d-b48d-cd20fff4e0cc service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:57:05.263163 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac72dad-8db6-4d7d-b48d-cd20fff4e0cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:57:05.263432 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac72dad-8db6-4d7d-b48d-cd20fff4e0cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:57:05.265047 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-bac72dad-8db6-4d7d-b48d-cd20fff4e0cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:57:05.379942 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac72dad-8db6-4d7d-b48d-cd20fff4e0cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:57:05.381334 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac72dad-8db6-4d7d-b48d-cd20fff4e0cc service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:57:05.401658 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 729/1470] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:57:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:57:14.788819 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=22 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:15.398628 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=66 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:25.327208 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf28b0e-249b-420a-8f35-16f72558b1e3 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:57:25.327728 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf28b0e-249b-420a-8f35-16f72558b1e3 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:57:25.327833 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf28b0e-249b-420a-8f35-16f72558b1e3 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:57:25.329168 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 742/1471] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:57:25.334479 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc24c3-9feb-4934-8d0f-6fc1fc43e7fd None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:57:25.334896 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc24c3-9feb-4934-8d0f-6fc1fc43e7fd None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:57:25.335010 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc24c3-9feb-4934-8d0f-6fc1fc43e7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:57:25.401514 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-abfc24c3-9feb-4934-8d0f-6fc1fc43e7fd None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:57:25.402727 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-abfc24c3-9feb-4934-8d0f-6fc1fc43e7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:57:25.499239 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 730/1472] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:57:25.797058 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523548b8-29db-45be-a0a7-0d7faa5ecf6b None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:57:25.797340 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523548b8-29db-45be-a0a7-0d7faa5ecf6b None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:57:25.797615 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523548b8-29db-45be-a0a7-0d7faa5ecf6b None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:57:25.798973 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 743/1473] 10.222.0.64 () {54 vars in 967 bytes} [Wed Aug 24 15:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:57:25.804034 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b10ab9-6386-4352-8e62-3ca4d7148ce2 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:57:25.806178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b10ab9-6386-4352-8e62-3ca4d7148ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:57:25.806178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b10ab9-6386-4352-8e62-3ca4d7148ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:57:25.885822 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-c3b10ab9-6386-4352-8e62-3ca4d7148ce2 None None] MFA Rules not processed for user `f21fda517a384dc5a6a9f36d68ac1a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:57:25.887050 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-c3b10ab9-6386-4352-8e62-3ca4d7148ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:57:25.908360 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:25.966743 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 731/1474] 10.222.0.64 () {58 vars in 1064 bytes} [Wed Aug 24 15:57:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:57:25.974509 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523548b8-29db-45be-a0a7-0d7faa5ecf6b None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:57:25.976053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-523548b8-29db-45be-a0a7-0d7faa5ecf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:57:26.082898 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523548b8-29db-45be-a0a7-0d7faa5ecf6b None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:57:26.157782 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f6314-4563-4ff8-946f-069f3f0c13d2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21fda517a384dc5a6a9f36d68ac1a2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:57:26.158395 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f6314-4563-4ff8-946f-069f3f0c13d2 service glance] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:57:26.158695 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f6314-4563-4ff8-946f-069f3f0c13d2 service glance] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:57:26.158946 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f6314-4563-4ff8-946f-069f3f0c13d2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:57:26.160553 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-402f6314-4563-4ff8-946f-069f3f0c13d2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:57:26.215971 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:26.270669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f6314-4563-4ff8-946f-069f3f0c13d2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:57:26.272136 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f6314-4563-4ff8-946f-069f3f0c13d2 service glance] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:57:26.291816 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 744/1475] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:57:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:57:28.401663 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158b1d4-25bb-4adb-9ffb-2f1545ff7cdd None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:57:28.402248 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158b1d4-25bb-4adb-9ffb-2f1545ff7cdd None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:57:28.402248 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158b1d4-25bb-4adb-9ffb-2f1545ff7cdd None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:57:28.403547 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 732/1476] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:57:28.408759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a81ba8-e8e0-4546-ae4e-83fd59626001 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:57:28.409179 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a81ba8-e8e0-4546-ae4e-83fd59626001 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:57:28.409329 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a81ba8-e8e0-4546-ae4e-83fd59626001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:57:28.475368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-88a81ba8-e8e0-4546-ae4e-83fd59626001 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:57:28.476598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-88a81ba8-e8e0-4546-ae4e-83fd59626001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:57:28.572841 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 745/1477] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:57:28.847568 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158b1d4-25bb-4adb-9ffb-2f1545ff7cdd None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:57:28.849149 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-4158b1d4-25bb-4adb-9ffb-2f1545ff7cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:57:28.979336 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158b1d4-25bb-4adb-9ffb-2f1545ff7cdd None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:57:29.038157 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:29.083801 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3f35d-02d2-4b44-9c36-659e7d09b98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:57:29.084410 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3f35d-02d2-4b44-9c36-659e7d09b98e admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:57:29.084717 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3f35d-02d2-4b44-9c36-659e7d09b98e admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:57:29.084994 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3f35d-02d2-4b44-9c36-659e7d09b98e admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:57:29.085627 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3f35d-02d2-4b44-9c36-659e7d09b98e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:57:29.087886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: WARNING py.warnings [None req-95d3f35d-02d2-4b44-9c36-659e7d09b98e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:57:29.087886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: warnings.warn(msg) Aug 24 15:57:29.087886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: Aug 24 15:57:29.089181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3f35d-02d2-4b44-9c36-659e7d09b98e admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:57:29.109968 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 733/1478] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 24 15:57:28 2022] GET /identity/v3/projects => generated 2553 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:57:31.092955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54fed1-3d6d-4e12-b583-fd71c6269f5f None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:57:31.093509 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54fed1-3d6d-4e12-b583-fd71c6269f5f None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:57:31.093509 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54fed1-3d6d-4e12-b583-fd71c6269f5f None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:57:31.094924 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 746/1479] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:57:31.100437 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa7d69-62a1-4821-afc0-344b236571be None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:57:31.100949 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa7d69-62a1-4821-afc0-344b236571be None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:57:31.101045 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa7d69-62a1-4821-afc0-344b236571be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:57:31.169436 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-23aa7d69-62a1-4821-afc0-344b236571be None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:57:31.170654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-23aa7d69-62a1-4821-afc0-344b236571be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:57:31.267972 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 734/1480] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:57:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:57:31.564156 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54fed1-3d6d-4e12-b583-fd71c6269f5f None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:57:31.565737 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-dc54fed1-3d6d-4e12-b583-fd71c6269f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:57:31.576452 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:31.712702 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54fed1-3d6d-4e12-b583-fd71c6269f5f None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:57:31.793797 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:31.831398 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb610289-b2fd-4bfa-8741-4125be0bacc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:57:31.832002 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb610289-b2fd-4bfa-8741-4125be0bacc3 service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:57:31.832277 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb610289-b2fd-4bfa-8741-4125be0bacc3 service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:57:31.832543 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb610289-b2fd-4bfa-8741-4125be0bacc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:57:31.834196 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-cb610289-b2fd-4bfa-8741-4125be0bacc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:57:31.930467 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb610289-b2fd-4bfa-8741-4125be0bacc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:57:31.932074 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb610289-b2fd-4bfa-8741-4125be0bacc3 service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:57:31.951364 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 747/1481] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:57:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:57:34.074747 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c63cd-76fc-48ca-94d0-2fd8c6b66003 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:57:34.075359 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c63cd-76fc-48ca-94d0-2fd8c6b66003 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:57:34.075359 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c63cd-76fc-48ca-94d0-2fd8c6b66003 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:57:34.076671 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 735/1482] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:57:34.082118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7117d-03ea-414b-9570-c97ae5bbe6c1 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:57:34.082594 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7117d-03ea-414b-9570-c97ae5bbe6c1 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:57:34.082701 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7117d-03ea-414b-9570-c97ae5bbe6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:57:34.150530 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-31b7117d-03ea-414b-9570-c97ae5bbe6c1 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:57:34.151750 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-31b7117d-03ea-414b-9570-c97ae5bbe6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:57:34.200089 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:34.253030 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 748/1483] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:57:34.540705 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c63cd-76fc-48ca-94d0-2fd8c6b66003 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:57:34.542232 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-4d4c63cd-76fc-48ca-94d0-2fd8c6b66003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:57:34.568177 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:34.651028 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c63cd-76fc-48ca-94d0-2fd8c6b66003 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:57:34.725424 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458328ec-2445-40cc-9094-6605ec33a2c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:57:34.726028 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458328ec-2445-40cc-9094-6605ec33a2c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:57:34.726306 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458328ec-2445-40cc-9094-6605ec33a2c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:57:34.726578 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458328ec-2445-40cc-9094-6605ec33a2c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:57:34.728191 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-458328ec-2445-40cc-9094-6605ec33a2c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:57:34.802087 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:34.837825 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458328ec-2445-40cc-9094-6605ec33a2c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:57:34.839255 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458328ec-2445-40cc-9094-6605ec33a2c8 service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:57:34.858552 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 736/1484] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:57:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:57:36.818667 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4863a-e0da-4650-b1eb-09e1db307212 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:57:36.819245 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4863a-e0da-4650-b1eb-09e1db307212 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:57:36.819245 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4863a-e0da-4650-b1eb-09e1db307212 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:57:36.820766 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 749/1485] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:57:36.826079 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df94705-59ea-40a7-9b2e-ead90d54f4fe None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:57:36.826536 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df94705-59ea-40a7-9b2e-ead90d54f4fe None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:57:36.826656 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df94705-59ea-40a7-9b2e-ead90d54f4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:57:36.894752 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-8df94705-59ea-40a7-9b2e-ead90d54f4fe None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:57:36.896042 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-8df94705-59ea-40a7-9b2e-ead90d54f4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:57:36.997289 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 737/1486] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:57:37.287835 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4863a-e0da-4650-b1eb-09e1db307212 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:57:37.289548 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-baf4863a-e0da-4650-b1eb-09e1db307212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:57:37.394702 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4863a-e0da-4650-b1eb-09e1db307212 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:57:37.468472 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:37.470234 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5be449-5b8a-4977-8f36-2c3ca3fd023d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:57:37.470847 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5be449-5b8a-4977-8f36-2c3ca3fd023d service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:57:37.471131 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5be449-5b8a-4977-8f36-2c3ca3fd023d service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:57:37.471406 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5be449-5b8a-4977-8f36-2c3ca3fd023d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:57:37.473055 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-ae5be449-5b8a-4977-8f36-2c3ca3fd023d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:57:37.586325 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5be449-5b8a-4977-8f36-2c3ca3fd023d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:57:37.587758 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5be449-5b8a-4977-8f36-2c3ca3fd023d service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:57:37.605397 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 750/1487] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:57:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:57:39.681446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506627f-216b-42ae-8313-abeb0dbd764e None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:57:39.681975 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506627f-216b-42ae-8313-abeb0dbd764e None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:57:39.681975 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506627f-216b-42ae-8313-abeb0dbd764e None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:57:39.683272 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 738/1488] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:57:39.688485 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe459f9b-b52b-4fac-9955-f7e80eea3954 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:57:39.688977 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe459f9b-b52b-4fac-9955-f7e80eea3954 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:57:39.689074 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe459f9b-b52b-4fac-9955-f7e80eea3954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:57:39.754032 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-fe459f9b-b52b-4fac-9955-f7e80eea3954 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:57:39.755252 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-fe459f9b-b52b-4fac-9955-f7e80eea3954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:57:39.807293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:39.852591 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 751/1489] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:57:40.143599 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506627f-216b-42ae-8313-abeb0dbd764e None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:57:40.145164 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e506627f-216b-42ae-8313-abeb0dbd764e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:57:40.182056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:40.251912 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506627f-216b-42ae-8313-abeb0dbd764e None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:57:40.329998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f739ec7-6878-4748-a5e3-ecc8046f3f19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:57:40.330604 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f739ec7-6878-4748-a5e3-ecc8046f3f19 service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:57:40.330885 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f739ec7-6878-4748-a5e3-ecc8046f3f19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:57:40.331159 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f739ec7-6878-4748-a5e3-ecc8046f3f19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:57:40.332786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-5f739ec7-6878-4748-a5e3-ecc8046f3f19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:57:40.413340 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:40.442490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f739ec7-6878-4748-a5e3-ecc8046f3f19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:57:40.443950 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f739ec7-6878-4748-a5e3-ecc8046f3f19 service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:57:40.463322 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 739/1490] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:57:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:57:42.784061 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cae1a9-8c9e-4436-a2ab-28fd7a620ba8 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:57:42.784649 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cae1a9-8c9e-4436-a2ab-28fd7a620ba8 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:57:42.784649 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cae1a9-8c9e-4436-a2ab-28fd7a620ba8 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:57:42.786125 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 752/1491] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 24 15:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:57:42.791551 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87e098-01ae-48ac-8f6e-0236334b423d None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:57:42.792003 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87e098-01ae-48ac-8f6e-0236334b423d None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:57:42.792128 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87e098-01ae-48ac-8f6e-0236334b423d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:57:42.858491 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-9a87e098-01ae-48ac-8f6e-0236334b423d None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:57:42.859690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-9a87e098-01ae-48ac-8f6e-0236334b423d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:57:42.958041 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 740/1492] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 24 15:57:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:57:43.254472 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cae1a9-8c9e-4436-a2ab-28fd7a620ba8 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:57:43.256298 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-f2cae1a9-8c9e-4436-a2ab-28fd7a620ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:57:43.362508 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cae1a9-8c9e-4436-a2ab-28fd7a620ba8 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:57:43.437268 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ea507-da4c-4545-b48f-147381192343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:57:43.437867 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ea507-da4c-4545-b48f-147381192343 service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:57:43.438142 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ea507-da4c-4545-b48f-147381192343 service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:57:43.438413 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ea507-da4c-4545-b48f-147381192343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:57:43.439999 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-e37ea507-da4c-4545-b48f-147381192343 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:57:43.449677 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:43.547987 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ea507-da4c-4545-b48f-147381192343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:57:43.549474 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ea507-da4c-4545-b48f-147381192343 service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:57:43.567759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 753/1493] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:57:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:57:52.956393 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=82 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:53.565598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=50 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:59:04.964166 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9beaa-187f-446c-bbed-445c4e00042b None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:59:04.964918 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9beaa-187f-446c-bbed-445c4e00042b None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:59:04.964918 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9beaa-187f-446c-bbed-445c4e00042b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:59:05.045105 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-dab9beaa-187f-446c-bbed-445c4e00042b None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:59:05.046332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-dab9beaa-187f-446c-bbed-445c4e00042b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:59:05.151813 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 741/1494] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 15:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:59:05.160586 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e9662-4ab5-4fca-8e3d-7b6f1209933b None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:59:05.161130 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e9662-4ab5-4fca-8e3d-7b6f1209933b None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:59:05.161240 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e9662-4ab5-4fca-8e3d-7b6f1209933b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:59:05.244671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-2d8e9662-4ab5-4fca-8e3d-7b6f1209933b None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:59:05.245801 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-2d8e9662-4ab5-4fca-8e3d-7b6f1209933b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:59:05.382284 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 754/1495] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 15:59:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:59:05.387046 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9beaa-187f-446c-bbed-445c4e00042b None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:59:05.388263 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-dab9beaa-187f-446c-bbed-445c4e00042b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:59:05.400435 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9beaa-187f-446c-bbed-445c4e00042b None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:59:05.465424 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:59:05.506427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0211d62-993a-48ae-957d-50dbf00295d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:59:05.506949 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0211d62-993a-48ae-957d-50dbf00295d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:59:05.507226 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0211d62-993a-48ae-957d-50dbf00295d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:59:05.507494 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0211d62-993a-48ae-957d-50dbf00295d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:59:05.508144 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0211d62-993a-48ae-957d-50dbf00295d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:59:05.508444 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0211d62-993a-48ae-957d-50dbf00295d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:59:05.509514 dv-cinder-849325-3-smb devstack@keystone.service[81717]: WARNING py.warnings [None req-e0211d62-993a-48ae-957d-50dbf00295d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:59:05.509514 dv-cinder-849325-3-smb devstack@keystone.service[81717]: warnings.warn(msg) Aug 24 15:59:05.509514 dv-cinder-849325-3-smb devstack@keystone.service[81717]: Aug 24 15:59:05.510406 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0211d62-993a-48ae-957d-50dbf00295d4 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:59:05.523865 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 742/1496] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 15:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:59:05.537660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e9662-4ab5-4fca-8e3d-7b6f1209933b None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:59:05.547074 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e9662-4ab5-4fca-8e3d-7b6f1209933b None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:59:05.610878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:59:05.646845 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c6ea4-3a1f-4349-a067-c6203a1dc53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:59:05.647460 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c6ea4-3a1f-4349-a067-c6203a1dc53c admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:59:05.647749 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c6ea4-3a1f-4349-a067-c6203a1dc53c admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:59:05.648025 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c6ea4-3a1f-4349-a067-c6203a1dc53c admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:59:05.648663 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c6ea4-3a1f-4349-a067-c6203a1dc53c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:59:05.650494 dv-cinder-849325-3-smb devstack@keystone.service[81716]: WARNING py.warnings [None req-ba7c6ea4-3a1f-4349-a067-c6203a1dc53c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:59:05.650494 dv-cinder-849325-3-smb devstack@keystone.service[81716]: warnings.warn(msg) Aug 24 15:59:05.650494 dv-cinder-849325-3-smb devstack@keystone.service[81716]: Aug 24 15:59:05.651707 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c6ea4-3a1f-4349-a067-c6203a1dc53c admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:59:05.767187 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 755/1497] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 15:59:05 2022] POST /identity/v3/projects => generated 379 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:59:05.771846 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0211d62-993a-48ae-957d-50dbf00295d4 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:59:05.773415 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e0211d62-993a-48ae-957d-50dbf00295d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:59:05.807849 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0211d62-993a-48ae-957d-50dbf00295d4 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:59:05.906070 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509bc049-bc6f-4b8b-8ea4-3a908cb462d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:59:05.906684 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bc049-bc6f-4b8b-8ea4-3a908cb462d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:59:05.906958 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bc049-bc6f-4b8b-8ea4-3a908cb462d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:59:05.907225 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bc049-bc6f-4b8b-8ea4-3a908cb462d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:59:05.907847 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509bc049-bc6f-4b8b-8ea4-3a908cb462d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:59:05.908923 dv-cinder-849325-3-smb devstack@keystone.service[81717]: WARNING py.warnings [None req-509bc049-bc6f-4b8b-8ea4-3a908cb462d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:59:05.908923 dv-cinder-849325-3-smb devstack@keystone.service[81717]: warnings.warn(msg) Aug 24 15:59:05.908923 dv-cinder-849325-3-smb devstack@keystone.service[81717]: Aug 24 15:59:05.910262 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509bc049-bc6f-4b8b-8ea4-3a908cb462d8 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:59:06.037877 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 743/1498] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 15:59:05 2022] POST /identity/v3/users => generated 290 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:59:06.041270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c6ea4-3a1f-4349-a067-c6203a1dc53c admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:59:06.042828 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-ba7c6ea4-3a1f-4349-a067-c6203a1dc53c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:59:06.106426 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c6ea4-3a1f-4349-a067-c6203a1dc53c admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:59:06.197748 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:59:06.208776 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd9667-1fb8-4bdf-914b-ba9abb6bcabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:59:06.211194 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd9667-1fb8-4bdf-914b-ba9abb6bcabd admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:59:06.211194 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd9667-1fb8-4bdf-914b-ba9abb6bcabd admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:59:06.211194 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd9667-1fb8-4bdf-914b-ba9abb6bcabd admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:59:06.211194 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd9667-1fb8-4bdf-914b-ba9abb6bcabd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:59:06.211575 dv-cinder-849325-3-smb devstack@keystone.service[81716]: WARNING py.warnings [None req-d4dd9667-1fb8-4bdf-914b-ba9abb6bcabd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:59:06.211575 dv-cinder-849325-3-smb devstack@keystone.service[81716]: warnings.warn(msg) Aug 24 15:59:06.211575 dv-cinder-849325-3-smb devstack@keystone.service[81716]: Aug 24 15:59:06.212430 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd9667-1fb8-4bdf-914b-ba9abb6bcabd admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:59:06.225111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 756/1499] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 15:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:59:06.229374 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509bc049-bc6f-4b8b-8ea4-3a908cb462d8 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:59:06.230958 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-509bc049-bc6f-4b8b-8ea4-3a908cb462d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:59:06.242966 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509bc049-bc6f-4b8b-8ea4-3a908cb462d8 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:59:06.269679 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:59:06.340869 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b17fc-4f8d-4a29-bacd-bc11163e4ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:59:06.341474 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b17fc-4f8d-4a29-bacd-bc11163e4ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:59:06.341754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b17fc-4f8d-4a29-bacd-bc11163e4ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:59:06.342028 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b17fc-4f8d-4a29-bacd-bc11163e4ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:59:06.342667 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b17fc-4f8d-4a29-bacd-bc11163e4ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:59:06.343687 dv-cinder-849325-3-smb devstack@keystone.service[81717]: WARNING py.warnings [None req-a81b17fc-4f8d-4a29-bacd-bc11163e4ec2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:59:06.343687 dv-cinder-849325-3-smb devstack@keystone.service[81717]: warnings.warn(msg) Aug 24 15:59:06.343687 dv-cinder-849325-3-smb devstack@keystone.service[81717]: Aug 24 15:59:06.344570 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b17fc-4f8d-4a29-bacd-bc11163e4ec2 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:59:06.358124 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 744/1500] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 15:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:59:06.362930 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd9667-1fb8-4bdf-914b-ba9abb6bcabd admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:59:06.364554 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-d4dd9667-1fb8-4bdf-914b-ba9abb6bcabd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:59:06.399723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd9667-1fb8-4bdf-914b-ba9abb6bcabd admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:59:06.497068 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77ef48-c2ba-4686-8e08-93bd53803067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:59:06.498041 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77ef48-c2ba-4686-8e08-93bd53803067 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:59:06.498041 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77ef48-c2ba-4686-8e08-93bd53803067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:59:06.498260 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77ef48-c2ba-4686-8e08-93bd53803067 admin admin] PATH_INFO: `/v3/projects/c33601c19fd74455976deea9282dd005/users/1b117ca9d65f4692ae6a6dd398ae76fb/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:59:06.521603 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77ef48-c2ba-4686-8e08-93bd53803067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c33601c19fd74455976deea9282dd005, user_id=1b117ca9d65f4692ae6a6dd398ae76fb, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:59:06.522657 dv-cinder-849325-3-smb devstack@keystone.service[81716]: WARNING py.warnings [None req-6e77ef48-c2ba-4686-8e08-93bd53803067 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:59:06.522657 dv-cinder-849325-3-smb devstack@keystone.service[81716]: warnings.warn(msg) Aug 24 15:59:06.522657 dv-cinder-849325-3-smb devstack@keystone.service[81716]: Aug 24 15:59:06.524573 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77ef48-c2ba-4686-8e08-93bd53803067 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:59:06.617991 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 757/1501] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 15:59:06 2022] PUT /identity/v3/projects/c33601c19fd74455976deea9282dd005/users/1b117ca9d65f4692ae6a6dd398ae76fb/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:59:06.630747 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b72b1d-17dd-48a7-8a51-4a1639cc3561 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:59:06.631033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b72b1d-17dd-48a7-8a51-4a1639cc3561 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:59:06.631304 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b72b1d-17dd-48a7-8a51-4a1639cc3561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:59:06.696192 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-53b72b1d-17dd-48a7-8a51-4a1639cc3561 None None] MFA Rules not processed for user `1b117ca9d65f4692ae6a6dd398ae76fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:59:06.697630 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-53b72b1d-17dd-48a7-8a51-4a1639cc3561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:59:06.779701 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 745/1502] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 15:59:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:59:06.793794 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c5d50-c45e-48ab-b5c0-2e6ad9c61764 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:59:06.794085 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c5d50-c45e-48ab-b5c0-2e6ad9c61764 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:59:06.794359 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c5d50-c45e-48ab-b5c0-2e6ad9c61764 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:59:06.795760 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 758/1503] 10.222.0.64 () {54 vars in 964 bytes} [Wed Aug 24 15:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:59:06.801576 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d27bd-2a33-4a1c-a5b3-5f8938c92a29 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:59:06.801861 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d27bd-2a33-4a1c-a5b3-5f8938c92a29 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:59:06.802134 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d27bd-2a33-4a1c-a5b3-5f8938c92a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:59:06.834388 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:59:06.882191 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-1c0d27bd-2a33-4a1c-a5b3-5f8938c92a29 None None] MFA Rules not processed for user `89d937fedccb484a8a494cd686361fac`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:59:06.883389 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-1c0d27bd-2a33-4a1c-a5b3-5f8938c92a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:59:06.964000 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 746/1504] 10.222.0.64 () {58 vars in 1061 bytes} [Wed Aug 24 15:59:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:59:06.972950 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c5d50-c45e-48ab-b5c0-2e6ad9c61764 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:59:06.974493 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-a18c5d50-c45e-48ab-b5c0-2e6ad9c61764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:59:07.026422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:59:07.081966 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c5d50-c45e-48ab-b5c0-2e6ad9c61764 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:59:07.156822 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2efd3-76aa-4de5-be85-ed1e59d7dd5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:59:07.157347 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2efd3-76aa-4de5-be85-ed1e59d7dd5a service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:59:07.157622 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2efd3-76aa-4de5-be85-ed1e59d7dd5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:59:07.157888 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2efd3-76aa-4de5-be85-ed1e59d7dd5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:59:07.160120 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-63f2efd3-76aa-4de5-be85-ed1e59d7dd5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:59:07.258311 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2efd3-76aa-4de5-be85-ed1e59d7dd5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:59:07.259744 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2efd3-76aa-4de5-be85-ed1e59d7dd5a service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:59:07.263265 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:59:07.280589 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 759/1505] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:59:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:59:07.328113 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7037ed8-ca9c-40bb-8a43-c3a5d7772ebb None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:59:07.328551 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7037ed8-ca9c-40bb-8a43-c3a5d7772ebb None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:59:07.328686 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7037ed8-ca9c-40bb-8a43-c3a5d7772ebb None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:59:07.329940 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 747/1506] 10.222.0.64 () {52 vars in 830 bytes} [Wed Aug 24 15:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:59:07.333626 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2efd3-76aa-4de5-be85-ed1e59d7dd5a service cinder] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:59:07.334879 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-63f2efd3-76aa-4de5-be85-ed1e59d7dd5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:59:07.438364 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2efd3-76aa-4de5-be85-ed1e59d7dd5a service cinder] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:59:07.533433 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9cb443-08a0-4c76-810f-d265bf8f0e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:59:07.534620 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cb443-08a0-4c76-810f-d265bf8f0e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:59:07.534942 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cb443-08a0-4c76-810f-d265bf8f0e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:59:07.535218 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cb443-08a0-4c76-810f-d265bf8f0e68 admin admin] PATH_INFO: `/v3/users/1b117ca9d65f4692ae6a6dd398ae76fb` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:59:07.547620 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9cb443-08a0-4c76-810f-d265bf8f0e68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b117ca9d65f4692ae6a6dd398ae76fb)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:59:07.548680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: WARNING py.warnings [None req-1e9cb443-08a0-4c76-810f-d265bf8f0e68 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:59:07.548680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: warnings.warn(msg) Aug 24 15:59:07.548680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: Aug 24 15:59:07.550635 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9cb443-08a0-4c76-810f-d265bf8f0e68 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:59:07.560400 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:59:07.942319 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-1e9cb443-08a0-4c76-810f-d265bf8f0e68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b117ca9d65f4692ae6a6dd398ae76fb'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:59:07.942893 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-1e9cb443-08a0-4c76-810f-d265bf8f0e68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b117ca9d65f4692ae6a6dd398ae76fb'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:59:07.943321 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-1e9cb443-08a0-4c76-810f-d265bf8f0e68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b117ca9d65f4692ae6a6dd398ae76fb'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:59:07.969087 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-1e9cb443-08a0-4c76-810f-d265bf8f0e68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b117ca9d65f4692ae6a6dd398ae76fb'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:59:08.031365 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-1e9cb443-08a0-4c76-810f-d265bf8f0e68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b117ca9d65f4692ae6a6dd398ae76fb'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:59:08.053470 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 760/1507] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 15:59:07 2022] DELETE /identity/v3/users/1b117ca9d65f4692ae6a6dd398ae76fb => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:59:08.058290 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6cc68-305a-4d97-8571-f10cdb1b1b15 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:59:08.058568 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6cc68-305a-4d97-8571-f10cdb1b1b15 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:59:08.058845 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6cc68-305a-4d97-8571-f10cdb1b1b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:59:08.121557 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-17a6cc68-305a-4d97-8571-f10cdb1b1b15 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:59:08.122783 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-17a6cc68-305a-4d97-8571-f10cdb1b1b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:59:08.203688 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:59:08.217491 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 748/1508] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 15:59:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:59:08.227489 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9cb443-08a0-4c76-810f-d265bf8f0e68 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:59:08.228751 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-1e9cb443-08a0-4c76-810f-d265bf8f0e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:59:08.339064 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9cb443-08a0-4c76-810f-d265bf8f0e68 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:59:08.398903 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:59:08.418536 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18d2fd-72e6-489b-8872-8d15e99145db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:59:08.419143 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18d2fd-72e6-489b-8872-8d15e99145db service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:59:08.419420 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18d2fd-72e6-489b-8872-8d15e99145db service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:59:08.419688 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18d2fd-72e6-489b-8872-8d15e99145db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:59:08.421328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-bc18d2fd-72e6-489b-8872-8d15e99145db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:59:08.531708 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18d2fd-72e6-489b-8872-8d15e99145db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:59:08.533155 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18d2fd-72e6-489b-8872-8d15e99145db service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:59:08.552328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 761/1509] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 15:59:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:59:09.063872 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6cc68-305a-4d97-8571-f10cdb1b1b15 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:59:09.066241 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-17a6cc68-305a-4d97-8571-f10cdb1b1b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:59:09.077963 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6cc68-305a-4d97-8571-f10cdb1b1b15 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:59:09.192262 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54f5c1-5982-40a3-88da-7ad7bce9d67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:59:09.193000 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54f5c1-5982-40a3-88da-7ad7bce9d67a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:59:09.193274 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54f5c1-5982-40a3-88da-7ad7bce9d67a admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:59:09.193541 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54f5c1-5982-40a3-88da-7ad7bce9d67a admin admin] PATH_INFO: `/v3/projects/c33601c19fd74455976deea9282dd005` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:59:09.204014 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54f5c1-5982-40a3-88da-7ad7bce9d67a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c33601c19fd74455976deea9282dd005)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:59:09.205071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: WARNING py.warnings [None req-de54f5c1-5982-40a3-88da-7ad7bce9d67a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:59:09.205071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: warnings.warn(msg) Aug 24 15:59:09.205071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: Aug 24 15:59:09.207237 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54f5c1-5982-40a3-88da-7ad7bce9d67a admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:59:09.361311 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-de54f5c1-5982-40a3-88da-7ad7bce9d67a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c33601c19fd74455976deea9282dd005', 'request_id': 'req-de54f5c1-5982-40a3-88da-7ad7bce9d67a'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:59:09.361311 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-de54f5c1-5982-40a3-88da-7ad7bce9d67a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c33601c19fd74455976deea9282dd005', 'request_id': 'req-de54f5c1-5982-40a3-88da-7ad7bce9d67a'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:59:09.361311 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-de54f5c1-5982-40a3-88da-7ad7bce9d67a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c33601c19fd74455976deea9282dd005', 'request_id': 'req-de54f5c1-5982-40a3-88da-7ad7bce9d67a'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:59:09.567984 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-de54f5c1-5982-40a3-88da-7ad7bce9d67a admin admin] The token cache is being invalidate because project c33601c19fd74455976deea9282dd005 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:59:09.568274 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-de54f5c1-5982-40a3-88da-7ad7bce9d67a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:59:09.568840 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-de54f5c1-5982-40a3-88da-7ad7bce9d67a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:59:09.570178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 749/1510] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 15:59:09 2022] DELETE /identity/v3/projects/c33601c19fd74455976deea9282dd005 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:59:18.549583 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=62 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:59:19.564986 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:00:51.832233 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52547183-8611-4f6c-b205-0d9ef805b612 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:00:51.832781 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52547183-8611-4f6c-b205-0d9ef805b612 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:00:51.833416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52547183-8611-4f6c-b205-0d9ef805b612 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:00:51.834797 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 762/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 16:00:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:00:51.839943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56370a28-336d-4c6a-8183-b58d1ed13ef2 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:00:51.840384 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56370a28-336d-4c6a-8183-b58d1ed13ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:00:51.840545 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56370a28-336d-4c6a-8183-b58d1ed13ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:00:51.928899 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-56370a28-336d-4c6a-8183-b58d1ed13ef2 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:00:51.930002 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-56370a28-336d-4c6a-8183-b58d1ed13ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:00:52.038163 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 750/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 16:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:00:52.200323 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52547183-8611-4f6c-b205-0d9ef805b612 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:00:52.202548 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-52547183-8611-4f6c-b205-0d9ef805b612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:00:52.331789 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52547183-8611-4f6c-b205-0d9ef805b612 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:00:52.337503 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f517f3-47eb-4698-b625-cf1b5f8693ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:00:52.338111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f517f3-47eb-4698-b625-cf1b5f8693ad service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:00:52.338388 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f517f3-47eb-4698-b625-cf1b5f8693ad service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:00:52.338657 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f517f3-47eb-4698-b625-cf1b5f8693ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:00:52.347145 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f517f3-47eb-4698-b625-cf1b5f8693ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:00:52.348758 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f517f3-47eb-4698-b625-cf1b5f8693ad service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:00:52.358572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 763/1513] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:00:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:00:53.206586 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbb486-2258-41f6-953d-64007ab8361b None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:00:53.207110 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbb486-2258-41f6-953d-64007ab8361b None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:00:53.207110 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbb486-2258-41f6-953d-64007ab8361b None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:00:53.208413 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 751/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 16:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:00:53.213480 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5c94c-edfc-49d8-b245-8ee92b72f8e9 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:00:53.214053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5c94c-edfc-49d8-b245-8ee92b72f8e9 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:00:53.214053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5c94c-edfc-49d8-b245-8ee92b72f8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:00:53.235927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-f8f5c94c-edfc-49d8-b245-8ee92b72f8e9 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:00:53.236250 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-f8f5c94c-edfc-49d8-b245-8ee92b72f8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:00:53.244156 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 764/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 16:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:00:53.402472 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbb486-2258-41f6-953d-64007ab8361b None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:00:53.416900 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbb486-2258-41f6-953d-64007ab8361b None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:00:53.422316 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb63f5-7d99-4704-a47f-aacb76186d64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:00:53.422929 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb63f5-7d99-4704-a47f-aacb76186d64 service nova] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:00:53.423209 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb63f5-7d99-4704-a47f-aacb76186d64 service nova] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:00:53.423479 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb63f5-7d99-4704-a47f-aacb76186d64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:00:53.432324 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb63f5-7d99-4704-a47f-aacb76186d64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:00:53.434011 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb63f5-7d99-4704-a47f-aacb76186d64 service nova] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:00:53.444496 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 752/1516] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:00:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:00:54.091452 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70bce8-41f8-4d6d-a91e-e6f33d63e90e None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:00:54.091724 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70bce8-41f8-4d6d-a91e-e6f33d63e90e None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:00:54.091987 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70bce8-41f8-4d6d-a91e-e6f33d63e90e None None] PATH_INFO: `/v3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:00:54.093359 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 765/1517] 10.222.0.49 () {54 vars in 925 bytes} [Wed Aug 24 16:00:54 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:00:54.100392 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6d0ce-b758-43e5-8147-e7abb761a1af None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:00:54.100700 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6d0ce-b758-43e5-8147-e7abb761a1af None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:00:54.100972 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6d0ce-b758-43e5-8147-e7abb761a1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:00:54.167932 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-2ad6d0ce-b758-43e5-8147-e7abb761a1af None None] MFA Rules not processed for user `4f6907dfd3254d3c97d07ca2fb648858`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:00:54.169197 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-2ad6d0ce-b758-43e5-8147-e7abb761a1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:00:54.188713 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:00:54.247638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 753/1518] 10.222.0.49 () {58 vars in 1015 bytes} [Wed Aug 24 16:00:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:00:58.381787 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1f33e-e20a-441e-b493-4f728e524c16 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:00:58.382351 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1f33e-e20a-441e-b493-4f728e524c16 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:00:58.382351 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1f33e-e20a-441e-b493-4f728e524c16 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:00:58.383669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 766/1519] 10.222.0.64 () {54 vars in 961 bytes} [Wed Aug 24 16:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:00:58.389017 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75864dce-f24a-4b57-a351-288d823858b2 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:00:58.389476 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75864dce-f24a-4b57-a351-288d823858b2 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:00:58.389588 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75864dce-f24a-4b57-a351-288d823858b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:00:58.410324 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-75864dce-f24a-4b57-a351-288d823858b2 None None] MFA Rules not processed for user `4f6907dfd3254d3c97d07ca2fb648858`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:00:58.411546 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-75864dce-f24a-4b57-a351-288d823858b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:00:58.420106 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 754/1520] 10.222.0.64 () {58 vars in 1058 bytes} [Wed Aug 24 16:00:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:00:58.427668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1f33e-e20a-441e-b493-4f728e524c16 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:00:58.441183 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1f33e-e20a-441e-b493-4f728e524c16 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:00:58.446139 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4c3e3-05ff-4bcc-85da-0b87bdd20608 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6907dfd3254d3c97d07ca2fb648858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:00:58.446735 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4c3e3-05ff-4bcc-85da-0b87bdd20608 service placement] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:00:58.447010 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4c3e3-05ff-4bcc-85da-0b87bdd20608 service placement] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:00:58.447280 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4c3e3-05ff-4bcc-85da-0b87bdd20608 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:00:58.456454 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4c3e3-05ff-4bcc-85da-0b87bdd20608 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:00:58.458069 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4c3e3-05ff-4bcc-85da-0b87bdd20608 service placement] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:00:58.467935 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 767/1521] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:00:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:01:04.696226 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f5b84-d88e-4860-8896-b4cc6b0737a3 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:01:04.696785 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f5b84-d88e-4860-8896-b4cc6b0737a3 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:01:04.696785 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f5b84-d88e-4860-8896-b4cc6b0737a3 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:01:04.698201 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 755/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 16:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:01:04.703497 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1dcd16-9642-4f9b-a8c6-be6b06cbfd53 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:01:04.703896 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1dcd16-9642-4f9b-a8c6-be6b06cbfd53 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:01:04.704050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1dcd16-9642-4f9b-a8c6-be6b06cbfd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:01:04.723788 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-5f1dcd16-9642-4f9b-a8c6-be6b06cbfd53 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:01:04.725026 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-5f1dcd16-9642-4f9b-a8c6-be6b06cbfd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:01:04.732792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 768/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 16:01:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:01:04.888352 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f5b84-d88e-4860-8896-b4cc6b0737a3 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:01:04.903141 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f5b84-d88e-4860-8896-b4cc6b0737a3 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:01:04.910096 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f635c6-39cf-4e16-9ff6-21340dc393f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:01:04.910698 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f635c6-39cf-4e16-9ff6-21340dc393f9 service nova] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:01:04.911099 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f635c6-39cf-4e16-9ff6-21340dc393f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:01:04.911371 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f635c6-39cf-4e16-9ff6-21340dc393f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:01:04.919637 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f635c6-39cf-4e16-9ff6-21340dc393f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:01:04.921247 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f635c6-39cf-4e16-9ff6-21340dc393f9 service nova] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:01:04.931093 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 756/1524] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:01:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:01:05.763869 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e63f5-4b58-4497-b4fa-96e111b467b9 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:01:05.764431 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e63f5-4b58-4497-b4fa-96e111b467b9 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:01:05.764431 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e63f5-4b58-4497-b4fa-96e111b467b9 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:01:05.765829 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 769/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 16:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:01:05.771374 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d15150-3e47-4e51-8a1f-ae941b4b2702 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:01:05.771842 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d15150-3e47-4e51-8a1f-ae941b4b2702 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:01:05.771958 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d15150-3e47-4e51-8a1f-ae941b4b2702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:01:05.792026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-11d15150-3e47-4e51-8a1f-ae941b4b2702 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:01:05.793276 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-11d15150-3e47-4e51-8a1f-ae941b4b2702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:01:05.801268 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 757/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 16:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:01:05.958258 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e63f5-4b58-4497-b4fa-96e111b467b9 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:01:05.973772 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e63f5-4b58-4497-b4fa-96e111b467b9 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:01:05.979214 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f6d09-5a6b-4bb8-a690-396739ab0d12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:01:05.979809 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f6d09-5a6b-4bb8-a690-396739ab0d12 service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:01:05.980084 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f6d09-5a6b-4bb8-a690-396739ab0d12 service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:01:05.980352 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f6d09-5a6b-4bb8-a690-396739ab0d12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:01:05.989297 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f6d09-5a6b-4bb8-a690-396739ab0d12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:01:05.990884 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f6d09-5a6b-4bb8-a690-396739ab0d12 service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:01:06.000967 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 770/1527] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:01:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:01:09.769426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdc684-6309-4842-9f40-122d007f7886 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:01:09.770033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdc684-6309-4842-9f40-122d007f7886 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:01:09.770033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdc684-6309-4842-9f40-122d007f7886 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:01:09.771367 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 758/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 16:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:01:09.778714 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51168f95-6121-470c-bd77-a54818ed20e9 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:01:09.779227 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51168f95-6121-470c-bd77-a54818ed20e9 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:01:09.779334 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51168f95-6121-470c-bd77-a54818ed20e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:01:09.804071 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-51168f95-6121-470c-bd77-a54818ed20e9 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:01:09.805417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-51168f95-6121-470c-bd77-a54818ed20e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:01:09.820168 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 771/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 16:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:01:10.109656 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bdc684-6309-4842-9f40-122d007f7886 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:01:10.111655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-91bdc684-6309-4842-9f40-122d007f7886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:01:10.196745 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bdc684-6309-4842-9f40-122d007f7886 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:01:10.200577 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e539f2-db3d-47d7-ba84-151f15a7aeb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:01:10.201343 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e539f2-db3d-47d7-ba84-151f15a7aeb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:01:10.201622 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e539f2-db3d-47d7-ba84-151f15a7aeb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:01:10.201898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e539f2-db3d-47d7-ba84-151f15a7aeb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:01:10.212192 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e539f2-db3d-47d7-ba84-151f15a7aeb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:01:10.213668 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e539f2-db3d-47d7-ba84-151f15a7aeb4 service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:01:10.224204 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 759/1530] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:01:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:01:12.163256 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f7214-a955-4737-8a03-edbd9ac81501 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:01:12.163801 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f7214-a955-4737-8a03-edbd9ac81501 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:01:12.163801 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f7214-a955-4737-8a03-edbd9ac81501 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:01:12.165186 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 772/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 16:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:01:12.170682 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e87956-07f9-464b-bf29-8d089154162e None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:01:12.171184 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e87956-07f9-464b-bf29-8d089154162e None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:01:12.171287 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e87956-07f9-464b-bf29-8d089154162e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:01:12.191444 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-84e87956-07f9-464b-bf29-8d089154162e None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:01:12.192711 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-84e87956-07f9-464b-bf29-8d089154162e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:01:12.201052 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 760/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 16:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:01:12.489172 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f7214-a955-4737-8a03-edbd9ac81501 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:01:12.490905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-e52f7214-a955-4737-8a03-edbd9ac81501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:01:12.505250 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f7214-a955-4737-8a03-edbd9ac81501 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:01:12.509132 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f223778-30e2-440a-9fbe-8f2c62e2e854 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:01:12.509762 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f223778-30e2-440a-9fbe-8f2c62e2e854 service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:01:12.510041 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f223778-30e2-440a-9fbe-8f2c62e2e854 service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:01:12.510338 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f223778-30e2-440a-9fbe-8f2c62e2e854 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:01:12.521519 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f223778-30e2-440a-9fbe-8f2c62e2e854 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:01:12.522957 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f223778-30e2-440a-9fbe-8f2c62e2e854 service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:01:12.533535 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 773/1533] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:01:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:01:16.185195 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96803d-3723-43c1-8b9c-0977436aae37 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:01:16.185769 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96803d-3723-43c1-8b9c-0977436aae37 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:01:16.185873 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96803d-3723-43c1-8b9c-0977436aae37 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:01:16.187200 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 761/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 16:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:01:16.192866 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392a5bc-dc4d-4dc9-9022-871ef4a89630 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:01:16.193305 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392a5bc-dc4d-4dc9-9022-871ef4a89630 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:01:16.193432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392a5bc-dc4d-4dc9-9022-871ef4a89630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:01:16.213326 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-6392a5bc-dc4d-4dc9-9022-871ef4a89630 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:01:16.214505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-6392a5bc-dc4d-4dc9-9022-871ef4a89630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:01:16.223908 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 774/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 16:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:01:16.783077 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96803d-3723-43c1-8b9c-0977436aae37 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:01:16.784847 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-2d96803d-3723-43c1-8b9c-0977436aae37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:01:16.854956 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:01:16.868712 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96803d-3723-43c1-8b9c-0977436aae37 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:01:16.872635 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eada9de-3e3e-4f85-a914-53ddcb3d1031 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:01:16.873260 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eada9de-3e3e-4f85-a914-53ddcb3d1031 service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:01:16.877567 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eada9de-3e3e-4f85-a914-53ddcb3d1031 service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:01:16.877567 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eada9de-3e3e-4f85-a914-53ddcb3d1031 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:01:16.883093 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eada9de-3e3e-4f85-a914-53ddcb3d1031 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:01:16.884522 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eada9de-3e3e-4f85-a914-53ddcb3d1031 service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:01:16.894962 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 762/1536] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:01:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:01:18.874188 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2168aa-2d42-4ae2-a42f-7edaf68b1893 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:01:18.874764 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2168aa-2d42-4ae2-a42f-7edaf68b1893 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:01:18.874764 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2168aa-2d42-4ae2-a42f-7edaf68b1893 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:01:18.876162 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 775/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 16:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:01:18.881766 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97138e-5163-41ec-9dba-df4f2a8268de None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:01:18.882244 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97138e-5163-41ec-9dba-df4f2a8268de None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:01:18.882340 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97138e-5163-41ec-9dba-df4f2a8268de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:01:18.901992 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-1d97138e-5163-41ec-9dba-df4f2a8268de None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:01:18.903216 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-1d97138e-5163-41ec-9dba-df4f2a8268de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:01:18.911901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 763/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 16:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:01:19.475307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2168aa-2d42-4ae2-a42f-7edaf68b1893 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:01:19.477026 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-7b2168aa-2d42-4ae2-a42f-7edaf68b1893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:01:19.484603 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=84 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:01:19.490669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2168aa-2d42-4ae2-a42f-7edaf68b1893 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:01:19.494826 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba43f5-5335-41b5-b8d8-57be5f425117 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:01:19.497325 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba43f5-5335-41b5-b8d8-57be5f425117 service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:01:19.497325 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba43f5-5335-41b5-b8d8-57be5f425117 service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:01:19.497325 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba43f5-5335-41b5-b8d8-57be5f425117 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:01:19.506478 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba43f5-5335-41b5-b8d8-57be5f425117 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:01:19.508097 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba43f5-5335-41b5-b8d8-57be5f425117 service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:01:19.518686 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 776/1539] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:01:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:01:28.897053 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=11 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:01:29.521024 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=5 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:02:58.794812 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff1415-9c70-45ce-9a24-90cf072e9c35 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:02:58.796129 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff1415-9c70-45ce-9a24-90cf072e9c35 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:02:58.796947 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff1415-9c70-45ce-9a24-90cf072e9c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:02:58.826582 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-21ff1415-9c70-45ce-9a24-90cf072e9c35 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:02:58.828195 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-21ff1415-9c70-45ce-9a24-90cf072e9c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:02:58.839303 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 764/1540] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:02:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:02:58.847495 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb69f83-e0d0-40c0-b9ed-da8a7fc58a4a None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:02:58.852412 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb69f83-e0d0-40c0-b9ed-da8a7fc58a4a None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:02:58.852412 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb69f83-e0d0-40c0-b9ed-da8a7fc58a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:02:58.880060 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-deb69f83-e0d0-40c0-b9ed-da8a7fc58a4a None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:02:58.881749 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-deb69f83-e0d0-40c0-b9ed-da8a7fc58a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:02:58.891066 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 777/1541] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:02:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:02:58.896529 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff1415-9c70-45ce-9a24-90cf072e9c35 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:02:58.914738 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff1415-9c70-45ce-9a24-90cf072e9c35 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:02:58.920516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a747a2-c5ee-4780-b69b-ba5249239e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:02:58.921504 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a747a2-c5ee-4780-b69b-ba5249239e0d admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:02:58.921982 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a747a2-c5ee-4780-b69b-ba5249239e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:02:58.922470 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a747a2-c5ee-4780-b69b-ba5249239e0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:02:58.923316 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a747a2-c5ee-4780-b69b-ba5249239e0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:02:58.923819 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a747a2-c5ee-4780-b69b-ba5249239e0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:02:58.926764 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a747a2-c5ee-4780-b69b-ba5249239e0d admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:02:58.950163 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 765/1542] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:02:58.959810 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb69f83-e0d0-40c0-b9ed-da8a7fc58a4a None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:02:58.971565 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb69f83-e0d0-40c0-b9ed-da8a7fc58a4a None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:02:58.987508 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c269d-0c0a-4829-947b-dd96a2d793ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:02:58.988880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c269d-0c0a-4829-947b-dd96a2d793ae admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:02:58.989658 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c269d-0c0a-4829-947b-dd96a2d793ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:02:58.990351 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c269d-0c0a-4829-947b-dd96a2d793ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:02:58.991278 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c269d-0c0a-4829-947b-dd96a2d793ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:02:58.993758 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c269d-0c0a-4829-947b-dd96a2d793ae admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:02:59.099979 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f918a1-c5f9-4388-bc74-bd363ebc8414 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:02:59.100605 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f918a1-c5f9-4388-bc74-bd363ebc8414 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:02:59.101385 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f918a1-c5f9-4388-bc74-bd363ebc8414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:02:59.146809 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 778/1543] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:02:58 2022] POST /identity/v3/projects => generated 405 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:02:59.151768 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-86f918a1-c5f9-4388-bc74-bd363ebc8414 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:02:59.153985 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c269d-0c0a-4829-947b-dd96a2d793ae admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:02:59.160744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-86f918a1-c5f9-4388-bc74-bd363ebc8414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:02:59.357834 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c269d-0c0a-4829-947b-dd96a2d793ae admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:02:59.374593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 766/1544] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:02:59.376644 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf03cc6-2757-4ca0-8c73-ede3758e462e None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:02:59.382310 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9951da-6a01-4201-8601-d4c149ca0a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:02:59.382968 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9951da-6a01-4201-8601-d4c149ca0a6c admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:02:59.383436 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9951da-6a01-4201-8601-d4c149ca0a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:02:59.383709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9951da-6a01-4201-8601-d4c149ca0a6c admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:02:59.384349 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9951da-6a01-4201-8601-d4c149ca0a6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:02:59.385419 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf03cc6-2757-4ca0-8c73-ede3758e462e None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:02:59.385750 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf03cc6-2757-4ca0-8c73-ede3758e462e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:02:59.386682 dv-cinder-849325-3-smb devstack@keystone.service[81716]: WARNING py.warnings [None req-5e9951da-6a01-4201-8601-d4c149ca0a6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:02:59.386682 dv-cinder-849325-3-smb devstack@keystone.service[81716]: warnings.warn(msg) Aug 24 16:02:59.386682 dv-cinder-849325-3-smb devstack@keystone.service[81716]: Aug 24 16:02:59.388002 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9951da-6a01-4201-8601-d4c149ca0a6c admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:02:59.438098 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-9bf03cc6-2757-4ca0-8c73-ede3758e462e None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:02:59.439313 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-9bf03cc6-2757-4ca0-8c73-ede3758e462e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:02:59.447764 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 767/1545] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:02:59.453239 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec479b38-2b7a-47b5-97ac-cb946bf620d2 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:02:59.453529 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec479b38-2b7a-47b5-97ac-cb946bf620d2 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:02:59.453836 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec479b38-2b7a-47b5-97ac-cb946bf620d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:02:59.482144 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-ec479b38-2b7a-47b5-97ac-cb946bf620d2 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:02:59.490747 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 779/1546] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:02:59 2022] POST /identity/v3/users => generated 303 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:02:59.492143 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32631a-e30b-41f4-859c-034abb094281 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:02:59.492600 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32631a-e30b-41f4-859c-034abb094281 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:02:59.497296 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32631a-e30b-41f4-859c-034abb094281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:02:59.500273 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-ec479b38-2b7a-47b5-97ac-cb946bf620d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:02:59.517286 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 768/1547] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:02:59.518763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec479b38-2b7a-47b5-97ac-cb946bf620d2 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:02:59.535396 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec479b38-2b7a-47b5-97ac-cb946bf620d2 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:02:59.540909 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-ae32631a-e30b-41f4-859c-034abb094281 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:02:59.542221 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-ae32631a-e30b-41f4-859c-034abb094281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:02:59.553258 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54aa21-c945-42e8-a9b4-cba43c671fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:02:59.553885 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54aa21-c945-42e8-a9b4-cba43c671fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:02:59.554166 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54aa21-c945-42e8-a9b4-cba43c671fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:02:59.554437 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54aa21-c945-42e8-a9b4-cba43c671fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:02:59.555092 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54aa21-c945-42e8-a9b4-cba43c671fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:02:59.556728 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54aa21-c945-42e8-a9b4-cba43c671fb8 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:02:59.564129 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 780/1548] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:02:59.566222 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32631a-e30b-41f4-859c-034abb094281 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:02:59.591973 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 769/1549] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:02:59.594206 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54aa21-c945-42e8-a9b4-cba43c671fb8 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:02:59.597505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32631a-e30b-41f4-859c-034abb094281 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:02:59.607718 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858eaacd-79b0-4982-84d7-5120504aee4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:02:59.608437 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858eaacd-79b0-4982-84d7-5120504aee4b admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:02:59.608662 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858eaacd-79b0-4982-84d7-5120504aee4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:02:59.608950 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858eaacd-79b0-4982-84d7-5120504aee4b admin admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:02:59.609598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858eaacd-79b0-4982-84d7-5120504aee4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:02:59.610300 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858eaacd-79b0-4982-84d7-5120504aee4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:02:59.611370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: WARNING py.warnings [None req-858eaacd-79b0-4982-84d7-5120504aee4b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:02:59.611370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: warnings.warn(msg) Aug 24 16:02:59.611370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: Aug 24 16:02:59.612848 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858eaacd-79b0-4982-84d7-5120504aee4b admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:02:59.629566 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54aa21-c945-42e8-a9b4-cba43c671fb8 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:02:59.640042 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4163767-9f6a-4dc3-9c7b-1e7bd3566133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:02:59.644776 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4163767-9f6a-4dc3-9c7b-1e7bd3566133 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:02:59.645231 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4163767-9f6a-4dc3-9c7b-1e7bd3566133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:02:59.645539 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4163767-9f6a-4dc3-9c7b-1e7bd3566133 admin admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:02:59.646191 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4163767-9f6a-4dc3-9c7b-1e7bd3566133 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:02:59.646550 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4163767-9f6a-4dc3-9c7b-1e7bd3566133 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:02:59.648197 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4163767-9f6a-4dc3-9c7b-1e7bd3566133 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:02:59.652362 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 781/1550] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:02:59.654327 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5070c-87c1-4012-8b2c-1b7eb81fd85b None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:02:59.654327 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5070c-87c1-4012-8b2c-1b7eb81fd85b None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:02:59.654720 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5070c-87c1-4012-8b2c-1b7eb81fd85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:02:59.671879 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 770/1551] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:02:59.672647 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4163767-9f6a-4dc3-9c7b-1e7bd3566133 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:02:59.701320 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4163767-9f6a-4dc3-9c7b-1e7bd3566133 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:02:59.703141 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-eee5070c-87c1-4012-8b2c-1b7eb81fd85b None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:02:59.704436 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-eee5070c-87c1-4012-8b2c-1b7eb81fd85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:02:59.707288 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49de93-81b4-4cfa-83dc-e3bfe6fbff72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:02:59.707929 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49de93-81b4-4cfa-83dc-e3bfe6fbff72 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:02:59.708210 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49de93-81b4-4cfa-83dc-e3bfe6fbff72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:02:59.708484 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49de93-81b4-4cfa-83dc-e3bfe6fbff72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:02:59.709170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49de93-81b4-4cfa-83dc-e3bfe6fbff72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:02:59.711082 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49de93-81b4-4cfa-83dc-e3bfe6fbff72 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:02:59.743159 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 771/1552] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:02:59.743740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49de93-81b4-4cfa-83dc-e3bfe6fbff72 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:02:59.744956 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 782/1553] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:02:59.745567 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5070c-87c1-4012-8b2c-1b7eb81fd85b None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:02:59.762614 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5070c-87c1-4012-8b2c-1b7eb81fd85b None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:02:59.767505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49de93-81b4-4cfa-83dc-e3bfe6fbff72 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:02:59.777176 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c0e993-ee3a-42ac-9f4f-f6a3aee1d4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:02:59.778007 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0e993-ee3a-42ac-9f4f-f6a3aee1d4cb admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:02:59.778274 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0e993-ee3a-42ac-9f4f-f6a3aee1d4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:02:59.778556 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0e993-ee3a-42ac-9f4f-f6a3aee1d4cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:02:59.779197 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c0e993-ee3a-42ac-9f4f-f6a3aee1d4cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:02:59.780236 dv-cinder-849325-3-smb devstack@keystone.service[81717]: WARNING py.warnings [None req-52c0e993-ee3a-42ac-9f4f-f6a3aee1d4cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:02:59.780236 dv-cinder-849325-3-smb devstack@keystone.service[81717]: warnings.warn(msg) Aug 24 16:02:59.780236 dv-cinder-849325-3-smb devstack@keystone.service[81717]: Aug 24 16:02:59.781457 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c0e993-ee3a-42ac-9f4f-f6a3aee1d4cb admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:02:59.791006 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e144ae-cbae-48b5-ab7e-5804997aaca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:02:59.791648 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e144ae-cbae-48b5-ab7e-5804997aaca8 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:02:59.791930 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e144ae-cbae-48b5-ab7e-5804997aaca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:02:59.792212 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e144ae-cbae-48b5-ab7e-5804997aaca8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:02:59.792857 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e144ae-cbae-48b5-ab7e-5804997aaca8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:02:59.794927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e144ae-cbae-48b5-ab7e-5804997aaca8 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:02:59.979311 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 772/1554] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:02:59 2022] POST /identity/v3/projects => generated 393 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:02:59.979311 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63526d62-14e4-4f67-be71-5cdefeb1a526 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:02:59.980082 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63526d62-14e4-4f67-be71-5cdefeb1a526 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:02:59.980082 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63526d62-14e4-4f67-be71-5cdefeb1a526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:00.001406 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-63526d62-14e4-4f67-be71-5cdefeb1a526 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:00.002809 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-63526d62-14e4-4f67-be71-5cdefeb1a526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:00.032702 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 783/1555] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:02:59 2022] POST /identity/v3/projects => generated 387 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:00.032702 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e144ae-cbae-48b5-ab7e-5804997aaca8 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:00.068321 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 773/1556] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:00.069627 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1830f00-73d4-4bdb-a373-d8076fe908b5 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:00.069917 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1830f00-73d4-4bdb-a373-d8076fe908b5 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:00.070196 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1830f00-73d4-4bdb-a373-d8076fe908b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:00.090412 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-c1830f00-73d4-4bdb-a373-d8076fe908b5 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:00.091634 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-c1830f00-73d4-4bdb-a373-d8076fe908b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:00.098894 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e144ae-cbae-48b5-ab7e-5804997aaca8 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:00.100480 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 774/1557] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:00.101756 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fec2f4-f8ea-497f-9786-d3b2cefa4220 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:00.102042 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fec2f4-f8ea-497f-9786-d3b2cefa4220 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:00.102318 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fec2f4-f8ea-497f-9786-d3b2cefa4220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:00.108298 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a567cd-3e89-4d39-a110-94fdc0186be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:00.109009 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a567cd-3e89-4d39-a110-94fdc0186be8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:00.109292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a567cd-3e89-4d39-a110-94fdc0186be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:00.109569 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a567cd-3e89-4d39-a110-94fdc0186be8 admin admin] PATH_INFO: `/v3/projects/2a005464ffbb43889eb8adaf18bd09d9/users/74e3f462380c432287adf0e30372c697/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:00.111608 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:00.119459 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:00.123952 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-d5fec2f4-f8ea-497f-9786-d3b2cefa4220 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:00.127779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-d5fec2f4-f8ea-497f-9786-d3b2cefa4220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:00.127903 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a567cd-3e89-4d39-a110-94fdc0186be8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a005464ffbb43889eb8adaf18bd09d9, user_id=74e3f462380c432287adf0e30372c697, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:00.129628 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a567cd-3e89-4d39-a110-94fdc0186be8 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:00.133634 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 775/1558] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:00.138073 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4c568-4580-4a24-8a73-c310ebd44317 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:00.138358 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4c568-4580-4a24-8a73-c310ebd44317 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:00.138633 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4c568-4580-4a24-8a73-c310ebd44317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:00.165325 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-afd4c568-4580-4a24-8a73-c310ebd44317 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:00.166540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-afd4c568-4580-4a24-8a73-c310ebd44317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:00.175665 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 776/1559] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:00.178583 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4c568-4580-4a24-8a73-c310ebd44317 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:00.186433 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4c568-4580-4a24-8a73-c310ebd44317 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:00.191516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ed0c1-37e5-4b12-93c9-6e014174a9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:00.192103 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ed0c1-37e5-4b12-93c9-6e014174a9cb admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:00.192428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ed0c1-37e5-4b12-93c9-6e014174a9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:00.192743 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ed0c1-37e5-4b12-93c9-6e014174a9cb admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:00.193364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ed0c1-37e5-4b12-93c9-6e014174a9cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:00.195391 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ed0c1-37e5-4b12-93c9-6e014174a9cb admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:00.204539 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 784/1560] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:00 2022] PUT /identity/v3/projects/2a005464ffbb43889eb8adaf18bd09d9/users/74e3f462380c432287adf0e30372c697/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:00.206710 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00465106-de36-480e-b93d-989fb03c3d29 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:00.207367 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00465106-de36-480e-b93d-989fb03c3d29 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:00.207367 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00465106-de36-480e-b93d-989fb03c3d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:00.229834 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-00465106-de36-480e-b93d-989fb03c3d29 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:00.231052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-00465106-de36-480e-b93d-989fb03c3d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:00.277456 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 777/1561] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:03:00 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:00.277456 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ed0c1-37e5-4b12-93c9-6e014174a9cb admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:00.286906 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ed0c1-37e5-4b12-93c9-6e014174a9cb admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:00.297204 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 785/1562] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:00.298115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00465106-de36-480e-b93d-989fb03c3d29 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:00.308489 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00465106-de36-480e-b93d-989fb03c3d29 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:00.315938 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74e3f5-b51d-42c5-a33a-2c7ae03a66e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:00.317279 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74e3f5-b51d-42c5-a33a-2c7ae03a66e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:00.317797 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74e3f5-b51d-42c5-a33a-2c7ae03a66e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:00.318216 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74e3f5-b51d-42c5-a33a-2c7ae03a66e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:00.319087 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74e3f5-b51d-42c5-a33a-2c7ae03a66e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:03:00.319606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74e3f5-b51d-42c5-a33a-2c7ae03a66e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:00.322227 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74e3f5-b51d-42c5-a33a-2c7ae03a66e1 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:00.337118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 786/1563] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:03:00.338605 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6690c03-1791-4367-a816-6b913d39137e None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:00.338995 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6690c03-1791-4367-a816-6b913d39137e None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:00.339379 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6690c03-1791-4367-a816-6b913d39137e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:00.362658 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-b6690c03-1791-4367-a816-6b913d39137e None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:00.368568 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-b6690c03-1791-4367-a816-6b913d39137e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:00.372997 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 787/1564] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:00.374460 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ec1ca-758a-4dff-9d26-2b617689d804 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:00.374821 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ec1ca-758a-4dff-9d26-2b617689d804 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:00.375165 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ec1ca-758a-4dff-9d26-2b617689d804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:00.378728 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1fdf3-2e5c-4491-802c-e5573ea33faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:00.379554 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1fdf3-2e5c-4491-802c-e5573ea33faa admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:00.379911 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1fdf3-2e5c-4491-802c-e5573ea33faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:00.380259 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1fdf3-2e5c-4491-802c-e5573ea33faa admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:00.380983 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1fdf3-2e5c-4491-802c-e5573ea33faa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:00.382993 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1fdf3-2e5c-4491-802c-e5573ea33faa admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:00.395846 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-d81ec1ca-758a-4dff-9d26-2b617689d804 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:00.397115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-d81ec1ca-758a-4dff-9d26-2b617689d804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:00.405122 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 788/1565] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:00.408887 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79795737-2084-469a-b0d6-891d94435aaa None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:00.408887 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79795737-2084-469a-b0d6-891d94435aaa None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:00.408887 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79795737-2084-469a-b0d6-891d94435aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:00.427729 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-79795737-2084-469a-b0d6-891d94435aaa None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:00.434448 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-79795737-2084-469a-b0d6-891d94435aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:00.437132 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 789/1566] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:00.438353 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d35c9-5940-49c9-98f6-aa28ae2c2381 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:00.438640 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d35c9-5940-49c9-98f6-aa28ae2c2381 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:00.438918 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d35c9-5940-49c9-98f6-aa28ae2c2381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:00.467304 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-8e6d35c9-5940-49c9-98f6-aa28ae2c2381 None None] MFA Rules not processed for user `74e3f462380c432287adf0e30372c697`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:00.468587 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-8e6d35c9-5940-49c9-98f6-aa28ae2c2381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:00.487259 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 778/1567] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:03:00 2022] POST /identity/v3/users => generated 294 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:00.488293 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1fdf3-2e5c-4491-802c-e5573ea33faa admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:00.507224 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1fdf3-2e5c-4491-802c-e5573ea33faa admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:00.512212 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca53ff-420b-4580-b911-26bb3b784e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:00.512854 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca53ff-420b-4580-b911-26bb3b784e97 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:00.513136 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca53ff-420b-4580-b911-26bb3b784e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:00.513408 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca53ff-420b-4580-b911-26bb3b784e97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:00.514120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca53ff-420b-4580-b911-26bb3b784e97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:00.515747 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca53ff-420b-4580-b911-26bb3b784e97 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:00.527544 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 779/1568] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:00.528832 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15ee1c-4733-493a-ab54-2821cc585d76 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:00.529116 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15ee1c-4733-493a-ab54-2821cc585d76 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:00.529386 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15ee1c-4733-493a-ab54-2821cc585d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:00.544138 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 790/1569] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:00 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:00.545008 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d35c9-5940-49c9-98f6-aa28ae2c2381 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:00.556387 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-4c15ee1c-4733-493a-ab54-2821cc585d76 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:00.557948 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-4c15ee1c-4733-493a-ab54-2821cc585d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:00.563047 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d35c9-5940-49c9-98f6-aa28ae2c2381 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:00.568004 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 780/1570] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:00.569039 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15ee1c-4733-493a-ab54-2821cc585d76 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:00.572680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827e4ba-b564-4d5c-8265-68c4df3d5b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:00.573323 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827e4ba-b564-4d5c-8265-68c4df3d5b7d admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:00.573604 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827e4ba-b564-4d5c-8265-68c4df3d5b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:00.573874 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827e4ba-b564-4d5c-8265-68c4df3d5b7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:00.574565 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827e4ba-b564-4d5c-8265-68c4df3d5b7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:00.576691 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827e4ba-b564-4d5c-8265-68c4df3d5b7d admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:00.579190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15ee1c-4733-493a-ab54-2821cc585d76 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:00.584019 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2f7a9-215f-4ffe-b5b6-51791b3ea62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:00.584651 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2f7a9-215f-4ffe-b5b6-51791b3ea62c admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:00.584923 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2f7a9-215f-4ffe-b5b6-51791b3ea62c admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:00.585192 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2f7a9-215f-4ffe-b5b6-51791b3ea62c admin admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:00.585840 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2f7a9-215f-4ffe-b5b6-51791b3ea62c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:03:00.586138 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2f7a9-215f-4ffe-b5b6-51791b3ea62c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:00.587728 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2f7a9-215f-4ffe-b5b6-51791b3ea62c admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:00.600303 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 781/1571] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:03:00.606379 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2f7a9-215f-4ffe-b5b6-51791b3ea62c admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:00.613144 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2f7a9-215f-4ffe-b5b6-51791b3ea62c admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:00.618608 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efead574-f66c-4c10-a571-d404889ede28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:00.619230 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efead574-f66c-4c10-a571-d404889ede28 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:00.619512 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efead574-f66c-4c10-a571-d404889ede28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:00.619841 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efead574-f66c-4c10-a571-d404889ede28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:00.620491 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efead574-f66c-4c10-a571-d404889ede28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:03:00.620830 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efead574-f66c-4c10-a571-d404889ede28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:00.622435 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efead574-f66c-4c10-a571-d404889ede28 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:00.635638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 782/1572] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:03:00.636476 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efead574-f66c-4c10-a571-d404889ede28 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:00.646465 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efead574-f66c-4c10-a571-d404889ede28 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:00.651157 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990260e-29c0-410a-9dce-9a7d6bc113de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:00.651750 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990260e-29c0-410a-9dce-9a7d6bc113de admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:00.652026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990260e-29c0-410a-9dce-9a7d6bc113de admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:00.652294 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990260e-29c0-410a-9dce-9a7d6bc113de admin admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:00.653000 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d990260e-29c0-410a-9dce-9a7d6bc113de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:03:00.653302 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d990260e-29c0-410a-9dce-9a7d6bc113de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:00.654892 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d990260e-29c0-410a-9dce-9a7d6bc113de admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:00.668223 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 783/1573] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:03:00.669096 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990260e-29c0-410a-9dce-9a7d6bc113de admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:00.680088 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990260e-29c0-410a-9dce-9a7d6bc113de admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:00.685010 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525dbc0-f28f-4818-9844-33a761190570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:00.685622 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525dbc0-f28f-4818-9844-33a761190570 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:00.685899 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525dbc0-f28f-4818-9844-33a761190570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:00.686167 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525dbc0-f28f-4818-9844-33a761190570 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:00.686811 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525dbc0-f28f-4818-9844-33a761190570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:00.688445 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525dbc0-f28f-4818-9844-33a761190570 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:00.700183 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 784/1574] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:00.701053 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525dbc0-f28f-4818-9844-33a761190570 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:00.710662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525dbc0-f28f-4818-9844-33a761190570 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:00.711360 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 791/1575] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:03:00 2022] POST /identity/v3/projects => generated 365 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:00.712188 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827e4ba-b564-4d5c-8265-68c4df3d5b7d admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:00.741317 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:00.765636 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:00.772909 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292db0e2-7bb9-40fd-8aff-b102645df6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:00.773531 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292db0e2-7bb9-40fd-8aff-b102645df6cb admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:00.778418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292db0e2-7bb9-40fd-8aff-b102645df6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:00.778418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292db0e2-7bb9-40fd-8aff-b102645df6cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:00.778418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292db0e2-7bb9-40fd-8aff-b102645df6cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:00.778418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292db0e2-7bb9-40fd-8aff-b102645df6cb admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:00.780956 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827e4ba-b564-4d5c-8265-68c4df3d5b7d admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:00.786841 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6f914-cb20-4f81-9f36-e0ff1893cb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:00.791528 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 785/1576] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:00.791708 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6f914-cb20-4f81-9f36-e0ff1893cb25 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:00.791708 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6f914-cb20-4f81-9f36-e0ff1893cb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:00.791708 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6f914-cb20-4f81-9f36-e0ff1893cb25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:00.791992 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292db0e2-7bb9-40fd-8aff-b102645df6cb admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:00.792090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6f914-cb20-4f81-9f36-e0ff1893cb25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:00.792090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6f914-cb20-4f81-9f36-e0ff1893cb25 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:00.801327 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292db0e2-7bb9-40fd-8aff-b102645df6cb admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:00.807191 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393efcdc-e689-4b65-98bc-7badd39077ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:00.809641 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393efcdc-e689-4b65-98bc-7badd39077ba admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:00.809641 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393efcdc-e689-4b65-98bc-7badd39077ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:00.809641 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393efcdc-e689-4b65-98bc-7badd39077ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:00.809641 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393efcdc-e689-4b65-98bc-7badd39077ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:03:00.810075 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393efcdc-e689-4b65-98bc-7badd39077ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:00.811526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393efcdc-e689-4b65-98bc-7badd39077ba admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:00.824330 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 786/1577] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:03:00.825019 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393efcdc-e689-4b65-98bc-7badd39077ba admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:00.835277 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393efcdc-e689-4b65-98bc-7badd39077ba admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:00.840238 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cbd9b-4fd7-4f76-8a83-1112b2448e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:00.840871 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cbd9b-4fd7-4f76-8a83-1112b2448e5a admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:00.841151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cbd9b-4fd7-4f76-8a83-1112b2448e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:00.841423 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cbd9b-4fd7-4f76-8a83-1112b2448e5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:00.842055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606cbd9b-4fd7-4f76-8a83-1112b2448e5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:00.844055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606cbd9b-4fd7-4f76-8a83-1112b2448e5a admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:00.909920 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 792/1578] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:03:00 2022] POST /identity/v3/projects => generated 405 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:00.911108 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6f914-cb20-4f81-9f36-e0ff1893cb25 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:00.971831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 787/1579] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:03:00 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:00.971831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cbd9b-4fd7-4f76-8a83-1112b2448e5a admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:00.976303 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6f914-cb20-4f81-9f36-e0ff1893cb25 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:01.033497 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d10c8-16f5-424a-9320-7473ad5eaeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:01.034736 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d10c8-16f5-424a-9320-7473ad5eaeca admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:01.034928 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d10c8-16f5-424a-9320-7473ad5eaeca admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:01.035263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d10c8-16f5-424a-9320-7473ad5eaeca admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:01.035892 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d10c8-16f5-424a-9320-7473ad5eaeca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:01.036298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cbd9b-4fd7-4f76-8a83-1112b2448e5a admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:01.037895 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d10c8-16f5-424a-9320-7473ad5eaeca admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:01.041138 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2663f9-9b1a-4bf0-bc3c-8967250ac520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:01.041748 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2663f9-9b1a-4bf0-bc3c-8967250ac520 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:01.042029 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2663f9-9b1a-4bf0-bc3c-8967250ac520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:01.042316 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2663f9-9b1a-4bf0-bc3c-8967250ac520 admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:01.042934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2663f9-9b1a-4bf0-bc3c-8967250ac520 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:01.044857 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2663f9-9b1a-4bf0-bc3c-8967250ac520 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:01.110687 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 793/1580] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:03:00 2022] POST /identity/v3/projects => generated 383 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:01.111486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d10c8-16f5-424a-9320-7473ad5eaeca admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:01.139589 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 788/1581] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:03:00 2022] POST /identity/v3/projects => generated 387 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:01.140907 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2663f9-9b1a-4bf0-bc3c-8967250ac520 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:01.156777 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:01.176523 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d10c8-16f5-424a-9320-7473ad5eaeca admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:01.204153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2663f9-9b1a-4bf0-bc3c-8967250ac520 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:01.209666 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c18be3-0744-4e62-b67d-41eb30ffda33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:01.210276 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c18be3-0744-4e62-b67d-41eb30ffda33 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:01.210558 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c18be3-0744-4e62-b67d-41eb30ffda33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:01.210906 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c18be3-0744-4e62-b67d-41eb30ffda33 admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:01.211535 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c18be3-0744-4e62-b67d-41eb30ffda33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:01.213501 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c18be3-0744-4e62-b67d-41eb30ffda33 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:01.235083 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7963b9-5acf-4c31-a845-b1a8effbf30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:01.237543 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7963b9-5acf-4c31-a845-b1a8effbf30e admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:01.237543 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7963b9-5acf-4c31-a845-b1a8effbf30e admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:01.237543 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7963b9-5acf-4c31-a845-b1a8effbf30e admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:01.237543 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7963b9-5acf-4c31-a845-b1a8effbf30e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:01.238923 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7963b9-5acf-4c31-a845-b1a8effbf30e admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:01.248547 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 794/1582] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:01.249333 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7963b9-5acf-4c31-a845-b1a8effbf30e admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:01.258670 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7963b9-5acf-4c31-a845-b1a8effbf30e admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:01.263348 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e6998-5373-495d-8b6a-576f867a12e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:01.263978 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e6998-5373-495d-8b6a-576f867a12e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:01.264257 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e6998-5373-495d-8b6a-576f867a12e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:01.264527 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e6998-5373-495d-8b6a-576f867a12e9 admin admin] PATH_INFO: `/v3/projects/ccb0872e78994c10b8fa4fdf1a04490c/users/c640f4b512f748669f75f297f5bf8df9/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:01.280255 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e6998-5373-495d-8b6a-576f867a12e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccb0872e78994c10b8fa4fdf1a04490c, user_id=c640f4b512f748669f75f297f5bf8df9, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:01.283147 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e6998-5373-495d-8b6a-576f867a12e9 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:01.290458 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 789/1583] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:03:01 2022] POST /identity/v3/users => generated 283 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:01.290835 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c18be3-0744-4e62-b67d-41eb30ffda33 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:01.300368 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c18be3-0744-4e62-b67d-41eb30ffda33 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:01.305023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04533cdc-9a11-4269-bd69-3c2bc0ab39d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:01.305666 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04533cdc-9a11-4269-bd69-3c2bc0ab39d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:01.306027 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04533cdc-9a11-4269-bd69-3c2bc0ab39d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:01.306209 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04533cdc-9a11-4269-bd69-3c2bc0ab39d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:01.306824 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04533cdc-9a11-4269-bd69-3c2bc0ab39d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:01.308774 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04533cdc-9a11-4269-bd69-3c2bc0ab39d5 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:01.381979 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 795/1584] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:01 2022] PUT /identity/v3/projects/ccb0872e78994c10b8fa4fdf1a04490c/users/c640f4b512f748669f75f297f5bf8df9/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:01.382818 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e6998-5373-495d-8b6a-576f867a12e9 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:01.417594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 790/1585] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:03:01 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:01.418274 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04533cdc-9a11-4269-bd69-3c2bc0ab39d5 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:01.429600 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:01.448282 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e6998-5373-495d-8b6a-576f867a12e9 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:01.494390 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04533cdc-9a11-4269-bd69-3c2bc0ab39d5 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:01.499481 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981c495-a17c-41b1-9bff-39fef6afd356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:01.500122 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981c495-a17c-41b1-9bff-39fef6afd356 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:01.501963 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981c495-a17c-41b1-9bff-39fef6afd356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:01.501963 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981c495-a17c-41b1-9bff-39fef6afd356 admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:01.501963 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0981c495-a17c-41b1-9bff-39fef6afd356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:01.503978 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0981c495-a17c-41b1-9bff-39fef6afd356 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:01.511514 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae94b7e-ce6e-4271-a7ff-89e3da691dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:01.512122 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae94b7e-ce6e-4271-a7ff-89e3da691dcc admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:01.512406 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae94b7e-ce6e-4271-a7ff-89e3da691dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:01.512716 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae94b7e-ce6e-4271-a7ff-89e3da691dcc admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:01.513380 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae94b7e-ce6e-4271-a7ff-89e3da691dcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:01.515356 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae94b7e-ce6e-4271-a7ff-89e3da691dcc admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:01.527261 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:01.597132 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 791/1586] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:03:01 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:01.597849 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981c495-a17c-41b1-9bff-39fef6afd356 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:01.608429 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981c495-a17c-41b1-9bff-39fef6afd356 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:01.610102 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 796/1587] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:03:01 2022] POST /identity/v3/users => generated 309 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:01.611284 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae94b7e-ce6e-4271-a7ff-89e3da691dcc admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:01.616159 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f9c53-e188-4a27-9692-49feac8bbd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:01.616814 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f9c53-e188-4a27-9692-49feac8bbd36 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:01.617094 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f9c53-e188-4a27-9692-49feac8bbd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:01.617364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f9c53-e188-4a27-9692-49feac8bbd36 admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:01.617985 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f9c53-e188-4a27-9692-49feac8bbd36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:01.619920 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f9c53-e188-4a27-9692-49feac8bbd36 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:01.622851 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae94b7e-ce6e-4271-a7ff-89e3da691dcc admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:01.627514 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2db645-4cf5-4aea-b553-af5808e4506d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:01.629597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2db645-4cf5-4aea-b553-af5808e4506d admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:01.629597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2db645-4cf5-4aea-b553-af5808e4506d admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:01.629597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2db645-4cf5-4aea-b553-af5808e4506d admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:01.629884 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2db645-4cf5-4aea-b553-af5808e4506d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:01.631799 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2db645-4cf5-4aea-b553-af5808e4506d admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:01.693881 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 792/1588] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:03:01 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:01.694510 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f9c53-e188-4a27-9692-49feac8bbd36 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:01.704287 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f9c53-e188-4a27-9692-49feac8bbd36 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:01.709276 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d39cdf-54fb-4561-93ee-05558f2e3b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:01.709949 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d39cdf-54fb-4561-93ee-05558f2e3b6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:01.710232 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d39cdf-54fb-4561-93ee-05558f2e3b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:01.710508 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d39cdf-54fb-4561-93ee-05558f2e3b6f admin admin] PATH_INFO: `/v3/projects/26f380b32d4640aabf2f43df27ec4f95/users/3f9710b10a9a4746a57a29dfedf88866/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:01.719596 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 797/1589] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:03:01 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:01.719596 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2db645-4cf5-4aea-b553-af5808e4506d admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:01.727452 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d39cdf-54fb-4561-93ee-05558f2e3b6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=26f380b32d4640aabf2f43df27ec4f95, user_id=3f9710b10a9a4746a57a29dfedf88866, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:01.728550 dv-cinder-849325-3-smb devstack@keystone.service[81717]: WARNING py.warnings [None req-29d39cdf-54fb-4561-93ee-05558f2e3b6f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:03:01.728550 dv-cinder-849325-3-smb devstack@keystone.service[81717]: warnings.warn(msg) Aug 24 16:03:01.728550 dv-cinder-849325-3-smb devstack@keystone.service[81717]: Aug 24 16:03:01.729129 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2db645-4cf5-4aea-b553-af5808e4506d admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:01.730527 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d39cdf-54fb-4561-93ee-05558f2e3b6f admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:01.734151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c12eb3-2205-4aa0-82f0-1a96aa25b98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:01.734850 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c12eb3-2205-4aa0-82f0-1a96aa25b98e admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:01.735133 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c12eb3-2205-4aa0-82f0-1a96aa25b98e admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:01.735408 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c12eb3-2205-4aa0-82f0-1a96aa25b98e admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:01.736089 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c12eb3-2205-4aa0-82f0-1a96aa25b98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:01.738697 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c12eb3-2205-4aa0-82f0-1a96aa25b98e admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:01.749754 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 798/1590] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:01.751832 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea0504-e952-4d24-9c79-07fb814ab694 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:01.752118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea0504-e952-4d24-9c79-07fb814ab694 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:01.752395 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea0504-e952-4d24-9c79-07fb814ab694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:01.771807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-7aea0504-e952-4d24-9c79-07fb814ab694 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:01.773079 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-7aea0504-e952-4d24-9c79-07fb814ab694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:01.780719 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 799/1591] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:01.781621 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea0504-e952-4d24-9c79-07fb814ab694 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:01.792385 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea0504-e952-4d24-9c79-07fb814ab694 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:01.793559 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 793/1592] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:01 2022] PUT /identity/v3/projects/26f380b32d4640aabf2f43df27ec4f95/users/3f9710b10a9a4746a57a29dfedf88866/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:01.796093 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d39cdf-54fb-4561-93ee-05558f2e3b6f admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:01.855694 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e357915-f7be-43c4-aa3d-13ff4d42b485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:01.856231 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e357915-f7be-43c4-aa3d-13ff4d42b485 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:01.856512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e357915-f7be-43c4-aa3d-13ff4d42b485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:01.856837 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e357915-f7be-43c4-aa3d-13ff4d42b485 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:01.857506 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e357915-f7be-43c4-aa3d-13ff4d42b485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:01.859445 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e357915-f7be-43c4-aa3d-13ff4d42b485 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:01.859879 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d39cdf-54fb-4561-93ee-05558f2e3b6f admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:01.865399 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8d6ff-f538-4479-af50-017db099eb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:01.866015 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8d6ff-f538-4479-af50-017db099eb8e admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:01.866296 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8d6ff-f538-4479-af50-017db099eb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:01.866591 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8d6ff-f538-4479-af50-017db099eb8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:01.867225 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a8d6ff-f538-4479-af50-017db099eb8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:01.868842 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a8d6ff-f538-4479-af50-017db099eb8e admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:01.880663 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 794/1593] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:01.884482 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8d6ff-f538-4479-af50-017db099eb8e admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:01.894505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8d6ff-f538-4479-af50-017db099eb8e admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:01.899338 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6cf180-5bfa-4fb4-b593-101557ed9ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:01.899932 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6cf180-5bfa-4fb4-b593-101557ed9ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:01.900210 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6cf180-5bfa-4fb4-b593-101557ed9ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:01.900478 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6cf180-5bfa-4fb4-b593-101557ed9ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:01.901155 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6cf180-5bfa-4fb4-b593-101557ed9ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:01.902744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6cf180-5bfa-4fb4-b593-101557ed9ff8 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:01.913626 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 795/1594] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:01.914615 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6cf180-5bfa-4fb4-b593-101557ed9ff8 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:01.924378 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6cf180-5bfa-4fb4-b593-101557ed9ff8 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:01.929764 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ae780-9d62-4977-8320-1c3069b470d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:01.930373 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ae780-9d62-4977-8320-1c3069b470d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:01.935476 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ae780-9d62-4977-8320-1c3069b470d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:01.935476 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ae780-9d62-4977-8320-1c3069b470d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:01.935476 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ae780-9d62-4977-8320-1c3069b470d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:01.935476 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ae780-9d62-4977-8320-1c3069b470d8 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:01.936565 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 800/1595] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:03:01 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:01.937493 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e357915-f7be-43c4-aa3d-13ff4d42b485 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:01.947188 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 796/1596] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:01.948128 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ae780-9d62-4977-8320-1c3069b470d8 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:01.949076 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e357915-f7be-43c4-aa3d-13ff4d42b485 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:01.954007 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18407287-837f-48c9-849b-82c8440b55c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:01.954998 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18407287-837f-48c9-849b-82c8440b55c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:01.954998 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18407287-837f-48c9-849b-82c8440b55c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:01.955225 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18407287-837f-48c9-849b-82c8440b55c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:01.955860 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18407287-837f-48c9-849b-82c8440b55c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:01.957680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18407287-837f-48c9-849b-82c8440b55c0 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:01.958628 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ae780-9d62-4977-8320-1c3069b470d8 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:01.964452 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4122a-80bb-4df4-8e7b-f55f7e05d9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:01.972262 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4122a-80bb-4df4-8e7b-f55f7e05d9db admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:01.972262 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4122a-80bb-4df4-8e7b-f55f7e05d9db admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:01.972262 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4122a-80bb-4df4-8e7b-f55f7e05d9db admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:01.972262 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4122a-80bb-4df4-8e7b-f55f7e05d9db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:01.972262 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4122a-80bb-4df4-8e7b-f55f7e05d9db admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:01.972820 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 801/1597] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:01.972820 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18407287-837f-48c9-849b-82c8440b55c0 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:01.981819 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 797/1598] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:01.983380 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92609b38-f83f-4b4a-a081-3b581102e355 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:01.983735 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92609b38-f83f-4b4a-a081-3b581102e355 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:01.984250 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92609b38-f83f-4b4a-a081-3b581102e355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:02.004571 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-92609b38-f83f-4b4a-a081-3b581102e355 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:02.005856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-92609b38-f83f-4b4a-a081-3b581102e355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:02.013898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 798/1599] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:02.014521 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92609b38-f83f-4b4a-a081-3b581102e355 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:02.024725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92609b38-f83f-4b4a-a081-3b581102e355 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:02.029365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146dfb3e-e3f3-45d8-8e71-398a22873014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:02.030002 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146dfb3e-e3f3-45d8-8e71-398a22873014 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:02.032029 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146dfb3e-e3f3-45d8-8e71-398a22873014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:02.032029 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146dfb3e-e3f3-45d8-8e71-398a22873014 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:02.032029 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146dfb3e-e3f3-45d8-8e71-398a22873014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:02.032309 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18407287-837f-48c9-849b-82c8440b55c0 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:02.032833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146dfb3e-e3f3-45d8-8e71-398a22873014 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:02.036290 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f65f7-b1df-4146-8145-bd97586b0342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:02.036945 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f65f7-b1df-4146-8145-bd97586b0342 service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:02.037225 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f65f7-b1df-4146-8145-bd97586b0342 service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:02.037522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f65f7-b1df-4146-8145-bd97586b0342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:02.045571 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 799/1600] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:02.046206 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146dfb3e-e3f3-45d8-8e71-398a22873014 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:02.047267 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f65f7-b1df-4146-8145-bd97586b0342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:02.048983 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f65f7-b1df-4146-8145-bd97586b0342 service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:02.052251 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:02.057538 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146dfb3e-e3f3-45d8-8e71-398a22873014 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:02.060308 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 802/1601] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:02.061163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f65f7-b1df-4146-8145-bd97586b0342 service neutron] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:02.062168 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856cd75e-c690-4171-811f-763636f97ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:02.064151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856cd75e-c690-4171-811f-763636f97ea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:02.064151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856cd75e-c690-4171-811f-763636f97ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:02.064151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856cd75e-c690-4171-811f-763636f97ea8 admin admin] PATH_INFO: `/v3/projects/9e006738c6f6487bb4b8869b85d2e4c6/users/dc8da54b4bdc44499fa971a8fa611887/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:02.071067 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f65f7-b1df-4146-8145-bd97586b0342 service neutron] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:02.075855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33108a-c0eb-432a-9af9-891b23456420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:02.076455 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33108a-c0eb-432a-9af9-891b23456420 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:02.076767 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33108a-c0eb-432a-9af9-891b23456420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:02.077044 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33108a-c0eb-432a-9af9-891b23456420 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:02.077691 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33108a-c0eb-432a-9af9-891b23456420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:02.079346 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33108a-c0eb-432a-9af9-891b23456420 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:02.079970 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856cd75e-c690-4171-811f-763636f97ea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e006738c6f6487bb4b8869b85d2e4c6, user_id=dc8da54b4bdc44499fa971a8fa611887, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:02.083246 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856cd75e-c690-4171-811f-763636f97ea8 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:02.091802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 803/1602] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:02.092676 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33108a-c0eb-432a-9af9-891b23456420 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:02.103465 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33108a-c0eb-432a-9af9-891b23456420 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:02.108179 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cfae4-5bbb-42a8-8c33-d92e50f7db75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:02.108742 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cfae4-5bbb-42a8-8c33-d92e50f7db75 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:02.109023 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cfae4-5bbb-42a8-8c33-d92e50f7db75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:02.109293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cfae4-5bbb-42a8-8c33-d92e50f7db75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:02.109930 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982cfae4-5bbb-42a8-8c33-d92e50f7db75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:02.111507 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982cfae4-5bbb-42a8-8c33-d92e50f7db75 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:02.124099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 804/1603] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:02.124942 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cfae4-5bbb-42a8-8c33-d92e50f7db75 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:02.134469 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cfae4-5bbb-42a8-8c33-d92e50f7db75 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:02.139044 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2d00c-e641-401f-9ce3-c68bdc52b08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:02.139625 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2d00c-e641-401f-9ce3-c68bdc52b08f admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:02.139902 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2d00c-e641-401f-9ce3-c68bdc52b08f admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:02.140170 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2d00c-e641-401f-9ce3-c68bdc52b08f admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:02.140830 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af2d00c-e641-401f-9ce3-c68bdc52b08f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:02.142440 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af2d00c-e641-401f-9ce3-c68bdc52b08f admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:02.153164 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 805/1604] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:02.154091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2d00c-e641-401f-9ce3-c68bdc52b08f admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:02.164780 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2d00c-e641-401f-9ce3-c68bdc52b08f admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:02.169471 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea9082-9872-483d-8a3c-3eed32444ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:02.170120 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea9082-9872-483d-8a3c-3eed32444ce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:02.170403 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea9082-9872-483d-8a3c-3eed32444ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:02.170679 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea9082-9872-483d-8a3c-3eed32444ce6 admin admin] PATH_INFO: `/v3/projects/fa4108a2d93f41a499fdb418a401fcc6/users/ff1d6c119e8442209714f0a046aab35c/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:02.173978 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:02.186162 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea9082-9872-483d-8a3c-3eed32444ce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa4108a2d93f41a499fdb418a401fcc6, user_id=ff1d6c119e8442209714f0a046aab35c, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:02.188925 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea9082-9872-483d-8a3c-3eed32444ce6 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:02.223146 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 800/1605] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:02 2022] PUT /identity/v3/projects/9e006738c6f6487bb4b8869b85d2e4c6/users/dc8da54b4bdc44499fa971a8fa611887/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:02.224064 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856cd75e-c690-4171-811f-763636f97ea8 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:02.282683 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856cd75e-c690-4171-811f-763636f97ea8 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:02.287572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 806/1606] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:02 2022] PUT /identity/v3/projects/fa4108a2d93f41a499fdb418a401fcc6/users/ff1d6c119e8442209714f0a046aab35c/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:02.288693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea9082-9872-483d-8a3c-3eed32444ce6 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:02.342501 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a3d8f-ce30-4118-a58a-d789539e28e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:02.343119 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a3d8f-ce30-4118-a58a-d789539e28e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:02.343404 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a3d8f-ce30-4118-a58a-d789539e28e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:02.343678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a3d8f-ce30-4118-a58a-d789539e28e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:02.369561 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea9082-9872-483d-8a3c-3eed32444ce6 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:02.374974 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2ee90-e4df-44d1-9d96-af81873bd67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:02.375655 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2ee90-e4df-44d1-9d96-af81873bd67f admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:02.375948 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2ee90-e4df-44d1-9d96-af81873bd67f admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:02.376220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2ee90-e4df-44d1-9d96-af81873bd67f admin admin] PATH_INFO: `/v3/projects/9619d886d5f543f6b2b673f91256da8c/users/d7e96891e45f427db01549f082d3f808/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:02.391763 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2ee90-e4df-44d1-9d96-af81873bd67f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9619d886d5f543f6b2b673f91256da8c, user_id=d7e96891e45f427db01549f082d3f808, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:02.394686 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2ee90-e4df-44d1-9d96-af81873bd67f admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:02.410538 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a3d8f-ce30-4118-a58a-d789539e28e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:02.412177 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a3d8f-ce30-4118-a58a-d789539e28e6 service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:02.422822 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 801/1607] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:02.423681 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a3d8f-ce30-4118-a58a-d789539e28e6 service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:02.434418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a3d8f-ce30-4118-a58a-d789539e28e6 service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:02.439340 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67d97d-bee0-429f-b31e-fdde8f2a4e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:02.439983 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67d97d-bee0-429f-b31e-fdde8f2a4e70 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:02.440442 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67d97d-bee0-429f-b31e-fdde8f2a4e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:02.440863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67d97d-bee0-429f-b31e-fdde8f2a4e70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:02.441536 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d67d97d-bee0-429f-b31e-fdde8f2a4e70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:02.443138 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d67d97d-bee0-429f-b31e-fdde8f2a4e70 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:02.455117 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 802/1608] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:02.457876 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67d97d-bee0-429f-b31e-fdde8f2a4e70 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:02.463250 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 807/1609] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:02 2022] PUT /identity/v3/projects/9619d886d5f543f6b2b673f91256da8c/users/d7e96891e45f427db01549f082d3f808/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:02.464507 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2ee90-e4df-44d1-9d96-af81873bd67f admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:02.485979 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67d97d-bee0-429f-b31e-fdde8f2a4e70 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:02.525571 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:02.547888 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2ee90-e4df-44d1-9d96-af81873bd67f admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:02.553187 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187215f8-c57f-4644-9391-635be1791ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:02.553793 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187215f8-c57f-4644-9391-635be1791ca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:02.554077 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187215f8-c57f-4644-9391-635be1791ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:02.554351 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187215f8-c57f-4644-9391-635be1791ca9 admin admin] PATH_INFO: `/v3/projects/260e4be642db451a95c1549c9860af67/users/eab3f668423e48df94a30cedc247f2dd/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:02.558555 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11215e2d-4ec3-4e08-8748-27ae7996064c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:02.559763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11215e2d-4ec3-4e08-8748-27ae7996064c admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:02.559763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11215e2d-4ec3-4e08-8748-27ae7996064c admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:02.559962 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11215e2d-4ec3-4e08-8748-27ae7996064c admin admin] PATH_INFO: `/v3/projects/67f683e38d604d4f844b7d8448a5f30b/users/f592a217d12141278b52707518ad4d47/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:02.571157 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187215f8-c57f-4644-9391-635be1791ca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=260e4be642db451a95c1549c9860af67, user_id=eab3f668423e48df94a30cedc247f2dd, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:02.573877 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187215f8-c57f-4644-9391-635be1791ca9 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:02.574622 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11215e2d-4ec3-4e08-8748-27ae7996064c admin admin] RBAC: Authorizing `identity:create_grant(project_id=67f683e38d604d4f844b7d8448a5f30b, user_id=f592a217d12141278b52707518ad4d47, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:02.577440 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11215e2d-4ec3-4e08-8748-27ae7996064c admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:02.668249 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 808/1610] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:02 2022] PUT /identity/v3/projects/260e4be642db451a95c1549c9860af67/users/eab3f668423e48df94a30cedc247f2dd/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:02.669133 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187215f8-c57f-4644-9391-635be1791ca9 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:02.683534 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 803/1611] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:02 2022] PUT /identity/v3/projects/67f683e38d604d4f844b7d8448a5f30b/users/f592a217d12141278b52707518ad4d47/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:02.683534 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fa1c7-28dd-44ce-8a3e-1e6cf0eb0396 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:02.683534 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fa1c7-28dd-44ce-8a3e-1e6cf0eb0396 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:02.683534 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fa1c7-28dd-44ce-8a3e-1e6cf0eb0396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:02.718170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-916fa1c7-28dd-44ce-8a3e-1e6cf0eb0396 None None] MFA Rules not processed for user `ff1d6c119e8442209714f0a046aab35c`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:02.719674 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-916fa1c7-28dd-44ce-8a3e-1e6cf0eb0396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:02.745166 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:02.759154 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187215f8-c57f-4644-9391-635be1791ca9 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:02.819590 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 804/1612] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:02.821463 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21601946-6544-4963-9e9a-5d8e1e69bf34 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:02.821879 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21601946-6544-4963-9e9a-5d8e1e69bf34 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:02.822208 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21601946-6544-4963-9e9a-5d8e1e69bf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:02.851926 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-21601946-6544-4963-9e9a-5d8e1e69bf34 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:02.853193 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-21601946-6544-4963-9e9a-5d8e1e69bf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:02.865917 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263910d7-cb2c-4d25-868e-c7736615db5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:02.866652 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263910d7-cb2c-4d25-868e-c7736615db5c admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:02.868134 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263910d7-cb2c-4d25-868e-c7736615db5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:02.868134 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263910d7-cb2c-4d25-868e-c7736615db5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:02.869773 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263910d7-cb2c-4d25-868e-c7736615db5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:02.873815 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263910d7-cb2c-4d25-868e-c7736615db5c admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:02.898831 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 809/1613] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:02.898831 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263910d7-cb2c-4d25-868e-c7736615db5c admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:02.911516 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263910d7-cb2c-4d25-868e-c7736615db5c admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:02.929983 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e51ee-d89b-4f06-ac14-7095e3bba835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:02.929983 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e51ee-d89b-4f06-ac14-7095e3bba835 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:02.929983 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e51ee-d89b-4f06-ac14-7095e3bba835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:02.929983 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e51ee-d89b-4f06-ac14-7095e3bba835 admin admin] PATH_INFO: `/v3/projects/e3beafcd2bb147ba95f3ca3f158d155c/users/85a094c88a2144e9a73b320f45987b70/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:02.941713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e51ee-d89b-4f06-ac14-7095e3bba835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3beafcd2bb147ba95f3ca3f158d155c, user_id=85a094c88a2144e9a73b320f45987b70, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:02.946282 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e51ee-d89b-4f06-ac14-7095e3bba835 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:02.962128 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 805/1614] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:02.966915 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b239e-7721-41f0-92df-ebd6f5020e12 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:02.966915 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b239e-7721-41f0-92df-ebd6f5020e12 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:02.966915 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b239e-7721-41f0-92df-ebd6f5020e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:03.002575 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-971b239e-7721-41f0-92df-ebd6f5020e12 None None] MFA Rules not processed for user `eab3f668423e48df94a30cedc247f2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:03.004398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-971b239e-7721-41f0-92df-ebd6f5020e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:03.044857 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:03.076857 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 810/1615] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:02 2022] PUT /identity/v3/projects/e3beafcd2bb147ba95f3ca3f158d155c/users/85a094c88a2144e9a73b320f45987b70/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:03.078317 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b53726-dab9-4e35-9611-695fa9792d9e None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:03.078608 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b53726-dab9-4e35-9611-695fa9792d9e None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:03.078875 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b53726-dab9-4e35-9611-695fa9792d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:03.085528 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 806/1616] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:03.085528 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b239e-7721-41f0-92df-ebd6f5020e12 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:03.117877 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-90b53726-dab9-4e35-9611-695fa9792d9e None None] MFA Rules not processed for user `f592a217d12141278b52707518ad4d47`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:03.119230 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-90b53726-dab9-4e35-9611-695fa9792d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:03.165245 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b239e-7721-41f0-92df-ebd6f5020e12 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:03.236494 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b962e0b-2a55-4569-b7a1-eb4e9dea2165 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:03.236494 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b962e0b-2a55-4569-b7a1-eb4e9dea2165 service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:03.236494 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b962e0b-2a55-4569-b7a1-eb4e9dea2165 service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:03.236494 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b962e0b-2a55-4569-b7a1-eb4e9dea2165 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:03.258834 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 811/1617] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:03.262019 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b53726-dab9-4e35-9611-695fa9792d9e None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:03.310854 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b962e0b-2a55-4569-b7a1-eb4e9dea2165 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:03.313790 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b962e0b-2a55-4569-b7a1-eb4e9dea2165 service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:03.328830 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 807/1618] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:03.329829 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b962e0b-2a55-4569-b7a1-eb4e9dea2165 service cinder] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:03.361536 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b53726-dab9-4e35-9611-695fa9792d9e None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:03.368014 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3b224-94b2-4ee6-b3e5-2079eb8518ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:03.368836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3b224-94b2-4ee6-b3e5-2079eb8518ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:03.369253 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3b224-94b2-4ee6-b3e5-2079eb8518ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:03.369539 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3b224-94b2-4ee6-b3e5-2079eb8518ed admin admin] PATH_INFO: `/v3/projects/9e006738c6f6487bb4b8869b85d2e4c6/users/dc8da54b4bdc44499fa971a8fa611887/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:03.371871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3b224-94b2-4ee6-b3e5-2079eb8518ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e006738c6f6487bb4b8869b85d2e4c6, user_id=dc8da54b4bdc44499fa971a8fa611887, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:03.374746 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3b224-94b2-4ee6-b3e5-2079eb8518ed admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:03.377607 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:03.399813 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 812/1619] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:03 2022] PUT /identity/v3/projects/9e006738c6f6487bb4b8869b85d2e4c6/users/dc8da54b4bdc44499fa971a8fa611887/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:03.399813 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac707f-d0ca-44ef-9b50-07866319ee79 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:03.402729 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac707f-d0ca-44ef-9b50-07866319ee79 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:03.403421 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac707f-d0ca-44ef-9b50-07866319ee79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:03.407520 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:03.419100 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b962e0b-2a55-4569-b7a1-eb4e9dea2165 service cinder] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:03.432838 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-96ac707f-d0ca-44ef-9b50-07866319ee79 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:03.434282 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-96ac707f-d0ca-44ef-9b50-07866319ee79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:03.493362 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36942377-44c4-4d62-8099-e4ccec8a1ad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:03.494882 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36942377-44c4-4d62-8099-e4ccec8a1ad6 service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:03.495313 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36942377-44c4-4d62-8099-e4ccec8a1ad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:03.497113 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36942377-44c4-4d62-8099-e4ccec8a1ad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:03.553649 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 813/1620] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:03.554730 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac707f-d0ca-44ef-9b50-07866319ee79 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:03.568718 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac707f-d0ca-44ef-9b50-07866319ee79 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:03.579394 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409af7b-87c3-41e9-8689-30c2a44779a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:03.580041 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409af7b-87c3-41e9-8689-30c2a44779a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:03.580455 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409af7b-87c3-41e9-8689-30c2a44779a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:03.580822 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409af7b-87c3-41e9-8689-30c2a44779a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:03.582089 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409af7b-87c3-41e9-8689-30c2a44779a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:03.584055 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409af7b-87c3-41e9-8689-30c2a44779a9 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:03.594611 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36942377-44c4-4d62-8099-e4ccec8a1ad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:03.596230 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36942377-44c4-4d62-8099-e4ccec8a1ad6 service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:03.610724 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 808/1621] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:03.613032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d14fa-1d67-4958-b9d3-fac257b07a78 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:03.613963 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d14fa-1d67-4958-b9d3-fac257b07a78 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:03.614309 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d14fa-1d67-4958-b9d3-fac257b07a78 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:03.616095 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 809/1622] 10.222.0.64 () {54 vars in 962 bytes} [Wed Aug 24 16:03:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:03:03.617407 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada7fa9-ef86-409d-9a06-7554dec313b8 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:03.617760 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada7fa9-ef86-409d-9a06-7554dec313b8 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:03.618152 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada7fa9-ef86-409d-9a06-7554dec313b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:03.658944 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-0ada7fa9-ef86-409d-9a06-7554dec313b8 None None] MFA Rules not processed for user `dc8da54b4bdc44499fa971a8fa611887`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:03.661049 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-0ada7fa9-ef86-409d-9a06-7554dec313b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:03.695700 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 814/1623] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:03:03 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:03.695700 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409af7b-87c3-41e9-8689-30c2a44779a9 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:03.795986 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409af7b-87c3-41e9-8689-30c2a44779a9 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:03.801682 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 810/1624] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:03 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:03.803692 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc56bc-2698-4c8e-8bde-dbcb142d9e80 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:03.803982 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc56bc-2698-4c8e-8bde-dbcb142d9e80 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:03.804303 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc56bc-2698-4c8e-8bde-dbcb142d9e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:03.816086 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e91c83-0e76-484a-b967-80ef3f585a54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:03.816890 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e91c83-0e76-484a-b967-80ef3f585a54 service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:03.817183 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e91c83-0e76-484a-b967-80ef3f585a54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:03.817469 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e91c83-0e76-484a-b967-80ef3f585a54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:03.868460 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-64cc56bc-2698-4c8e-8bde-dbcb142d9e80 None None] MFA Rules not processed for user `e5f0d8fe42e74d68bfa9a0e365bab4b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:03.870035 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-64cc56bc-2698-4c8e-8bde-dbcb142d9e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:03.910479 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e91c83-0e76-484a-b967-80ef3f585a54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:03.911959 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e91c83-0e76-484a-b967-80ef3f585a54 service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:03.927306 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 815/1625] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:03.928373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e91c83-0e76-484a-b967-80ef3f585a54 service neutron] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:03.941287 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e91c83-0e76-484a-b967-80ef3f585a54 service neutron] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:03.948760 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4cf1a8-f272-4826-9960-8661dac3aead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:03.949528 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4cf1a8-f272-4826-9960-8661dac3aead admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:03.949812 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4cf1a8-f272-4826-9960-8661dac3aead admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:03.950083 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4cf1a8-f272-4826-9960-8661dac3aead admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:03.951232 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4cf1a8-f272-4826-9960-8661dac3aead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:03.953970 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4cf1a8-f272-4826-9960-8661dac3aead admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:03.967639 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:04.001922 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 811/1626] 10.222.0.64 () {58 vars in 1059 bytes} [Wed Aug 24 16:03:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:04.002952 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc56bc-2698-4c8e-8bde-dbcb142d9e80 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:04.085341 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 816/1627] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:03:03 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:04.086526 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4cf1a8-f272-4826-9960-8661dac3aead admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:04.095439 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc56bc-2698-4c8e-8bde-dbcb142d9e80 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:04.104276 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc96c96-3172-44ec-a946-5197dfd17d2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:04.110489 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc96c96-3172-44ec-a946-5197dfd17d2a service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:04.110489 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc96c96-3172-44ec-a946-5197dfd17d2a service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:04.110489 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc96c96-3172-44ec-a946-5197dfd17d2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:04.116160 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4cf1a8-f272-4826-9960-8661dac3aead admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:04.132807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139db78-5917-4d13-aad2-250ff49152f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:04.134032 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139db78-5917-4d13-aad2-250ff49152f0 service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:04.135411 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139db78-5917-4d13-aad2-250ff49152f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:04.136522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139db78-5917-4d13-aad2-250ff49152f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:04.236120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc96c96-3172-44ec-a946-5197dfd17d2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:04.239668 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc96c96-3172-44ec-a946-5197dfd17d2a service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:04.241925 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139db78-5917-4d13-aad2-250ff49152f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:04.243553 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139db78-5917-4d13-aad2-250ff49152f0 service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:04.255084 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 812/1628] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:04 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:04.255807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 817/1629] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:04.258944 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc96c96-3172-44ec-a946-5197dfd17d2a service cinder] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:04.272472 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc96c96-3172-44ec-a946-5197dfd17d2a service cinder] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:04.279626 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed24b43-8bfd-411a-a350-68b2af2b9d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:04.287816 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed24b43-8bfd-411a-a350-68b2af2b9d99 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:04.287816 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed24b43-8bfd-411a-a350-68b2af2b9d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:04.287816 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed24b43-8bfd-411a-a350-68b2af2b9d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:04.287816 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed24b43-8bfd-411a-a350-68b2af2b9d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:04.287816 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed24b43-8bfd-411a-a350-68b2af2b9d99 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:04.288393 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:04.308674 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 813/1630] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:04.312681 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139db78-5917-4d13-aad2-250ff49152f0 service nova] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:04.322280 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139db78-5917-4d13-aad2-250ff49152f0 service nova] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:04.328412 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe459b3-3e41-4642-b3b3-299f5a332474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:04.329175 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe459b3-3e41-4642-b3b3-299f5a332474 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:04.329459 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe459b3-3e41-4642-b3b3-299f5a332474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:04.331726 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe459b3-3e41-4642-b3b3-299f5a332474 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:04.345113 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe459b3-3e41-4642-b3b3-299f5a332474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:04.350883 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe459b3-3e41-4642-b3b3-299f5a332474 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:04.389874 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed24b43-8bfd-411a-a350-68b2af2b9d99 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:04.390593 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 818/1631] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:03:04.406301 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed24b43-8bfd-411a-a350-68b2af2b9d99 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:04.419870 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85d2b2-fd22-4f1e-9413-89d7c27ff51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:04.421653 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85d2b2-fd22-4f1e-9413-89d7c27ff51a admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:04.422694 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85d2b2-fd22-4f1e-9413-89d7c27ff51a admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:04.424010 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85d2b2-fd22-4f1e-9413-89d7c27ff51a admin admin] PATH_INFO: `/v3/projects/d6a52a8a72464145a5efa837ad4d19eb/users/f59e1e0014bb41d29375d5432311a1ad/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:04.452946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e85d2b2-fd22-4f1e-9413-89d7c27ff51a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6a52a8a72464145a5efa837ad4d19eb, user_id=f59e1e0014bb41d29375d5432311a1ad, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:04.457439 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e85d2b2-fd22-4f1e-9413-89d7c27ff51a admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:04.620207 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe459b3-3e41-4642-b3b3-299f5a332474 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:04.636650 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 814/1632] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:04 2022] PUT /identity/v3/projects/d6a52a8a72464145a5efa837ad4d19eb/users/f59e1e0014bb41d29375d5432311a1ad/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:03:04.656763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d2436-0070-4da3-98a1-5192aa57218d None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:04.656763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d2436-0070-4da3-98a1-5192aa57218d None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:04.656763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d2436-0070-4da3-98a1-5192aa57218d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:04.668473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe459b3-3e41-4642-b3b3-299f5a332474 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:04.713145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-3f3d2436-0070-4da3-98a1-5192aa57218d None None] MFA Rules not processed for user `f59e1e0014bb41d29375d5432311a1ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:04.714587 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-3f3d2436-0070-4da3-98a1-5192aa57218d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:04.761383 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:04.839415 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065add6b-bd84-42ab-806d-64288c91da0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:04.840767 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065add6b-bd84-42ab-806d-64288c91da0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:04.840971 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065add6b-bd84-42ab-806d-64288c91da0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:04.841228 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065add6b-bd84-42ab-806d-64288c91da0b admin admin] PATH_INFO: `/v3/users/74e3f462380c432287adf0e30372c697` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:04.844461 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065add6b-bd84-42ab-806d-64288c91da0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=74e3f462380c432287adf0e30372c697)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:04.848516 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065add6b-bd84-42ab-806d-64288c91da0b admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:04.874713 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 815/1633] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:03:04.876045 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e385a-6487-4c96-b6e0-f8d36c5aa211 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:04.876338 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e385a-6487-4c96-b6e0-f8d36c5aa211 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:04.876788 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e385a-6487-4c96-b6e0-f8d36c5aa211 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:04.881419 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 816/1634] 10.222.0.64 () {54 vars in 912 bytes} [Wed Aug 24 16:03:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:03:04.882091 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e385a-6487-4c96-b6e0-f8d36c5aa211 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:04.910037 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e385a-6487-4c96-b6e0-f8d36c5aa211 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:04.913303 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8631f9e-eb5c-4aef-9088-1357614fe1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:04.913910 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8631f9e-eb5c-4aef-9088-1357614fe1bb admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:04.914194 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8631f9e-eb5c-4aef-9088-1357614fe1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:04.914544 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8631f9e-eb5c-4aef-9088-1357614fe1bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:04.915322 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8631f9e-eb5c-4aef-9088-1357614fe1bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:04.917406 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8631f9e-eb5c-4aef-9088-1357614fe1bb admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:05.050108 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 817/1635] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:03:04 2022] POST /identity/v3/projects => generated 387 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:05.055107 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16fb46e-b27a-4432-a53d-dd8c5f7bf47b None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:05.056293 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16fb46e-b27a-4432-a53d-dd8c5f7bf47b None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:05.056582 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16fb46e-b27a-4432-a53d-dd8c5f7bf47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:05.106098 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-f16fb46e-b27a-4432-a53d-dd8c5f7bf47b None None] MFA Rules not processed for user `e5f0d8fe42e74d68bfa9a0e365bab4b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:05.107758 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-f16fb46e-b27a-4432-a53d-dd8c5f7bf47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:05.118407 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-065add6b-bd84-42ab-806d-64288c91da0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74e3f462380c432287adf0e30372c697'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:05.121280 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-065add6b-bd84-42ab-806d-64288c91da0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74e3f462380c432287adf0e30372c697'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:05.122649 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-065add6b-bd84-42ab-806d-64288c91da0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74e3f462380c432287adf0e30372c697'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:05.169647 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-065add6b-bd84-42ab-806d-64288c91da0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74e3f462380c432287adf0e30372c697'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:05.263497 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 818/1636] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 24 16:03:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:05.265841 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16fb46e-b27a-4432-a53d-dd8c5f7bf47b None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:05.267667 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-f16fb46e-b27a-4432-a53d-dd8c5f7bf47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:05.290718 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-065add6b-bd84-42ab-806d-64288c91da0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74e3f462380c432287adf0e30372c697'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:05.316363 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 819/1637] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:03:04 2022] DELETE /identity/v3/users/74e3f462380c432287adf0e30372c697 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:03:05.317818 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065add6b-bd84-42ab-806d-64288c91da0b admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:05.320543 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-065add6b-bd84-42ab-806d-64288c91da0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:05.369053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:05.406468 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16fb46e-b27a-4432-a53d-dd8c5f7bf47b None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:05.458030 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065add6b-bd84-42ab-806d-64288c91da0b admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:05.586529 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e40d4-81bf-4cb7-b4eb-f6b9efd4e500 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:05.586529 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e40d4-81bf-4cb7-b4eb-f6b9efd4e500 service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:05.586529 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e40d4-81bf-4cb7-b4eb-f6b9efd4e500 service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:05.586529 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e40d4-81bf-4cb7-b4eb-f6b9efd4e500 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:05.587525 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d05aa-944b-46ab-8d6e-f22901619a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:05.587525 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d05aa-944b-46ab-8d6e-f22901619a03 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:05.587525 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d05aa-944b-46ab-8d6e-f22901619a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:05.587525 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d05aa-944b-46ab-8d6e-f22901619a03 admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:05.819370 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d05aa-944b-46ab-8d6e-f22901619a03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:05.819370 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d05aa-944b-46ab-8d6e-f22901619a03 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:05.820387 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e40d4-81bf-4cb7-b4eb-f6b9efd4e500 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:05.820387 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e40d4-81bf-4cb7-b4eb-f6b9efd4e500 service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:05.820387 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 820/1638] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:05.820387 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856d38f-f50d-4176-b68a-fe22e1979dd8 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:05.820387 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856d38f-f50d-4176-b68a-fe22e1979dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:05.820387 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856d38f-f50d-4176-b68a-fe22e1979dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:05.820924 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-7856d38f-f50d-4176-b68a-fe22e1979dd8 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:05.820924 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-7856d38f-f50d-4176-b68a-fe22e1979dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:05.820924 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 821/1639] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:05.821263 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 819/1640] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:03:05 2022] POST /identity/v3/users => generated 300 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:05.821775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856d38f-f50d-4176-b68a-fe22e1979dd8 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:05.821775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856d38f-f50d-4176-b68a-fe22e1979dd8 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:05.821775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c7a8f-0a2c-4cfb-86b4-a2af7bff957d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:05.821775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c7a8f-0a2c-4cfb-86b4-a2af7bff957d admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:05.822566 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c7a8f-0a2c-4cfb-86b4-a2af7bff957d admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:05.822566 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c7a8f-0a2c-4cfb-86b4-a2af7bff957d admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:05.822566 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c7a8f-0a2c-4cfb-86b4-a2af7bff957d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:05.822566 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c7a8f-0a2c-4cfb-86b4-a2af7bff957d admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:05.831770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 822/1641] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:05.837364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d05aa-944b-46ab-8d6e-f22901619a03 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:05.853413 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d05aa-944b-46ab-8d6e-f22901619a03 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:05.860051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a692d11-fea2-4f2a-8a9d-6fc17e84f328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:05.863251 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a692d11-fea2-4f2a-8a9d-6fc17e84f328 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:05.863251 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a692d11-fea2-4f2a-8a9d-6fc17e84f328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:05.863251 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a692d11-fea2-4f2a-8a9d-6fc17e84f328 admin admin] PATH_INFO: `/v3/projects/33b5a5b7aa394efb9374b1581b4aefd1/users/27c1bb568b214651aa56d7e0ba80d668/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:05.882226 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c7a8f-0a2c-4cfb-86b4-a2af7bff957d admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:05.883349 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:05.887776 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a692d11-fea2-4f2a-8a9d-6fc17e84f328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33b5a5b7aa394efb9374b1581b4aefd1, user_id=27c1bb568b214651aa56d7e0ba80d668, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:05.891697 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a692d11-fea2-4f2a-8a9d-6fc17e84f328 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:05.892786 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-793c7a8f-0a2c-4cfb-86b4-a2af7bff957d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:06.002927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c7a8f-0a2c-4cfb-86b4-a2af7bff957d admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:06.009114 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc77d3d-5a33-4aa4-86a0-9c7d4ca557bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:06.009791 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc77d3d-5a33-4aa4-86a0-9c7d4ca557bd service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:06.010171 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc77d3d-5a33-4aa4-86a0-9c7d4ca557bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:06.010505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc77d3d-5a33-4aa4-86a0-9c7d4ca557bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:06.025299 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc77d3d-5a33-4aa4-86a0-9c7d4ca557bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:06.028238 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc77d3d-5a33-4aa4-86a0-9c7d4ca557bd service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:06.044980 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 823/1642] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:06.216715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 820/1643] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:05 2022] PUT /identity/v3/projects/33b5a5b7aa394efb9374b1581b4aefd1/users/27c1bb568b214651aa56d7e0ba80d668/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:06.220003 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc77d3d-5a33-4aa4-86a0-9c7d4ca557bd service neutron] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:06.239508 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc77d3d-5a33-4aa4-86a0-9c7d4ca557bd service neutron] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:06.421168 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5f181-1688-4126-a9ba-58ec3ee0cfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:06.421815 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5f181-1688-4126-a9ba-58ec3ee0cfea admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:06.422095 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5f181-1688-4126-a9ba-58ec3ee0cfea admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:06.422364 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5f181-1688-4126-a9ba-58ec3ee0cfea admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:06.423028 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5f181-1688-4126-a9ba-58ec3ee0cfea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:06.430023 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5f181-1688-4126-a9ba-58ec3ee0cfea admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:06.456491 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 824/1644] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:06.459001 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a692d11-fea2-4f2a-8a9d-6fc17e84f328 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:06.473202 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a692d11-fea2-4f2a-8a9d-6fc17e84f328 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:06.489946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851dbd79-817c-430e-bc1c-42cad42c5939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:06.491739 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dbd79-817c-430e-bc1c-42cad42c5939 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:06.492536 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dbd79-817c-430e-bc1c-42cad42c5939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:06.493275 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dbd79-817c-430e-bc1c-42cad42c5939 admin admin] PATH_INFO: `/v3/projects/33b5a5b7aa394efb9374b1581b4aefd1/users/27c1bb568b214651aa56d7e0ba80d668/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:06.498072 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851dbd79-817c-430e-bc1c-42cad42c5939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33b5a5b7aa394efb9374b1581b4aefd1, user_id=27c1bb568b214651aa56d7e0ba80d668, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:06.504110 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851dbd79-817c-430e-bc1c-42cad42c5939 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:06.562837 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 821/1645] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:06 2022] PUT /identity/v3/projects/33b5a5b7aa394efb9374b1581b4aefd1/users/27c1bb568b214651aa56d7e0ba80d668/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:06.563029 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8046c31-dd21-4753-bd0f-758920e2cfce None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:06.563029 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8046c31-dd21-4753-bd0f-758920e2cfce None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:06.563029 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8046c31-dd21-4753-bd0f-758920e2cfce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:06.663116 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-c8046c31-dd21-4753-bd0f-758920e2cfce None None] MFA Rules not processed for user `27c1bb568b214651aa56d7e0ba80d668`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:06.665162 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-c8046c31-dd21-4753-bd0f-758920e2cfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:06.875972 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 825/1646] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:06 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:03:06.898055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851dbd79-817c-430e-bc1c-42cad42c5939 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:07.023394 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851dbd79-817c-430e-bc1c-42cad42c5939 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:07.033011 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbbb8b-1815-43ef-bf22-fd8df6114082 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:07.034543 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbbb8b-1815-43ef-bf22-fd8df6114082 service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:07.035135 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbbb8b-1815-43ef-bf22-fd8df6114082 service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:07.035537 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbbb8b-1815-43ef-bf22-fd8df6114082 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:07.056722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffbbb8b-1815-43ef-bf22-fd8df6114082 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:07.058454 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffbbb8b-1815-43ef-bf22-fd8df6114082 service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:07.092083 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 822/1647] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:06 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:03:07.481440 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f479e0-6cf0-4b20-aecd-c52f0f9eb4b0 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:07.482023 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f479e0-6cf0-4b20-aecd-c52f0f9eb4b0 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:07.482023 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f479e0-6cf0-4b20-aecd-c52f0f9eb4b0 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:07.489209 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 826/1648] 10.222.0.64 () {54 vars in 962 bytes} [Wed Aug 24 16:03:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:03:07.497327 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687500f-d465-42bb-a89d-4c8aafa6cf35 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:07.497941 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687500f-d465-42bb-a89d-4c8aafa6cf35 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:07.498463 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687500f-d465-42bb-a89d-4c8aafa6cf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:07.548982 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-0687500f-d465-42bb-a89d-4c8aafa6cf35 None None] MFA Rules not processed for user `e5f0d8fe42e74d68bfa9a0e365bab4b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:07.553567 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-0687500f-d465-42bb-a89d-4c8aafa6cf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:07.775770 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 823/1649] 10.222.0.64 () {58 vars in 1059 bytes} [Wed Aug 24 16:03:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:07.781689 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef7e67-1915-46f5-828c-0746c9ff6876 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:07.782486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef7e67-1915-46f5-828c-0746c9ff6876 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:07.783056 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef7e67-1915-46f5-828c-0746c9ff6876 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:07.785361 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 827/1650] 10.222.0.64 () {54 vars in 912 bytes} [Wed Aug 24 16:03:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:03:07.792427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d2137-f5d1-4e16-b60a-e22ca7547467 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:07.792427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d2137-f5d1-4e16-b60a-e22ca7547467 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:07.794942 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d2137-f5d1-4e16-b60a-e22ca7547467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:07.849241 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-f43d2137-f5d1-4e16-b60a-e22ca7547467 None None] MFA Rules not processed for user `e5f0d8fe42e74d68bfa9a0e365bab4b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:07.852276 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-f43d2137-f5d1-4e16-b60a-e22ca7547467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:07.894503 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 824/1651] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 24 16:03:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:07.902873 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:08.223101 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef7e67-1915-46f5-828c-0746c9ff6876 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:08.226200 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-a2ef7e67-1915-46f5-828c-0746c9ff6876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:08.351512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef7e67-1915-46f5-828c-0746c9ff6876 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:08.357878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b764d9-5449-45ab-8e82-63e216fe5448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:08.358967 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b764d9-5449-45ab-8e82-63e216fe5448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:08.359260 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b764d9-5449-45ab-8e82-63e216fe5448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:08.359533 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b764d9-5449-45ab-8e82-63e216fe5448 admin admin] PATH_INFO: `/v3/projects/2a005464ffbb43889eb8adaf18bd09d9` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:08.361735 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b764d9-5449-45ab-8e82-63e216fe5448 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a005464ffbb43889eb8adaf18bd09d9)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:08.362800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: WARNING py.warnings [None req-a6b764d9-5449-45ab-8e82-63e216fe5448 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:03:08.362800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: warnings.warn(msg) Aug 24 16:03:08.362800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: Aug 24 16:03:08.364261 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b764d9-5449-45ab-8e82-63e216fe5448 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:08.476508 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d2137-f5d1-4e16-b60a-e22ca7547467 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:08.478028 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-f43d2137-f5d1-4e16-b60a-e22ca7547467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:08.509644 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d2137-f5d1-4e16-b60a-e22ca7547467 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:08.537267 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-a6b764d9-5449-45ab-8e82-63e216fe5448 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a005464ffbb43889eb8adaf18bd09d9', 'request_id': 'req-a6b764d9-5449-45ab-8e82-63e216fe5448'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:08.546882 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:08.605843 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425846b-c5ac-4bfe-85e9-dbf3c899143f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:08.606593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425846b-c5ac-4bfe-85e9-dbf3c899143f service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:08.606877 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425846b-c5ac-4bfe-85e9-dbf3c899143f service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:08.607153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425846b-c5ac-4bfe-85e9-dbf3c899143f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:08.637318 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-a6b764d9-5449-45ab-8e82-63e216fe5448 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a005464ffbb43889eb8adaf18bd09d9', 'request_id': 'req-a6b764d9-5449-45ab-8e82-63e216fe5448'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:08.676579 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-a6b764d9-5449-45ab-8e82-63e216fe5448 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a005464ffbb43889eb8adaf18bd09d9', 'request_id': 'req-a6b764d9-5449-45ab-8e82-63e216fe5448'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:08.699671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-a6b764d9-5449-45ab-8e82-63e216fe5448 admin admin] The token cache is being invalidate because project 2a005464ffbb43889eb8adaf18bd09d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:03:08.707050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-a6b764d9-5449-45ab-8e82-63e216fe5448 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:08.707050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-a6b764d9-5449-45ab-8e82-63e216fe5448 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:08.708796 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 828/1652] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:03:08 2022] DELETE /identity/v3/projects/2a005464ffbb43889eb8adaf18bd09d9 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:08.710113 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b764d9-5449-45ab-8e82-63e216fe5448 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:08.712026 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-a6b764d9-5449-45ab-8e82-63e216fe5448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:08.806574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425846b-c5ac-4bfe-85e9-dbf3c899143f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:08.808073 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425846b-c5ac-4bfe-85e9-dbf3c899143f service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:08.847057 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 825/1653] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:03:08.874795 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:08.884177 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b764d9-5449-45ab-8e82-63e216fe5448 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:08.904396 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8645e-1318-4688-a93c-b4bcfb4be144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:08.906299 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8645e-1318-4688-a93c-b4bcfb4be144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:08.909836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8645e-1318-4688-a93c-b4bcfb4be144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:08.911984 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8645e-1318-4688-a93c-b4bcfb4be144 admin admin] PATH_INFO: `/v3/users/dc8da54b4bdc44499fa971a8fa611887` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:08.914870 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8645e-1318-4688-a93c-b4bcfb4be144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc8da54b4bdc44499fa971a8fa611887)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:08.923705 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8645e-1318-4688-a93c-b4bcfb4be144 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:09.186585 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425846b-c5ac-4bfe-85e9-dbf3c899143f service cinder] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:09.209190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425846b-c5ac-4bfe-85e9-dbf3c899143f service cinder] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:09.219519 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13949a2b-ca2c-44a9-9d94-3d936b49d220 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:09.220037 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13949a2b-ca2c-44a9-9d94-3d936b49d220 service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:09.220324 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13949a2b-ca2c-44a9-9d94-3d936b49d220 service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:09.220603 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13949a2b-ca2c-44a9-9d94-3d936b49d220 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:09.224864 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-09f8645e-1318-4688-a93c-b4bcfb4be144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc8da54b4bdc44499fa971a8fa611887'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:09.225254 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-13949a2b-ca2c-44a9-9d94-3d936b49d220 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:09.226972 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-09f8645e-1318-4688-a93c-b4bcfb4be144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc8da54b4bdc44499fa971a8fa611887'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:09.227685 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-09f8645e-1318-4688-a93c-b4bcfb4be144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc8da54b4bdc44499fa971a8fa611887'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:09.257048 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-09f8645e-1318-4688-a93c-b4bcfb4be144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc8da54b4bdc44499fa971a8fa611887'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:09.324146 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13949a2b-ca2c-44a9-9d94-3d936b49d220 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:09.325671 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13949a2b-ca2c-44a9-9d94-3d936b49d220 service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:09.351127 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 826/1654] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:09 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:03:09.361686 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-09f8645e-1318-4688-a93c-b4bcfb4be144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc8da54b4bdc44499fa971a8fa611887'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:09.401368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 829/1655] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:03:08 2022] DELETE /identity/v3/users/dc8da54b4bdc44499fa971a8fa611887 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:11.495240 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13949a2b-ca2c-44a9-9d94-3d936b49d220 service cinder] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:11.520687 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13949a2b-ca2c-44a9-9d94-3d936b49d220 service cinder] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:11.659615 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:11.690947 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7ae6e-be6a-4ec9-83a2-b22519f7d01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:11.692050 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7ae6e-be6a-4ec9-83a2-b22519f7d01c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:11.692445 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7ae6e-be6a-4ec9-83a2-b22519f7d01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:11.695737 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7ae6e-be6a-4ec9-83a2-b22519f7d01c admin admin] PATH_INFO: `/v3/projects/9e006738c6f6487bb4b8869b85d2e4c6` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:11.699562 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7ae6e-be6a-4ec9-83a2-b22519f7d01c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e006738c6f6487bb4b8869b85d2e4c6)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:11.702005 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7ae6e-be6a-4ec9-83a2-b22519f7d01c admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:11.950096 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-6ea7ae6e-be6a-4ec9-83a2-b22519f7d01c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e006738c6f6487bb4b8869b85d2e4c6', 'request_id': 'req-6ea7ae6e-be6a-4ec9-83a2-b22519f7d01c'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:11.963602 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-6ea7ae6e-be6a-4ec9-83a2-b22519f7d01c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e006738c6f6487bb4b8869b85d2e4c6', 'request_id': 'req-6ea7ae6e-be6a-4ec9-83a2-b22519f7d01c'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:11.975727 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-6ea7ae6e-be6a-4ec9-83a2-b22519f7d01c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e006738c6f6487bb4b8869b85d2e4c6', 'request_id': 'req-6ea7ae6e-be6a-4ec9-83a2-b22519f7d01c'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:12.072885 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-6ea7ae6e-be6a-4ec9-83a2-b22519f7d01c admin admin] The token cache is being invalidate because project 9e006738c6f6487bb4b8869b85d2e4c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:03:12.072885 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-6ea7ae6e-be6a-4ec9-83a2-b22519f7d01c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:12.073819 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-6ea7ae6e-be6a-4ec9-83a2-b22519f7d01c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:12.077358 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 827/1656] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:03:11 2022] DELETE /identity/v3/projects/9e006738c6f6487bb4b8869b85d2e4c6 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:12.082826 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb2cc0-7253-45ce-9c1d-42a56f7c1cb2 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:12.083255 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb2cc0-7253-45ce-9c1d-42a56f7c1cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:12.083557 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb2cc0-7253-45ce-9c1d-42a56f7c1cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:12.139606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-d3cb2cc0-7253-45ce-9c1d-42a56f7c1cb2 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:12.148218 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-d3cb2cc0-7253-45ce-9c1d-42a56f7c1cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:12.356181 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 830/1657] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:12.366020 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0018f-1305-4c01-bb72-b44d9a947763 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:12.366358 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0018f-1305-4c01-bb72-b44d9a947763 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:12.366578 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0018f-1305-4c01-bb72-b44d9a947763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:12.400699 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-64d0018f-1305-4c01-bb72-b44d9a947763 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:12.400699 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-64d0018f-1305-4c01-bb72-b44d9a947763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:12.413991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 828/1658] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:12.418150 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb2cc0-7253-45ce-9c1d-42a56f7c1cb2 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:12.438640 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb2cc0-7253-45ce-9c1d-42a56f7c1cb2 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:12.475289 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a1ae8-7168-4668-9203-b799947d44cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:12.475930 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a1ae8-7168-4668-9203-b799947d44cd admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:12.476206 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a1ae8-7168-4668-9203-b799947d44cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:12.476653 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a1ae8-7168-4668-9203-b799947d44cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:12.477824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a1ae8-7168-4668-9203-b799947d44cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:03:12.480559 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a1ae8-7168-4668-9203-b799947d44cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:12.493910 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a1ae8-7168-4668-9203-b799947d44cd admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:12.498138 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:12.532385 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0018f-1305-4c01-bb72-b44d9a947763 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:12.543628 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0018f-1305-4c01-bb72-b44d9a947763 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:12.547900 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 831/1659] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:03:12.565675 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8127744-0641-448c-947c-eabca41ce28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:12.566515 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8127744-0641-448c-947c-eabca41ce28e admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:12.566905 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8127744-0641-448c-947c-eabca41ce28e admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:12.567180 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8127744-0641-448c-947c-eabca41ce28e admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:12.567833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8127744-0641-448c-947c-eabca41ce28e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:12.569848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8127744-0641-448c-947c-eabca41ce28e admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:12.679376 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a1ae8-7168-4668-9203-b799947d44cd admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:12.689685 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 829/1660] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:03:12 2022] POST /identity/v3/projects => generated 405 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:03:12.696880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a1ae8-7168-4668-9203-b799947d44cd admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:12.812685 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8907ac-ae38-47de-8a15-2c4bd144aa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:12.813498 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8907ac-ae38-47de-8a15-2c4bd144aa63 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:12.813924 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8907ac-ae38-47de-8a15-2c4bd144aa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:12.814411 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8907ac-ae38-47de-8a15-2c4bd144aa63 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:12.815587 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8907ac-ae38-47de-8a15-2c4bd144aa63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:12.817983 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8907ac-ae38-47de-8a15-2c4bd144aa63 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:12.926089 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8127744-0641-448c-947c-eabca41ce28e admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:12.928517 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 832/1661] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:03:12 2022] POST /identity/v3/users => generated 303 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:12.942096 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8127744-0641-448c-947c-eabca41ce28e admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:12.953890 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34c3a8-91f3-48e3-810a-309f768b1e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:12.954776 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34c3a8-91f3-48e3-810a-309f768b1e80 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:12.955899 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34c3a8-91f3-48e3-810a-309f768b1e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:12.956564 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34c3a8-91f3-48e3-810a-309f768b1e80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:12.958268 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34c3a8-91f3-48e3-810a-309f768b1e80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:12.963786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34c3a8-91f3-48e3-810a-309f768b1e80 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:12.991636 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 830/1662] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:12.993220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8907ac-ae38-47de-8a15-2c4bd144aa63 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:13.008750 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8907ac-ae38-47de-8a15-2c4bd144aa63 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:13.025547 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20ef64-da16-4ae4-8c83-5ed627c635cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:13.026544 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20ef64-da16-4ae4-8c83-5ed627c635cc admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:13.027033 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20ef64-da16-4ae4-8c83-5ed627c635cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:13.027529 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20ef64-da16-4ae4-8c83-5ed627c635cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:13.028377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20ef64-da16-4ae4-8c83-5ed627c635cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:13.032309 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20ef64-da16-4ae4-8c83-5ed627c635cc admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:13.059533 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 833/1663] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:03:13.063812 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34c3a8-91f3-48e3-810a-309f768b1e80 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:13.097061 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34c3a8-91f3-48e3-810a-309f768b1e80 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:13.113754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b3484-47f2-4dff-ac10-72908aaa1ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:13.114436 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b3484-47f2-4dff-ac10-72908aaa1ec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:13.114711 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b3484-47f2-4dff-ac10-72908aaa1ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:13.114983 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b3484-47f2-4dff-ac10-72908aaa1ec4 admin admin] PATH_INFO: `/v3/projects/45ad4ca6aad64a509d4705bd592a67bb/users/8b6720c127d84ec48d77c8faadf9b5e1/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:13.158255 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9b3484-47f2-4dff-ac10-72908aaa1ec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45ad4ca6aad64a509d4705bd592a67bb, user_id=8b6720c127d84ec48d77c8faadf9b5e1, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:13.161626 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9b3484-47f2-4dff-ac10-72908aaa1ec4 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:13.286738 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 831/1664] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:13 2022] PUT /identity/v3/projects/45ad4ca6aad64a509d4705bd592a67bb/users/8b6720c127d84ec48d77c8faadf9b5e1/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:03:13.291478 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d6c5e-2d47-4a91-b560-860cdbdb16ae None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:13.292425 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d6c5e-2d47-4a91-b560-860cdbdb16ae None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:13.292948 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d6c5e-2d47-4a91-b560-860cdbdb16ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:13.329717 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-510d6c5e-2d47-4a91-b560-860cdbdb16ae None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:13.331289 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-510d6c5e-2d47-4a91-b560-860cdbdb16ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:13.501517 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 834/1665] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:13.535239 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b3484-47f2-4dff-ac10-72908aaa1ec4 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:13.537366 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-2c9b3484-47f2-4dff-ac10-72908aaa1ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:13.717528 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b3484-47f2-4dff-ac10-72908aaa1ec4 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:13.728877 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb4726-5680-4b15-9341-ab5de3b285c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:13.731372 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb4726-5680-4b15-9341-ab5de3b285c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:13.731583 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb4726-5680-4b15-9341-ab5de3b285c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:13.731868 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb4726-5680-4b15-9341-ab5de3b285c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:13.780740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb4726-5680-4b15-9341-ab5de3b285c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:13.786066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb4726-5680-4b15-9341-ab5de3b285c3 service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:13.819464 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 832/1666] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:15.920130 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d6c5e-2d47-4a91-b560-860cdbdb16ae None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:15.921993 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-510d6c5e-2d47-4a91-b560-860cdbdb16ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:15.948950 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d6c5e-2d47-4a91-b560-860cdbdb16ae None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:15.974500 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca564110-4efb-4b25-89c7-08ecfff0d6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:15.975604 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca564110-4efb-4b25-89c7-08ecfff0d6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:15.976038 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca564110-4efb-4b25-89c7-08ecfff0d6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:15.976461 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca564110-4efb-4b25-89c7-08ecfff0d6aa admin admin] PATH_INFO: `/v3/users/f592a217d12141278b52707518ad4d47` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:15.984611 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca564110-4efb-4b25-89c7-08ecfff0d6aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f592a217d12141278b52707518ad4d47)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:15.988505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca564110-4efb-4b25-89c7-08ecfff0d6aa admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:16.276981 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-ca564110-4efb-4b25-89c7-08ecfff0d6aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f592a217d12141278b52707518ad4d47'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:16.277850 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-ca564110-4efb-4b25-89c7-08ecfff0d6aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f592a217d12141278b52707518ad4d47'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:16.278271 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-ca564110-4efb-4b25-89c7-08ecfff0d6aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f592a217d12141278b52707518ad4d47'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:16.377165 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-ca564110-4efb-4b25-89c7-08ecfff0d6aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f592a217d12141278b52707518ad4d47'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:16.377165 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:16.430688 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-ca564110-4efb-4b25-89c7-08ecfff0d6aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f592a217d12141278b52707518ad4d47'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:16.454101 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 835/1667] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:03:15 2022] DELETE /identity/v3/users/f592a217d12141278b52707518ad4d47 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:16.459358 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d032f5-7efe-4c85-a1d0-5ff11cc5c83e None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:16.459885 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d032f5-7efe-4c85-a1d0-5ff11cc5c83e None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:16.459885 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d032f5-7efe-4c85-a1d0-5ff11cc5c83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:16.514902 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-e9d032f5-7efe-4c85-a1d0-5ff11cc5c83e None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:16.515215 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e9d032f5-7efe-4c85-a1d0-5ff11cc5c83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:16.592488 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:16.701104 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 833/1668] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:16.727124 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca564110-4efb-4b25-89c7-08ecfff0d6aa admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:16.728767 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-ca564110-4efb-4b25-89c7-08ecfff0d6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:16.885692 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca564110-4efb-4b25-89c7-08ecfff0d6aa admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:16.903245 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fb6e5-ffa1-4924-bb7b-45988f2436c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:16.907211 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fb6e5-ffa1-4924-bb7b-45988f2436c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:16.909130 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fb6e5-ffa1-4924-bb7b-45988f2436c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:16.914326 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fb6e5-ffa1-4924-bb7b-45988f2436c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:16.931393 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8fb6e5-ffa1-4924-bb7b-45988f2436c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:16.933652 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8fb6e5-ffa1-4924-bb7b-45988f2436c3 service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:16.949844 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 836/1669] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:17.063262 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1a7c3-c63c-43de-bd70-a6c893410021 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:17.065657 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1a7c3-c63c-43de-bd70-a6c893410021 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:17.065657 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1a7c3-c63c-43de-bd70-a6c893410021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:17.137620 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-1cb1a7c3-c63c-43de-bd70-a6c893410021 None None] MFA Rules not processed for user `c640f4b512f748669f75f297f5bf8df9`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:17.140517 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-1cb1a7c3-c63c-43de-bd70-a6c893410021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:17.178755 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fb6e5-ffa1-4924-bb7b-45988f2436c3 service neutron] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:17.180588 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-7d8fb6e5-ffa1-4924-bb7b-45988f2436c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:17.353309 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fb6e5-ffa1-4924-bb7b-45988f2436c3 service neutron] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:17.372356 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 834/1670] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:17.377328 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b31a2-9ef4-4d3c-9d81-80a300f53d88 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:17.381596 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b31a2-9ef4-4d3c-9d81-80a300f53d88 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:17.383011 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b31a2-9ef4-4d3c-9d81-80a300f53d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:17.383825 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33bf325-f8ef-4ca1-baf9-ca8786dcd644 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:17.387536 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33bf325-f8ef-4ca1-baf9-ca8786dcd644 service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:17.388020 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33bf325-f8ef-4ca1-baf9-ca8786dcd644 service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:17.388448 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33bf325-f8ef-4ca1-baf9-ca8786dcd644 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:17.395573 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-f33bf325-f8ef-4ca1-baf9-ca8786dcd644 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:17.439785 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-005b31a2-9ef4-4d3c-9d81-80a300f53d88 None None] MFA Rules not processed for user `c640f4b512f748669f75f297f5bf8df9`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:17.445473 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-005b31a2-9ef4-4d3c-9d81-80a300f53d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:17.466271 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 835/1671] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:17.480971 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b31a2-9ef4-4d3c-9d81-80a300f53d88 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:17.483189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-005b31a2-9ef4-4d3c-9d81-80a300f53d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:17.582358 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33bf325-f8ef-4ca1-baf9-ca8786dcd644 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:17.587652 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33bf325-f8ef-4ca1-baf9-ca8786dcd644 service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:17.619896 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 837/1672] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:03:17.748077 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b31a2-9ef4-4d3c-9d81-80a300f53d88 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:17.748077 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59d596-9e42-4616-a8e2-48a428a14001 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:17.748077 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59d596-9e42-4616-a8e2-48a428a14001 service nova] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:17.748077 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59d596-9e42-4616-a8e2-48a428a14001 service nova] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:17.748548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59d596-9e42-4616-a8e2-48a428a14001 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:17.752853 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f329b-fd18-4988-ab28-87e2ccfdb982 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:17.754655 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f329b-fd18-4988-ab28-87e2ccfdb982 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:17.757014 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f329b-fd18-4988-ab28-87e2ccfdb982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:17.780037 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59d596-9e42-4616-a8e2-48a428a14001 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:17.785288 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59d596-9e42-4616-a8e2-48a428a14001 service nova] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:17.829174 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 836/1673] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:17 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:03:17.906359 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-cf6f329b-fd18-4988-ab28-87e2ccfdb982 None None] MFA Rules not processed for user `8b6720c127d84ec48d77c8faadf9b5e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:17.908667 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-cf6f329b-fd18-4988-ab28-87e2ccfdb982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:18.203297 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 838/1674] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:17 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:18.209781 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59d596-9e42-4616-a8e2-48a428a14001 service nova] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:18.213775 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-5c59d596-9e42-4616-a8e2-48a428a14001 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:18.260877 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59d596-9e42-4616-a8e2-48a428a14001 service nova] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:18.274407 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0568d-2edd-4930-a28b-6603fc61491c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:18.280705 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0568d-2edd-4930-a28b-6603fc61491c admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:18.280705 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0568d-2edd-4930-a28b-6603fc61491c admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:18.280705 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0568d-2edd-4930-a28b-6603fc61491c admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:18.280705 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0568d-2edd-4930-a28b-6603fc61491c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:18.285150 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0568d-2edd-4930-a28b-6603fc61491c admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:18.440947 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:18.453718 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 837/1675] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:03:18 2022] POST /identity/v3/projects => generated 405 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:18.455411 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f329b-fd18-4988-ab28-87e2ccfdb982 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:18.493903 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f329b-fd18-4988-ab28-87e2ccfdb982 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:18.664874 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec1b2a-dcf7-43f2-8a08-47565060dde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:18.665469 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec1b2a-dcf7-43f2-8a08-47565060dde3 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:18.665921 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec1b2a-dcf7-43f2-8a08-47565060dde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:18.666346 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec1b2a-dcf7-43f2-8a08-47565060dde3 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:18.667129 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec1b2a-dcf7-43f2-8a08-47565060dde3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:18.669441 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec1b2a-dcf7-43f2-8a08-47565060dde3 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:18.823008 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea35775-18b0-4f2c-b34d-31191d61ade4 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:18.823008 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea35775-18b0-4f2c-b34d-31191d61ade4 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:18.823008 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea35775-18b0-4f2c-b34d-31191d61ade4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:18.860435 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 839/1676] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:03:18 2022] POST /identity/v3/users => generated 309 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:18.863476 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec1b2a-dcf7-43f2-8a08-47565060dde3 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:18.869120 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-2dec1b2a-dcf7-43f2-8a08-47565060dde3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:18.916456 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec1b2a-dcf7-43f2-8a08-47565060dde3 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:18.930518 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd18dd-5396-498d-ac2d-ae7e145165db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:18.932243 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd18dd-5396-498d-ac2d-ae7e145165db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:18.932243 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd18dd-5396-498d-ac2d-ae7e145165db admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:18.932243 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd18dd-5396-498d-ac2d-ae7e145165db admin admin] PATH_INFO: `/v3/projects/67f683e38d604d4f844b7d8448a5f30b` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:18.935450 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:18.937037 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd18dd-5396-498d-ac2d-ae7e145165db admin admin] RBAC: Authorizing `identity:delete_project(project_id=67f683e38d604d4f844b7d8448a5f30b)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:18.942820 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd18dd-5396-498d-ac2d-ae7e145165db admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:18.945705 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-aea35775-18b0-4f2c-b34d-31191d61ade4 None None] MFA Rules not processed for user `3f9710b10a9a4746a57a29dfedf88866`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:18.946950 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-aea35775-18b0-4f2c-b34d-31191d61ade4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:19.135616 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 838/1677] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:19.135616 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea35775-18b0-4f2c-b34d-31191d61ade4 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:19.157133 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea35775-18b0-4f2c-b34d-31191d61ade4 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:19.186697 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-7efd18dd-5396-498d-ac2d-ae7e145165db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67f683e38d604d4f844b7d8448a5f30b', 'request_id': 'req-7efd18dd-5396-498d-ac2d-ae7e145165db'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:19.269159 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-7efd18dd-5396-498d-ac2d-ae7e145165db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67f683e38d604d4f844b7d8448a5f30b', 'request_id': 'req-7efd18dd-5396-498d-ac2d-ae7e145165db'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:19.282801 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-7efd18dd-5396-498d-ac2d-ae7e145165db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67f683e38d604d4f844b7d8448a5f30b', 'request_id': 'req-7efd18dd-5396-498d-ac2d-ae7e145165db'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:19.310812 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-7efd18dd-5396-498d-ac2d-ae7e145165db admin admin] The token cache is being invalidate because project 67f683e38d604d4f844b7d8448a5f30b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:03:19.311241 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-7efd18dd-5396-498d-ac2d-ae7e145165db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:19.312058 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-7efd18dd-5396-498d-ac2d-ae7e145165db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:19.316085 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 840/1678] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:03:18 2022] DELETE /identity/v3/projects/67f683e38d604d4f844b7d8448a5f30b => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:19.322965 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179b1d6-480b-47d4-b688-60da72edec95 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:19.324949 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179b1d6-480b-47d4-b688-60da72edec95 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:19.326355 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179b1d6-480b-47d4-b688-60da72edec95 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:19.327887 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 841/1679] 10.222.0.64 () {54 vars in 912 bytes} [Wed Aug 24 16:03:19 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:03:19.329238 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179b1d6-480b-47d4-b688-60da72edec95 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:19.339482 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-a179b1d6-480b-47d4-b688-60da72edec95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:19.363011 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266bf9a-9021-4971-a7ef-3f3f078a6b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:19.365023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266bf9a-9021-4971-a7ef-3f3f078a6b28 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:19.366445 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266bf9a-9021-4971-a7ef-3f3f078a6b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:19.367355 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266bf9a-9021-4971-a7ef-3f3f078a6b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:19.369319 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266bf9a-9021-4971-a7ef-3f3f078a6b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:19.374262 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266bf9a-9021-4971-a7ef-3f3f078a6b28 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:19.402684 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 839/1680] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:19.405097 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555204e4-b58a-48d6-8d2d-1905c92661a8 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:19.405662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555204e4-b58a-48d6-8d2d-1905c92661a8 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:19.406069 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555204e4-b58a-48d6-8d2d-1905c92661a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:19.440898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-555204e4-b58a-48d6-8d2d-1905c92661a8 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:19.442427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-555204e4-b58a-48d6-8d2d-1905c92661a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:19.468857 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179b1d6-480b-47d4-b688-60da72edec95 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:19.480495 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 840/1681] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:19.488964 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04878f7-f3e0-4414-be54-1d3ab5e9cddb None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:19.488964 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04878f7-f3e0-4414-be54-1d3ab5e9cddb None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:19.488964 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04878f7-f3e0-4414-be54-1d3ab5e9cddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:19.497088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d3fac-0818-4bcd-88b5-42ba995071f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:19.497873 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d3fac-0818-4bcd-88b5-42ba995071f2 service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:19.498256 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d3fac-0818-4bcd-88b5-42ba995071f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:19.498633 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d3fac-0818-4bcd-88b5-42ba995071f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:19.503732 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-ab7d3fac-0818-4bcd-88b5-42ba995071f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:19.522723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:19.578684 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-e04878f7-f3e0-4414-be54-1d3ab5e9cddb None None] MFA Rules not processed for user `80f7e6f1af76404096d4c717cbcf20f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:19.580765 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e04878f7-f3e0-4414-be54-1d3ab5e9cddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:19.624866 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d3fac-0818-4bcd-88b5-42ba995071f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:19.639664 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 841/1682] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 24 16:03:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:19.640863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04878f7-f3e0-4414-be54-1d3ab5e9cddb None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:19.642650 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e04878f7-f3e0-4414-be54-1d3ab5e9cddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:19.648086 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d3fac-0818-4bcd-88b5-42ba995071f2 service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:19.668735 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04878f7-f3e0-4414-be54-1d3ab5e9cddb None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:19.675806 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8213a-53c1-4972-897e-f66e7e3e82f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:19.677601 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8213a-53c1-4972-897e-f66e7e3e82f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:19.677601 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8213a-53c1-4972-897e-f66e7e3e82f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:19.677601 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8213a-53c1-4972-897e-f66e7e3e82f2 admin admin] PATH_INFO: `/v3/projects/1252fc2f3c104a57af1dc6cae76e1a0c/users/bfc9c96ac0c14007b7d8da83a1cb0773/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:19.686433 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 842/1683] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:19 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:19.687536 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d3fac-0818-4bcd-88b5-42ba995071f2 service nova] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:19.692257 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-ab7d3fac-0818-4bcd-88b5-42ba995071f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:19.698059 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8213a-53c1-4972-897e-f66e7e3e82f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1252fc2f3c104a57af1dc6cae76e1a0c, user_id=bfc9c96ac0c14007b7d8da83a1cb0773, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:19.701421 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8213a-53c1-4972-897e-f66e7e3e82f2 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:19.726511 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d3fac-0818-4bcd-88b5-42ba995071f2 service nova] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:19.732179 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98930a72-c39f-409a-8bc3-76f0d6e9bd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:19.734982 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98930a72-c39f-409a-8bc3-76f0d6e9bd78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:19.734982 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98930a72-c39f-409a-8bc3-76f0d6e9bd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:19.734982 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98930a72-c39f-409a-8bc3-76f0d6e9bd78 admin admin] PATH_INFO: `/v3/users/ff1d6c119e8442209714f0a046aab35c` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:19.734982 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98930a72-c39f-409a-8bc3-76f0d6e9bd78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff1d6c119e8442209714f0a046aab35c)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:19.738077 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98930a72-c39f-409a-8bc3-76f0d6e9bd78 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:19.802889 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 842/1684] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:19 2022] PUT /identity/v3/projects/1252fc2f3c104a57af1dc6cae76e1a0c/users/bfc9c96ac0c14007b7d8da83a1cb0773/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:19.804934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76141427-19c3-4d49-b3af-9e395897c3ce None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:19.805452 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76141427-19c3-4d49-b3af-9e395897c3ce None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:19.806159 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76141427-19c3-4d49-b3af-9e395897c3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:19.849873 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-76141427-19c3-4d49-b3af-9e395897c3ce None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:19.852096 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-76141427-19c3-4d49-b3af-9e395897c3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:19.969944 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 843/1685] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:19.972848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2252c-438d-47c6-995d-3728d43e1404 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:19.973139 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2252c-438d-47c6-995d-3728d43e1404 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:19.973473 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2252c-438d-47c6-995d-3728d43e1404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:19.989233 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-98930a72-c39f-409a-8bc3-76f0d6e9bd78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff1d6c119e8442209714f0a046aab35c'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:19.991038 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-98930a72-c39f-409a-8bc3-76f0d6e9bd78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff1d6c119e8442209714f0a046aab35c'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:19.993369 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-98930a72-c39f-409a-8bc3-76f0d6e9bd78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff1d6c119e8442209714f0a046aab35c'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:20.013553 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-d5e2252c-438d-47c6-995d-3728d43e1404 None None] MFA Rules not processed for user `d7e96891e45f427db01549f082d3f808`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:20.014982 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-d5e2252c-438d-47c6-995d-3728d43e1404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:20.023017 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-98930a72-c39f-409a-8bc3-76f0d6e9bd78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff1d6c119e8442209714f0a046aab35c'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:20.091702 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-98930a72-c39f-409a-8bc3-76f0d6e9bd78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff1d6c119e8442209714f0a046aab35c'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:20.120422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 843/1686] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:03:19 2022] DELETE /identity/v3/users/ff1d6c119e8442209714f0a046aab35c => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:20.122223 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9197c-5d88-4a07-913a-79b8c60e42d1 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:20.124202 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9197c-5d88-4a07-913a-79b8c60e42d1 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:20.124953 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9197c-5d88-4a07-913a-79b8c60e42d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:20.193546 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-55b9197c-5d88-4a07-913a-79b8c60e42d1 None None] MFA Rules not processed for user `85a094c88a2144e9a73b320f45987b70`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:20.193802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-55b9197c-5d88-4a07-913a-79b8c60e42d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:20.224615 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 844/1687] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:20.225374 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2252c-438d-47c6-995d-3728d43e1404 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:20.227559 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-d5e2252c-438d-47c6-995d-3728d43e1404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:20.327676 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 844/1688] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:20.330162 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9197c-5d88-4a07-913a-79b8c60e42d1 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:20.340837 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-55b9197c-5d88-4a07-913a-79b8c60e42d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:20.380254 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2252c-438d-47c6-995d-3728d43e1404 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:20.452450 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71917f6-51b7-4488-ac39-d9493ffa3c8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:20.453351 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71917f6-51b7-4488-ac39-d9493ffa3c8f service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:20.453725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71917f6-51b7-4488-ac39-d9493ffa3c8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:20.454103 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71917f6-51b7-4488-ac39-d9493ffa3c8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:20.457592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-a71917f6-51b7-4488-ac39-d9493ffa3c8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:20.469453 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71917f6-51b7-4488-ac39-d9493ffa3c8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:20.470819 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9197c-5d88-4a07-913a-79b8c60e42d1 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:20.473917 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71917f6-51b7-4488-ac39-d9493ffa3c8f service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:20.489408 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 845/1689] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:20.489761 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f3861-0361-48b6-ac81-9b5fb2f261dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:20.490554 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f3861-0361-48b6-ac81-9b5fb2f261dc admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:20.490676 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71917f6-51b7-4488-ac39-d9493ffa3c8f service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:20.490836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f3861-0361-48b6-ac81-9b5fb2f261dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:20.491089 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f3861-0361-48b6-ac81-9b5fb2f261dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:20.491755 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f3861-0361-48b6-ac81-9b5fb2f261dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:20.492502 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-a71917f6-51b7-4488-ac39-d9493ffa3c8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:20.493481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f3861-0361-48b6-ac81-9b5fb2f261dc admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:20.514747 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71917f6-51b7-4488-ac39-d9493ffa3c8f service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:20.520192 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dd291-c713-48f2-b525-751d0ef5c571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:20.521070 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dd291-c713-48f2-b525-751d0ef5c571 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:20.521547 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dd291-c713-48f2-b525-751d0ef5c571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:20.521926 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dd291-c713-48f2-b525-751d0ef5c571 admin admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:20.522833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5dd291-c713-48f2-b525-751d0ef5c571 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:03:20.523259 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5dd291-c713-48f2-b525-751d0ef5c571 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:20.525376 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5dd291-c713-48f2-b525-751d0ef5c571 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:20.533373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 845/1690] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:20.559564 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ca8b8-1455-4279-ba53-72d1d618f58c None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:20.559853 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ca8b8-1455-4279-ba53-72d1d618f58c None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:20.560173 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ca8b8-1455-4279-ba53-72d1d618f58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:20.575817 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 846/1691] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:03:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:03:20.582603 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dd291-c713-48f2-b525-751d0ef5c571 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:20.582603 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-9a5dd291-c713-48f2-b525-751d0ef5c571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:20.652282 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-745ca8b8-1455-4279-ba53-72d1d618f58c None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:20.657314 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-745ca8b8-1455-4279-ba53-72d1d618f58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:20.692831 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 846/1692] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:20.698009 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6c413-fe3d-427e-8e9b-50c7ce81c42e None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:20.698310 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6c413-fe3d-427e-8e9b-50c7ce81c42e None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:20.698616 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6c413-fe3d-427e-8e9b-50c7ce81c42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:20.775164 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-68e6c413-fe3d-427e-8e9b-50c7ce81c42e None None] MFA Rules not processed for user `85a094c88a2144e9a73b320f45987b70`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:20.780016 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-68e6c413-fe3d-427e-8e9b-50c7ce81c42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:20.780178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dd291-c713-48f2-b525-751d0ef5c571 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:20.799575 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 847/1693] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:20.806340 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6c413-fe3d-427e-8e9b-50c7ce81c42e None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:20.809193 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4f742-7b93-45dc-8725-e61f356ea419 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:20.809949 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4f742-7b93-45dc-8725-e61f356ea419 service nova] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:20.811680 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4f742-7b93-45dc-8725-e61f356ea419 service nova] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:20.811986 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4f742-7b93-45dc-8725-e61f356ea419 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:20.832472 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6c413-fe3d-427e-8e9b-50c7ce81c42e None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:20.860415 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64767e-6f5d-4091-984a-18d87701ca88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:20.861302 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64767e-6f5d-4091-984a-18d87701ca88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:20.861874 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64767e-6f5d-4091-984a-18d87701ca88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:20.862552 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64767e-6f5d-4091-984a-18d87701ca88 admin admin] PATH_INFO: `/v3/projects/1252fc2f3c104a57af1dc6cae76e1a0c/users/bfc9c96ac0c14007b7d8da83a1cb0773/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:20.881831 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64767e-6f5d-4091-984a-18d87701ca88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1252fc2f3c104a57af1dc6cae76e1a0c, user_id=bfc9c96ac0c14007b7d8da83a1cb0773, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:20.891036 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64767e-6f5d-4091-984a-18d87701ca88 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:20.911692 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 848/1694] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:20 2022] PUT /identity/v3/projects/1252fc2f3c104a57af1dc6cae76e1a0c/users/bfc9c96ac0c14007b7d8da83a1cb0773/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:20.914053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64767e-6f5d-4091-984a-18d87701ca88 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:20.968219 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4f742-7b93-45dc-8725-e61f356ea419 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:20.970779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4f742-7b93-45dc-8725-e61f356ea419 service nova] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:20.996361 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 847/1695] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:20.998433 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4f742-7b93-45dc-8725-e61f356ea419 service nova] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:21.005850 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:21.008735 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e1d4f742-7b93-45dc-8725-e61f356ea419 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:21.041594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4f742-7b93-45dc-8725-e61f356ea419 service nova] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:21.067081 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64767e-6f5d-4091-984a-18d87701ca88 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:21.104973 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90990c53-5dfe-477d-aefc-2dea82b85e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:21.119088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90990c53-5dfe-477d-aefc-2dea82b85e1c admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:21.119443 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90990c53-5dfe-477d-aefc-2dea82b85e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:21.120962 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90990c53-5dfe-477d-aefc-2dea82b85e1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:21.121726 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90990c53-5dfe-477d-aefc-2dea82b85e1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:21.134603 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90990c53-5dfe-477d-aefc-2dea82b85e1c admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:21.210849 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945c486-d9a8-4d43-b7be-91aeda72699c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:21.215412 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945c486-d9a8-4d43-b7be-91aeda72699c service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:21.215874 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945c486-d9a8-4d43-b7be-91aeda72699c service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:21.216166 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945c486-d9a8-4d43-b7be-91aeda72699c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:21.233347 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945c486-d9a8-4d43-b7be-91aeda72699c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:21.238594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945c486-d9a8-4d43-b7be-91aeda72699c service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:21.264707 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 848/1696] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:21.267658 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945c486-d9a8-4d43-b7be-91aeda72699c service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:21.302737 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 849/1697] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:03:20 2022] POST /identity/v3/projects => generated 375 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:21.307545 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90990c53-5dfe-477d-aefc-2dea82b85e1c admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:21.444498 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90990c53-5dfe-477d-aefc-2dea82b85e1c admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:21.454231 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9369da-00a2-4f85-bb39-e1fe056837db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:21.455556 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9369da-00a2-4f85-bb39-e1fe056837db admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:21.455922 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9369da-00a2-4f85-bb39-e1fe056837db admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:21.456200 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9369da-00a2-4f85-bb39-e1fe056837db admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:21.456873 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9369da-00a2-4f85-bb39-e1fe056837db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:21.461631 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9369da-00a2-4f85-bb39-e1fe056837db admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:21.505573 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945c486-d9a8-4d43-b7be-91aeda72699c service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:21.628120 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 850/1698] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:03:21 2022] POST /identity/v3/users => generated 288 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:03:21.633269 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9369da-00a2-4f85-bb39-e1fe056837db admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:21.673862 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9369da-00a2-4f85-bb39-e1fe056837db admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:21.684779 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045daf8a-68dd-4a86-85b8-ffda99db1be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:21.686358 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045daf8a-68dd-4a86-85b8-ffda99db1be9 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:21.686790 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045daf8a-68dd-4a86-85b8-ffda99db1be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:21.687227 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045daf8a-68dd-4a86-85b8-ffda99db1be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:21.688162 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045daf8a-68dd-4a86-85b8-ffda99db1be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:21.691593 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045daf8a-68dd-4a86-85b8-ffda99db1be9 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:21.706245 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de28e1-c0a6-4ae0-80e9-315d79ae6c5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:21.708829 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de28e1-c0a6-4ae0-80e9-315d79ae6c5f service nova] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:21.711052 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de28e1-c0a6-4ae0-80e9-315d79ae6c5f service nova] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:21.711052 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de28e1-c0a6-4ae0-80e9-315d79ae6c5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:21.712986 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 851/1699] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:21.715330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a74a34-2b0d-4712-9ca4-bd42f8d5818c None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:21.715873 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a74a34-2b0d-4712-9ca4-bd42f8d5818c None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:21.716326 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a74a34-2b0d-4712-9ca4-bd42f8d5818c None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:21.719154 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 852/1700] 10.222.0.64 () {54 vars in 961 bytes} [Wed Aug 24 16:03:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:03:21.720258 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a74a34-2b0d-4712-9ca4-bd42f8d5818c None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:21.768563 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a74a34-2b0d-4712-9ca4-bd42f8d5818c None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:21.784411 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f0a63-56d5-41d4-b049-c7e422b6e355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:21.785076 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f0a63-56d5-41d4-b049-c7e422b6e355 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:21.785360 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f0a63-56d5-41d4-b049-c7e422b6e355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:21.785640 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f0a63-56d5-41d4-b049-c7e422b6e355 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:21.786319 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f0a63-56d5-41d4-b049-c7e422b6e355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:21.789836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f0a63-56d5-41d4-b049-c7e422b6e355 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:21.831373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 853/1701] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:21.839073 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fb0e1-a8e3-4a5e-9b62-801e0b17d391 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:21.839375 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fb0e1-a8e3-4a5e-9b62-801e0b17d391 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:21.839659 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fb0e1-a8e3-4a5e-9b62-801e0b17d391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:21.883426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de28e1-c0a6-4ae0-80e9-315d79ae6c5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:21.883426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de28e1-c0a6-4ae0-80e9-315d79ae6c5f service nova] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:21.895269 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-c73fb0e1-a8e3-4a5e-9b62-801e0b17d391 None None] MFA Rules not processed for user `4f6907dfd3254d3c97d07ca2fb648858`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:21.896704 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-c73fb0e1-a8e3-4a5e-9b62-801e0b17d391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:21.914219 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 849/1702] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:21.921094 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de28e1-c0a6-4ae0-80e9-315d79ae6c5f service nova] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:21.945362 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de28e1-c0a6-4ae0-80e9-315d79ae6c5f service nova] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:21.965614 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257911b9-c7b2-479f-86c5-17a9e14e783d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:21.966541 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257911b9-c7b2-479f-86c5-17a9e14e783d admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:21.968265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257911b9-c7b2-479f-86c5-17a9e14e783d admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:21.968820 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257911b9-c7b2-479f-86c5-17a9e14e783d admin admin] PATH_INFO: `/v3/projects/16dcbe6d87c4401ca02a4790f1c79d14/users/b0fd7aed263849459d0fdb7494352097/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:22.046095 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257911b9-c7b2-479f-86c5-17a9e14e783d admin admin] RBAC: Authorizing `identity:create_grant(project_id=16dcbe6d87c4401ca02a4790f1c79d14, user_id=b0fd7aed263849459d0fdb7494352097, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:22.061013 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257911b9-c7b2-479f-86c5-17a9e14e783d admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:22.136772 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 854/1703] 10.222.0.64 () {58 vars in 1058 bytes} [Wed Aug 24 16:03:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:22.142968 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b4487-c283-4908-ba48-1a01c89b59f1 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:22.143571 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b4487-c283-4908-ba48-1a01c89b59f1 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:22.146741 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b4487-c283-4908-ba48-1a01c89b59f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:22.153157 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 850/1704] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:21 2022] PUT /identity/v3/projects/16dcbe6d87c4401ca02a4790f1c79d14/users/b0fd7aed263849459d0fdb7494352097/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:22.158142 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257911b9-c7b2-479f-86c5-17a9e14e783d admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:22.188755 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-b63b4487-c283-4908-ba48-1a01c89b59f1 None None] MFA Rules not processed for user `c640f4b512f748669f75f297f5bf8df9`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:22.192468 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-b63b4487-c283-4908-ba48-1a01c89b59f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:22.316572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 855/1705] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:22.316572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dcbfdb-9afc-418f-8b02-9b038050269f None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:22.316572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dcbfdb-9afc-418f-8b02-9b038050269f None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:22.328822 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dcbfdb-9afc-418f-8b02-9b038050269f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:22.368180 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257911b9-c7b2-479f-86c5-17a9e14e783d admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:22.374426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd939cbd-ebed-471a-9b53-43bfa2275083 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6907dfd3254d3c97d07ca2fb648858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:22.389527 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd939cbd-ebed-471a-9b53-43bfa2275083 service placement] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:22.389821 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd939cbd-ebed-471a-9b53-43bfa2275083 service placement] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:22.390096 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd939cbd-ebed-471a-9b53-43bfa2275083 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:22.395928 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-cd939cbd-ebed-471a-9b53-43bfa2275083 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:22.411456 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-24dcbfdb-9afc-418f-8b02-9b038050269f None None] MFA Rules not processed for user `b0fd7aed263849459d0fdb7494352097`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:22.413383 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-24dcbfdb-9afc-418f-8b02-9b038050269f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:22.422849 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd939cbd-ebed-471a-9b53-43bfa2275083 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:22.424863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd939cbd-ebed-471a-9b53-43bfa2275083 service placement] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:22.452965 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 851/1706] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:22.554426 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 856/1707] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:22.606833 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:23.311865 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02503b15-0e47-4599-8cd3-26bdccb11605 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:23.312470 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02503b15-0e47-4599-8cd3-26bdccb11605 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:23.312470 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02503b15-0e47-4599-8cd3-26bdccb11605 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:23.317288 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 852/1708] 10.222.0.64 () {54 vars in 912 bytes} [Wed Aug 24 16:03:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:03:23.321486 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02503b15-0e47-4599-8cd3-26bdccb11605 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:23.321753 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b91843-73d4-4835-918b-78244fcf6f3f None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:23.322197 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b91843-73d4-4835-918b-78244fcf6f3f None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:23.322959 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b91843-73d4-4835-918b-78244fcf6f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:23.323265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-02503b15-0e47-4599-8cd3-26bdccb11605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:23.328658 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:23.374409 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-41b91843-73d4-4835-918b-78244fcf6f3f None None] MFA Rules not processed for user `80f7e6f1af76404096d4c717cbcf20f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:23.380745 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-41b91843-73d4-4835-918b-78244fcf6f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:23.494364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02503b15-0e47-4599-8cd3-26bdccb11605 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:23.513605 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1c54a-10cd-4751-80bc-37301a98105b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:23.514412 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1c54a-10cd-4751-80bc-37301a98105b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:23.514701 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1c54a-10cd-4751-80bc-37301a98105b admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:23.515028 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1c54a-10cd-4751-80bc-37301a98105b admin admin] PATH_INFO: `/v3/projects/fa4108a2d93f41a499fdb418a401fcc6` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:23.516601 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1c54a-10cd-4751-80bc-37301a98105b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa4108a2d93f41a499fdb418a401fcc6)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:23.522780 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1c54a-10cd-4751-80bc-37301a98105b admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:23.573292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 857/1709] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 24 16:03:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:23.600996 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b91843-73d4-4835-918b-78244fcf6f3f None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:23.614366 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b91843-73d4-4835-918b-78244fcf6f3f None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:23.621607 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccdf85b-8e80-4ed7-ae66-f01c294db890 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:23.622277 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdf85b-8e80-4ed7-ae66-f01c294db890 service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:23.622738 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdf85b-8e80-4ed7-ae66-f01c294db890 service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:23.623148 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdf85b-8e80-4ed7-ae66-f01c294db890 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:23.646799 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccdf85b-8e80-4ed7-ae66-f01c294db890 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:23.646799 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccdf85b-8e80-4ed7-ae66-f01c294db890 service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:23.669845 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 858/1710] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:03:23.797751 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-92f1c54a-10cd-4751-80bc-37301a98105b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa4108a2d93f41a499fdb418a401fcc6', 'request_id': 'req-92f1c54a-10cd-4751-80bc-37301a98105b'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:23.822681 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-92f1c54a-10cd-4751-80bc-37301a98105b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa4108a2d93f41a499fdb418a401fcc6', 'request_id': 'req-92f1c54a-10cd-4751-80bc-37301a98105b'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:23.862740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-92f1c54a-10cd-4751-80bc-37301a98105b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa4108a2d93f41a499fdb418a401fcc6', 'request_id': 'req-92f1c54a-10cd-4751-80bc-37301a98105b'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:23.948747 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccdf85b-8e80-4ed7-ae66-f01c294db890 service neutron] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:23.951867 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-3ccdf85b-8e80-4ed7-ae66-f01c294db890 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:23.956860 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-92f1c54a-10cd-4751-80bc-37301a98105b admin admin] The token cache is being invalidate because project fa4108a2d93f41a499fdb418a401fcc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:03:23.959197 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-92f1c54a-10cd-4751-80bc-37301a98105b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:23.959197 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-92f1c54a-10cd-4751-80bc-37301a98105b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:23.961229 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 853/1711] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:03:23 2022] DELETE /identity/v3/projects/fa4108a2d93f41a499fdb418a401fcc6 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:03:23.968827 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdb4b4-f034-4535-878a-cec1219a7df1 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:23.969453 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdb4b4-f034-4535-878a-cec1219a7df1 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:23.969793 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdb4b4-f034-4535-878a-cec1219a7df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:23.984212 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccdf85b-8e80-4ed7-ae66-f01c294db890 service neutron] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:24.006126 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-67bdb4b4-f034-4535-878a-cec1219a7df1 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:24.009080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-67bdb4b4-f034-4535-878a-cec1219a7df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:24.194133 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db9f54-3a6e-456c-8ec6-6b56d5c8b542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:24.199189 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db9f54-3a6e-456c-8ec6-6b56d5c8b542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:24.199542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db9f54-3a6e-456c-8ec6-6b56d5c8b542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:24.199831 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db9f54-3a6e-456c-8ec6-6b56d5c8b542 admin admin] PATH_INFO: `/v3/users/eab3f668423e48df94a30cedc247f2dd` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:24.208301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db9f54-3a6e-456c-8ec6-6b56d5c8b542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eab3f668423e48df94a30cedc247f2dd)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:24.210037 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db9f54-3a6e-456c-8ec6-6b56d5c8b542 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:24.218226 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 854/1712] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:24.227986 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697c8cf-dcc6-4e35-9a4f-924e2cb7b9eb None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:24.228263 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697c8cf-dcc6-4e35-9a4f-924e2cb7b9eb None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:24.228543 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697c8cf-dcc6-4e35-9a4f-924e2cb7b9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:24.274729 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-8697c8cf-dcc6-4e35-9a4f-924e2cb7b9eb None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:24.275987 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-8697c8cf-dcc6-4e35-9a4f-924e2cb7b9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:24.314115 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 855/1713] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:03:24.315625 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2059c-b70c-4e67-856c-b7c2db09dad3 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:24.315894 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2059c-b70c-4e67-856c-b7c2db09dad3 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:24.316312 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2059c-b70c-4e67-856c-b7c2db09dad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:24.326839 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:24.403740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-acf2059c-b70c-4e67-856c-b7c2db09dad3 None None] MFA Rules not processed for user `bfc9c96ac0c14007b7d8da83a1cb0773`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:24.405339 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-acf2059c-b70c-4e67-856c-b7c2db09dad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:24.524718 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 856/1714] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:24 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:24.524718 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2059c-b70c-4e67-856c-b7c2db09dad3 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:24.581166 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-63db9f54-3a6e-456c-8ec6-6b56d5c8b542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eab3f668423e48df94a30cedc247f2dd'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:24.582181 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-63db9f54-3a6e-456c-8ec6-6b56d5c8b542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eab3f668423e48df94a30cedc247f2dd'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:24.583453 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-63db9f54-3a6e-456c-8ec6-6b56d5c8b542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eab3f668423e48df94a30cedc247f2dd'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:24.592405 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2059c-b70c-4e67-856c-b7c2db09dad3 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:24.604110 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-63db9f54-3a6e-456c-8ec6-6b56d5c8b542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eab3f668423e48df94a30cedc247f2dd'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:24.629678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6252b9-6390-48ad-a740-c21e6f431cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:24.632332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6252b9-6390-48ad-a740-c21e6f431cdd admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:24.632332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6252b9-6390-48ad-a740-c21e6f431cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:24.632332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6252b9-6390-48ad-a740-c21e6f431cdd admin admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:24.632332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6252b9-6390-48ad-a740-c21e6f431cdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:03:24.632332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6252b9-6390-48ad-a740-c21e6f431cdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:24.643129 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6252b9-6390-48ad-a740-c21e6f431cdd admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:24.697831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 857/1715] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:03:24.697831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6252b9-6390-48ad-a740-c21e6f431cdd admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:24.698645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-0d6252b9-6390-48ad-a740-c21e6f431cdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:24.770210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-63db9f54-3a6e-456c-8ec6-6b56d5c8b542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eab3f668423e48df94a30cedc247f2dd'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:24.812180 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 859/1716] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:03:23 2022] DELETE /identity/v3/users/eab3f668423e48df94a30cedc247f2dd => generated 0 bytes in 864 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:24.820311 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db9f54-3a6e-456c-8ec6-6b56d5c8b542 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:24.828019 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-63db9f54-3a6e-456c-8ec6-6b56d5c8b542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:24.925144 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6252b9-6390-48ad-a740-c21e6f431cdd admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:25.112849 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db9f54-3a6e-456c-8ec6-6b56d5c8b542 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:25.123643 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e0100-3a40-42ac-95fa-06996d2909e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:25.124725 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e0100-3a40-42ac-95fa-06996d2909e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:25.125168 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e0100-3a40-42ac-95fa-06996d2909e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:25.125770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e0100-3a40-42ac-95fa-06996d2909e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:25.126798 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e0100-3a40-42ac-95fa-06996d2909e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:25.144282 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e0100-3a40-42ac-95fa-06996d2909e7 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:25.188529 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f94c83-30b3-409a-97fe-11f136b8bd6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:25.194974 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f94c83-30b3-409a-97fe-11f136b8bd6e service nova] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:25.194974 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f94c83-30b3-409a-97fe-11f136b8bd6e service nova] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:25.194974 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f94c83-30b3-409a-97fe-11f136b8bd6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:25.196919 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-b4f94c83-30b3-409a-97fe-11f136b8bd6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:25.304989 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 860/1717] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:03:24 2022] POST /identity/v3/projects => generated 377 bytes in 492 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:25.306658 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad4fb6-1c3d-4829-8f23-3b2b4fbdb903 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:25.307113 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad4fb6-1c3d-4829-8f23-3b2b4fbdb903 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:25.307618 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad4fb6-1c3d-4829-8f23-3b2b4fbdb903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:25.343476 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-93ad4fb6-1c3d-4829-8f23-3b2b4fbdb903 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:25.345853 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-93ad4fb6-1c3d-4829-8f23-3b2b4fbdb903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:25.363387 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f94c83-30b3-409a-97fe-11f136b8bd6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:25.365053 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f94c83-30b3-409a-97fe-11f136b8bd6e service nova] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:25.449273 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 858/1718] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 753 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:25.457641 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f94c83-30b3-409a-97fe-11f136b8bd6e service nova] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:25.476811 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f94c83-30b3-409a-97fe-11f136b8bd6e service nova] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:25.566682 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 861/1719] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:25.591306 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:25.636127 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae2b04-f318-4b98-bdc0-06dacf0f6b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:25.637486 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae2b04-f318-4b98-bdc0-06dacf0f6b38 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:25.637840 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae2b04-f318-4b98-bdc0-06dacf0f6b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:25.640309 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae2b04-f318-4b98-bdc0-06dacf0f6b38 admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:25.640309 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae2b04-f318-4b98-bdc0-06dacf0f6b38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:25.671664 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae2b04-f318-4b98-bdc0-06dacf0f6b38 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:25.791612 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad4fb6-1c3d-4829-8f23-3b2b4fbdb903 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:25.802937 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-93ad4fb6-1c3d-4829-8f23-3b2b4fbdb903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:25.838747 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 859/1720] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:03:25 2022] POST /identity/v3/users => generated 289 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:25.840137 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4cb9c-77ca-465b-a08e-54fab9e33acc None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:25.840503 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4cb9c-77ca-465b-a08e-54fab9e33acc None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:25.840865 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4cb9c-77ca-465b-a08e-54fab9e33acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:25.901077 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-85c4cb9c-77ca-465b-a08e-54fab9e33acc None None] MFA Rules not processed for user `3f9710b10a9a4746a57a29dfedf88866`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:25.902435 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-85c4cb9c-77ca-465b-a08e-54fab9e33acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:25.945384 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad4fb6-1c3d-4829-8f23-3b2b4fbdb903 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:25.950515 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d1a33-29b0-445c-bcb1-533cf934a0d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:25.951317 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d1a33-29b0-445c-bcb1-533cf934a0d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:25.951799 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d1a33-29b0-445c-bcb1-533cf934a0d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:25.952303 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d1a33-29b0-445c-bcb1-533cf934a0d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:25.965529 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d1a33-29b0-445c-bcb1-533cf934a0d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:25.967856 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d1a33-29b0-445c-bcb1-533cf934a0d3 service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:25.991958 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 862/1721] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:03:25.992609 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d1a33-29b0-445c-bcb1-533cf934a0d3 service neutron] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:26.005242 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d1a33-29b0-445c-bcb1-533cf934a0d3 service neutron] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:26.020187 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d0981-0f00-450e-b2ac-c9182d9404e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:26.020915 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d0981-0f00-450e-b2ac-c9182d9404e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:26.021277 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d0981-0f00-450e-b2ac-c9182d9404e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:26.021657 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d0981-0f00-450e-b2ac-c9182d9404e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:26.023179 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d0981-0f00-450e-b2ac-c9182d9404e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:26.025889 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d0981-0f00-450e-b2ac-c9182d9404e9 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:26.027059 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 860/1722] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:26.028381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4cb9c-77ca-465b-a08e-54fab9e33acc None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:26.030890 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-85c4cb9c-77ca-465b-a08e-54fab9e33acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:26.077312 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 863/1723] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:26.078811 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d0981-0f00-450e-b2ac-c9182d9404e9 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:26.104470 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d0981-0f00-450e-b2ac-c9182d9404e9 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:26.110753 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4cb9c-77ca-465b-a08e-54fab9e33acc None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:26.117360 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:26.125014 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d44682-40c0-41a7-aea2-1fa617907c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:26.125649 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d44682-40c0-41a7-aea2-1fa617907c93 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:26.126503 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d44682-40c0-41a7-aea2-1fa617907c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:26.126851 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d44682-40c0-41a7-aea2-1fa617907c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:26.127659 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d44682-40c0-41a7-aea2-1fa617907c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:26.134862 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfb6b5-3613-4d35-acc7-e2281a7a0182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:26.135496 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfb6b5-3613-4d35-acc7-e2281a7a0182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:26.135777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfb6b5-3613-4d35-acc7-e2281a7a0182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:26.136896 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d44682-40c0-41a7-aea2-1fa617907c93 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:26.139033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfb6b5-3613-4d35-acc7-e2281a7a0182 admin admin] PATH_INFO: `/v3/users/b0fd7aed263849459d0fdb7494352097` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:26.140023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfb6b5-3613-4d35-acc7-e2281a7a0182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0fd7aed263849459d0fdb7494352097)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:26.142235 dv-cinder-849325-3-smb devstack@keystone.service[81717]: WARNING py.warnings [None req-2fdfb6b5-3613-4d35-acc7-e2281a7a0182 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:03:26.142235 dv-cinder-849325-3-smb devstack@keystone.service[81717]: warnings.warn(msg) Aug 24 16:03:26.142235 dv-cinder-849325-3-smb devstack@keystone.service[81717]: Aug 24 16:03:26.149005 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfb6b5-3613-4d35-acc7-e2281a7a0182 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:26.167752 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 864/1724] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:26.170368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d44682-40c0-41a7-aea2-1fa617907c93 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:26.202756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d44682-40c0-41a7-aea2-1fa617907c93 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:26.217854 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983fe44-9801-4628-812f-20809b7f9de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:26.218711 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983fe44-9801-4628-812f-20809b7f9de8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:26.218998 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983fe44-9801-4628-812f-20809b7f9de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:26.219283 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983fe44-9801-4628-812f-20809b7f9de8 admin admin] PATH_INFO: `/v3/projects/5618e315b5394b8e94d58dfe8e7e7658/users/0aea1adf50f64e70a5553a10c3bfb3d8/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:26.276335 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6983fe44-9801-4628-812f-20809b7f9de8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5618e315b5394b8e94d58dfe8e7e7658, user_id=0aea1adf50f64e70a5553a10c3bfb3d8, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:26.306579 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6983fe44-9801-4628-812f-20809b7f9de8 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:26.455438 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 865/1725] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:26 2022] PUT /identity/v3/projects/5618e315b5394b8e94d58dfe8e7e7658/users/0aea1adf50f64e70a5553a10c3bfb3d8/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:03:26.467500 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4615d8b-f0ae-4b41-a3e1-4bac84665173 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:26.467816 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4615d8b-f0ae-4b41-a3e1-4bac84665173 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:26.468054 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4615d8b-f0ae-4b41-a3e1-4bac84665173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:26.503681 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-b4615d8b-f0ae-4b41-a3e1-4bac84665173 None None] MFA Rules not processed for user `0aea1adf50f64e70a5553a10c3bfb3d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:26.505017 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-b4615d8b-f0ae-4b41-a3e1-4bac84665173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:26.596329 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-2fdfb6b5-3613-4d35-acc7-e2281a7a0182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0fd7aed263849459d0fdb7494352097'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:26.597291 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-2fdfb6b5-3613-4d35-acc7-e2281a7a0182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0fd7aed263849459d0fdb7494352097'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:26.598172 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-2fdfb6b5-3613-4d35-acc7-e2281a7a0182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0fd7aed263849459d0fdb7494352097'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:26.614325 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 866/1726] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:26.621731 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4615d8b-f0ae-4b41-a3e1-4bac84665173 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:26.674368 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-2fdfb6b5-3613-4d35-acc7-e2281a7a0182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0fd7aed263849459d0fdb7494352097'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:26.694580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-2fdfb6b5-3613-4d35-acc7-e2281a7a0182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0fd7aed263849459d0fdb7494352097'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:26.703375 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4615d8b-f0ae-4b41-a3e1-4bac84665173 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:26.713547 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a998f5c-ad2f-4539-b7b3-24c7e31d4e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:26.713757 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a998f5c-ad2f-4539-b7b3-24c7e31d4e8d admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:26.713923 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a998f5c-ad2f-4539-b7b3-24c7e31d4e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:26.714308 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a998f5c-ad2f-4539-b7b3-24c7e31d4e8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:26.715098 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a998f5c-ad2f-4539-b7b3-24c7e31d4e8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:26.717490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a998f5c-ad2f-4539-b7b3-24c7e31d4e8d admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:26.747109 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 861/1727] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:03:26 2022] DELETE /identity/v3/users/b0fd7aed263849459d0fdb7494352097 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:26.748533 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e45bf-ff2b-49c1-9abe-9912fb5b2b8a None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:26.748853 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e45bf-ff2b-49c1-9abe-9912fb5b2b8a None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:26.749132 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e45bf-ff2b-49c1-9abe-9912fb5b2b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:26.772100 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-7e0e45bf-ff2b-49c1-9abe-9912fb5b2b8a None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:26.781196 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-7e0e45bf-ff2b-49c1-9abe-9912fb5b2b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:26.881215 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 867/1728] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:03:26 2022] POST /identity/v3/projects => generated 375 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:26.884105 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a998f5c-ad2f-4539-b7b3-24c7e31d4e8d admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:26.904593 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-0a998f5c-ad2f-4539-b7b3-24c7e31d4e8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:26.915693 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 862/1729] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:26.977241 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e45bf-ff2b-49c1-9abe-9912fb5b2b8a None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:26.979210 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-7e0e45bf-ff2b-49c1-9abe-9912fb5b2b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:27.075452 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a998f5c-ad2f-4539-b7b3-24c7e31d4e8d admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:27.091045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536c657-1169-4369-b3b5-649d995e3df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:27.091947 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e45bf-ff2b-49c1-9abe-9912fb5b2b8a None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:27.092335 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536c657-1169-4369-b3b5-649d995e3df0 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:27.092852 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536c657-1169-4369-b3b5-649d995e3df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:27.093330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536c657-1169-4369-b3b5-649d995e3df0 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:27.094442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536c657-1169-4369-b3b5-649d995e3df0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:27.101488 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536c657-1169-4369-b3b5-649d995e3df0 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:27.199742 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8afc2f9-8e96-495e-a0bc-cddfb8064f83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:27.200561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afc2f9-8e96-495e-a0bc-cddfb8064f83 service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:27.201051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afc2f9-8e96-495e-a0bc-cddfb8064f83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:27.201481 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afc2f9-8e96-495e-a0bc-cddfb8064f83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:27.221660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 868/1730] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:03:26 2022] POST /identity/v3/users => generated 294 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:03:27.223283 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434332b-d52a-4cfc-b192-1beec7f4cd74 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:27.223827 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434332b-d52a-4cfc-b192-1beec7f4cd74 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:27.224732 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434332b-d52a-4cfc-b192-1beec7f4cd74 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:27.226383 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 869/1731] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 24 16:03:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:03:27.234258 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434332b-d52a-4cfc-b192-1beec7f4cd74 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:27.234604 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8afc2f9-8e96-495e-a0bc-cddfb8064f83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:27.238077 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8afc2f9-8e96-495e-a0bc-cddfb8064f83 service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:27.259553 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 863/1732] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:27.263829 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434332b-d52a-4cfc-b192-1beec7f4cd74 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:27.277078 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1451e3-840c-4d8d-a1b3-85931c84a3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:27.282763 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1451e3-840c-4d8d-a1b3-85931c84a3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:27.282763 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1451e3-840c-4d8d-a1b3-85931c84a3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:27.282763 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1451e3-840c-4d8d-a1b3-85931c84a3d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:27.282763 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1451e3-840c-4d8d-a1b3-85931c84a3d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:27.282763 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1451e3-840c-4d8d-a1b3-85931c84a3d4 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:27.298860 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d61be8-1e02-4b50-8803-83f3c95d5d8b None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:27.299488 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d61be8-1e02-4b50-8803-83f3c95d5d8b None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:27.299954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d61be8-1e02-4b50-8803-83f3c95d5d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:27.302698 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 870/1733] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:27.307163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1451e3-840c-4d8d-a1b3-85931c84a3d4 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:27.327485 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1451e3-840c-4d8d-a1b3-85931c84a3d4 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:27.334267 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b1c6e-eba5-475c-9c1c-647e30937d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:27.334942 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b1c6e-eba5-475c-9c1c-647e30937d29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:27.335223 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b1c6e-eba5-475c-9c1c-647e30937d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:27.335495 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b1c6e-eba5-475c-9c1c-647e30937d29 admin admin] PATH_INFO: `/v3/projects/4d0b78c7f3ee406587bf8e7504e59e01/users/e63ad27fd1a54c96851ec953018425c0/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:27.351726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-e7d61be8-1e02-4b50-8803-83f3c95d5d8b None None] MFA Rules not processed for user `4f6907dfd3254d3c97d07ca2fb648858`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:27.351726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e7d61be8-1e02-4b50-8803-83f3c95d5d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:27.370139 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b1c6e-eba5-475c-9c1c-647e30937d29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d0b78c7f3ee406587bf8e7504e59e01, user_id=e63ad27fd1a54c96851ec953018425c0, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:27.373261 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b1c6e-eba5-475c-9c1c-647e30937d29 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:27.476672 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 864/1734] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 24 16:03:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:03:27.516271 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 871/1735] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:27 2022] PUT /identity/v3/projects/4d0b78c7f3ee406587bf8e7504e59e01/users/e63ad27fd1a54c96851ec953018425c0/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:27.522443 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d61be8-1e02-4b50-8803-83f3c95d5d8b None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:27.531614 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b1c6e-eba5-475c-9c1c-647e30937d29 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:27.535768 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-b72b1c6e-eba5-475c-9c1c-647e30937d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:27.553830 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d61be8-1e02-4b50-8803-83f3c95d5d8b None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:27.691129 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5b074-a9e3-4c01-ba89-8c4c1dcdffa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:27.691814 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5b074-a9e3-4c01-ba89-8c4c1dcdffa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:27.692247 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5b074-a9e3-4c01-ba89-8c4c1dcdffa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:27.693171 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5b074-a9e3-4c01-ba89-8c4c1dcdffa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:27.694052 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe5b074-a9e3-4c01-ba89-8c4c1dcdffa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:27.697606 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe5b074-a9e3-4c01-ba89-8c4c1dcdffa9 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:27.705952 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b1c6e-eba5-475c-9c1c-647e30937d29 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:27.718027 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 865/1736] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:27.719142 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5b074-a9e3-4c01-ba89-8c4c1dcdffa9 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:27.724942 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74728bc-df60-4aa9-bcac-e2d0a8252d08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6907dfd3254d3c97d07ca2fb648858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:27.726060 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74728bc-df60-4aa9-bcac-e2d0a8252d08 service placement] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:27.726571 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74728bc-df60-4aa9-bcac-e2d0a8252d08 service placement] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:27.727113 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74728bc-df60-4aa9-bcac-e2d0a8252d08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:27.732124 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5b074-a9e3-4c01-ba89-8c4c1dcdffa9 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:27.738686 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ebae9-737e-445b-b479-a112a00e1a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:27.740434 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ebae9-737e-445b-b479-a112a00e1a89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:27.740848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ebae9-737e-445b-b479-a112a00e1a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:27.741135 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ebae9-737e-445b-b479-a112a00e1a89 admin admin] PATH_INFO: `/v3/projects/4d0b78c7f3ee406587bf8e7504e59e01/users/e63ad27fd1a54c96851ec953018425c0/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:27.745062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ebae9-737e-445b-b479-a112a00e1a89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d0b78c7f3ee406587bf8e7504e59e01, user_id=e63ad27fd1a54c96851ec953018425c0, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:27.749439 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ebae9-737e-445b-b479-a112a00e1a89 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:27.753647 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74728bc-df60-4aa9-bcac-e2d0a8252d08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:27.756291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74728bc-df60-4aa9-bcac-e2d0a8252d08 service placement] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:27.760502 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:27.776931 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 866/1737] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:27 2022] PUT /identity/v3/projects/4d0b78c7f3ee406587bf8e7504e59e01/users/e63ad27fd1a54c96851ec953018425c0/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:27.792433 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 872/1738] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:27.805417 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926642be-1fe9-4d44-8150-2cfddea4816d None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:27.806140 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926642be-1fe9-4d44-8150-2cfddea4816d None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:27.809979 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926642be-1fe9-4d44-8150-2cfddea4816d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:27.853909 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-926642be-1fe9-4d44-8150-2cfddea4816d None None] MFA Rules not processed for user `e63ad27fd1a54c96851ec953018425c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:27.856571 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-926642be-1fe9-4d44-8150-2cfddea4816d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:27.973885 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 867/1739] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:27.989162 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74728bc-df60-4aa9-bcac-e2d0a8252d08 service placement] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:27.990936 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-b74728bc-df60-4aa9-bcac-e2d0a8252d08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:28.040032 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:28.107568 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74728bc-df60-4aa9-bcac-e2d0a8252d08 service placement] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:28.150568 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8072bb-fdde-4c15-b879-65b6d436de44 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:28.151071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8072bb-fdde-4c15-b879-65b6d436de44 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:28.151552 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8072bb-fdde-4c15-b879-65b6d436de44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:28.204925 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623eef08-b32e-4199-9f81-cd252cfe353e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:28.205991 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623eef08-b32e-4199-9f81-cd252cfe353e service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:28.206440 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623eef08-b32e-4199-9f81-cd252cfe353e service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:28.206849 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623eef08-b32e-4199-9f81-cd252cfe353e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:28.211356 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-623eef08-b32e-4199-9f81-cd252cfe353e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:28.271662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-fe8072bb-fdde-4c15-b879-65b6d436de44 None None] MFA Rules not processed for user `eaf3821dd57a4d8f9ca6385c202bb0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:28.273192 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-fe8072bb-fdde-4c15-b879-65b6d436de44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:28.372321 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623eef08-b32e-4199-9f81-cd252cfe353e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:28.376603 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623eef08-b32e-4199-9f81-cd252cfe353e service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:28.400294 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 873/1740] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:28.425621 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 868/1741] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 24 16:03:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:03:29.061439 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623eef08-b32e-4199-9f81-cd252cfe353e service cinder] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:29.063058 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-623eef08-b32e-4199-9f81-cd252cfe353e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:29.275046 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623eef08-b32e-4199-9f81-cd252cfe353e service cinder] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:29.281588 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83456ae2-64d1-4d6c-9bf2-6e68f5b62e77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a0a84e4c4e47fc930881109fc07039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:29.285930 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83456ae2-64d1-4d6c-9bf2-6e68f5b62e77 service swift] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:29.286456 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83456ae2-64d1-4d6c-9bf2-6e68f5b62e77 service swift] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:29.286946 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83456ae2-64d1-4d6c-9bf2-6e68f5b62e77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:29.297340 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83456ae2-64d1-4d6c-9bf2-6e68f5b62e77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:29.300104 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83456ae2-64d1-4d6c-9bf2-6e68f5b62e77 service swift] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:29.311238 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 874/1742] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 24 16:03:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:03:29.395160 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8072bb-fdde-4c15-b879-65b6d436de44 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:29.398934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-fe8072bb-fdde-4c15-b879-65b6d436de44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:29.676866 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8072bb-fdde-4c15-b879-65b6d436de44 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:29.709987 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc2390-c6b1-4c40-9aa7-8eba427a0a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:29.715948 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc2390-c6b1-4c40-9aa7-8eba427a0a83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:29.716251 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc2390-c6b1-4c40-9aa7-8eba427a0a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:29.716923 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc2390-c6b1-4c40-9aa7-8eba427a0a83 admin admin] PATH_INFO: `/v3/users/8b6720c127d84ec48d77c8faadf9b5e1` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:29.727840 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc2390-c6b1-4c40-9aa7-8eba427a0a83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b6720c127d84ec48d77c8faadf9b5e1)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:29.729894 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc2390-c6b1-4c40-9aa7-8eba427a0a83 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:29.995160 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:30.102753 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:30.239838 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-3bbc2390-c6b1-4c40-9aa7-8eba427a0a83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b6720c127d84ec48d77c8faadf9b5e1'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:30.244846 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83456ae2-64d1-4d6c-9bf2-6e68f5b62e77 service swift] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:30.246847 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-3bbc2390-c6b1-4c40-9aa7-8eba427a0a83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b6720c127d84ec48d77c8faadf9b5e1'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:30.248036 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-83456ae2-64d1-4d6c-9bf2-6e68f5b62e77 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:30.248719 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-3bbc2390-c6b1-4c40-9aa7-8eba427a0a83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b6720c127d84ec48d77c8faadf9b5e1'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:30.325322 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83456ae2-64d1-4d6c-9bf2-6e68f5b62e77 service swift] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:30.360719 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead0d99-f150-427d-a2fd-97e4aa8db0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:30.364947 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead0d99-f150-427d-a2fd-97e4aa8db0fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:30.369293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead0d99-f150-427d-a2fd-97e4aa8db0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:30.370469 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead0d99-f150-427d-a2fd-97e4aa8db0fb admin admin] PATH_INFO: `/v3/projects/260e4be642db451a95c1549c9860af67` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:30.375126 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead0d99-f150-427d-a2fd-97e4aa8db0fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=260e4be642db451a95c1549c9860af67)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:30.397471 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead0d99-f150-427d-a2fd-97e4aa8db0fb admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:30.506048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-3bbc2390-c6b1-4c40-9aa7-8eba427a0a83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b6720c127d84ec48d77c8faadf9b5e1'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:30.541829 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-3bbc2390-c6b1-4c40-9aa7-8eba427a0a83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b6720c127d84ec48d77c8faadf9b5e1'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:30.593619 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 869/1743] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:03:29 2022] DELETE /identity/v3/users/8b6720c127d84ec48d77c8faadf9b5e1 => generated 0 bytes in 1199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:30.787525 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-4ead0d99-f150-427d-a2fd-97e4aa8db0fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '260e4be642db451a95c1549c9860af67', 'request_id': 'req-4ead0d99-f150-427d-a2fd-97e4aa8db0fb'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:30.824189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cad1b-25c7-4632-905c-55caa8a90042 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:30.824785 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cad1b-25c7-4632-905c-55caa8a90042 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:30.825220 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cad1b-25c7-4632-905c-55caa8a90042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:30.885456 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-f95cad1b-25c7-4632-905c-55caa8a90042 None None] MFA Rules not processed for user `d7e96891e45f427db01549f082d3f808`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:30.887001 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-f95cad1b-25c7-4632-905c-55caa8a90042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:30.890777 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-4ead0d99-f150-427d-a2fd-97e4aa8db0fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '260e4be642db451a95c1549c9860af67', 'request_id': 'req-4ead0d99-f150-427d-a2fd-97e4aa8db0fb'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:30.901430 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-4ead0d99-f150-427d-a2fd-97e4aa8db0fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '260e4be642db451a95c1549c9860af67', 'request_id': 'req-4ead0d99-f150-427d-a2fd-97e4aa8db0fb'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:30.977013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-4ead0d99-f150-427d-a2fd-97e4aa8db0fb admin admin] The token cache is being invalidate because project 260e4be642db451a95c1549c9860af67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:03:30.977511 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-4ead0d99-f150-427d-a2fd-97e4aa8db0fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:30.980761 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-4ead0d99-f150-427d-a2fd-97e4aa8db0fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:30.988105 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 875/1744] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:03:30 2022] DELETE /identity/v3/projects/260e4be642db451a95c1549c9860af67 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:30.993039 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead0d99-f150-427d-a2fd-97e4aa8db0fb admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:30.995297 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-4ead0d99-f150-427d-a2fd-97e4aa8db0fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:31.079470 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 870/1745] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:03:31.204754 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead0d99-f150-427d-a2fd-97e4aa8db0fb admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:31.221394 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f0bba-f475-4245-9b60-72cc099adade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:31.222114 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f0bba-f475-4245-9b60-72cc099adade admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:31.222712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f0bba-f475-4245-9b60-72cc099adade admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:31.223043 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f0bba-f475-4245-9b60-72cc099adade admin admin] PATH_INFO: `/v3/users/f59e1e0014bb41d29375d5432311a1ad` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:31.224410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f0bba-f475-4245-9b60-72cc099adade admin admin] RBAC: Authorizing `identity:delete_user(user_id=f59e1e0014bb41d29375d5432311a1ad)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:31.226589 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f0bba-f475-4245-9b60-72cc099adade admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:31.780797 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95cad1b-25c7-4632-905c-55caa8a90042 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:31.782789 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-f95cad1b-25c7-4632-905c-55caa8a90042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:31.798173 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:31.821979 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95cad1b-25c7-4632-905c-55caa8a90042 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:31.841326 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d37f0bba-f475-4245-9b60-72cc099adade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f59e1e0014bb41d29375d5432311a1ad'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:31.841326 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d37f0bba-f475-4245-9b60-72cc099adade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f59e1e0014bb41d29375d5432311a1ad'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:31.841326 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d37f0bba-f475-4245-9b60-72cc099adade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f59e1e0014bb41d29375d5432311a1ad'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:31.857297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e37174-3800-4181-b3ee-0c48fdc3a4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:31.857671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d37f0bba-f475-4245-9b60-72cc099adade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f59e1e0014bb41d29375d5432311a1ad'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:31.857979 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e37174-3800-4181-b3ee-0c48fdc3a4e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:31.858270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e37174-3800-4181-b3ee-0c48fdc3a4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:31.858557 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e37174-3800-4181-b3ee-0c48fdc3a4e2 admin admin] PATH_INFO: `/v3/projects/16dcbe6d87c4401ca02a4790f1c79d14` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:31.883883 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e37174-3800-4181-b3ee-0c48fdc3a4e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16dcbe6d87c4401ca02a4790f1c79d14)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:31.902718 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e37174-3800-4181-b3ee-0c48fdc3a4e2 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:32.028528 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d37f0bba-f475-4245-9b60-72cc099adade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f59e1e0014bb41d29375d5432311a1ad'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:32.117908 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 876/1746] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:03:30 2022] DELETE /identity/v3/users/f59e1e0014bb41d29375d5432311a1ad => generated 0 bytes in 1126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:32.242694 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a7e37174-3800-4181-b3ee-0c48fdc3a4e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16dcbe6d87c4401ca02a4790f1c79d14', 'request_id': 'req-a7e37174-3800-4181-b3ee-0c48fdc3a4e2'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:32.249691 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae8773-0227-42b6-9edc-f0e329ca996a None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:32.250015 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae8773-0227-42b6-9edc-f0e329ca996a None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:32.250308 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae8773-0227-42b6-9edc-f0e329ca996a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:32.266513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a7e37174-3800-4181-b3ee-0c48fdc3a4e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16dcbe6d87c4401ca02a4790f1c79d14', 'request_id': 'req-a7e37174-3800-4181-b3ee-0c48fdc3a4e2'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:32.298401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a7e37174-3800-4181-b3ee-0c48fdc3a4e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16dcbe6d87c4401ca02a4790f1c79d14', 'request_id': 'req-a7e37174-3800-4181-b3ee-0c48fdc3a4e2'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:32.317115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-06ae8773-0227-42b6-9edc-f0e329ca996a None None] MFA Rules not processed for user `80f7e6f1af76404096d4c717cbcf20f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:32.318367 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-06ae8773-0227-42b6-9edc-f0e329ca996a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:32.435146 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a7e37174-3800-4181-b3ee-0c48fdc3a4e2 admin admin] The token cache is being invalidate because project 16dcbe6d87c4401ca02a4790f1c79d14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:03:32.437802 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a7e37174-3800-4181-b3ee-0c48fdc3a4e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:32.439479 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a7e37174-3800-4181-b3ee-0c48fdc3a4e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:32.442142 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 871/1747] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:03:31 2022] DELETE /identity/v3/projects/16dcbe6d87c4401ca02a4790f1c79d14 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:03:32.447372 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3849b0a-351f-4fba-a0a4-adcf37c288d8 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:32.464032 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 877/1748] 10.222.0.49 () {58 vars in 1015 bytes} [Wed Aug 24 16:03:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:32.464267 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3849b0a-351f-4fba-a0a4-adcf37c288d8 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:32.465257 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3849b0a-351f-4fba-a0a4-adcf37c288d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:32.506422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae8773-0227-42b6-9edc-f0e329ca996a None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:32.508192 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-06ae8773-0227-42b6-9edc-f0e329ca996a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:32.522574 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae8773-0227-42b6-9edc-f0e329ca996a None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:32.533757 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f972612-7c0d-4ca5-b4e7-8ffd03cb1782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:32.534398 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f972612-7c0d-4ca5-b4e7-8ffd03cb1782 service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:32.534686 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f972612-7c0d-4ca5-b4e7-8ffd03cb1782 service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:32.534972 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f972612-7c0d-4ca5-b4e7-8ffd03cb1782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:32.535085 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-f3849b0a-351f-4fba-a0a4-adcf37c288d8 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:32.540050 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-f3849b0a-351f-4fba-a0a4-adcf37c288d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:32.558962 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f972612-7c0d-4ca5-b4e7-8ffd03cb1782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:32.560721 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f972612-7c0d-4ca5-b4e7-8ffd03cb1782 service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:32.583234 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 878/1749] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:32.757692 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 872/1750] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:32.760750 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76fb83-73cb-4098-b7d1-b360e55648cb None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:32.761046 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76fb83-73cb-4098-b7d1-b360e55648cb None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:32.761394 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76fb83-73cb-4098-b7d1-b360e55648cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:32.853867 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-ad76fb83-73cb-4098-b7d1-b360e55648cb None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:32.856720 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-ad76fb83-73cb-4098-b7d1-b360e55648cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:32.915231 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 879/1751] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:32.915895 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3849b0a-351f-4fba-a0a4-adcf37c288d8 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:32.918179 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-f3849b0a-351f-4fba-a0a4-adcf37c288d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:32.930862 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76fb83-73cb-4098-b7d1-b360e55648cb None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:32.967398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3849b0a-351f-4fba-a0a4-adcf37c288d8 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:32.981359 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76fb83-73cb-4098-b7d1-b360e55648cb None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:32.994116 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f55a94-8e57-4372-8a8d-ed64211ba84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:32.996020 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f55a94-8e57-4372-8a8d-ed64211ba84b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:32.997729 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f55a94-8e57-4372-8a8d-ed64211ba84b admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:32.998181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f55a94-8e57-4372-8a8d-ed64211ba84b admin admin] PATH_INFO: `/v3/projects/45ad4ca6aad64a509d4705bd592a67bb` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:33.016075 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f55a94-8e57-4372-8a8d-ed64211ba84b admin admin] RBAC: Authorizing `identity:delete_project(project_id=45ad4ca6aad64a509d4705bd592a67bb)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:33.035368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5fb42-258a-477d-87cd-e07acb197e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:33.036121 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5fb42-258a-477d-87cd-e07acb197e73 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:33.036564 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5fb42-258a-477d-87cd-e07acb197e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:33.037108 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5fb42-258a-477d-87cd-e07acb197e73 admin admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:33.038392 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb5fb42-258a-477d-87cd-e07acb197e73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:03:33.042130 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb5fb42-258a-477d-87cd-e07acb197e73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:33.043946 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb5fb42-258a-477d-87cd-e07acb197e73 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:33.048212 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f55a94-8e57-4372-8a8d-ed64211ba84b admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:33.136210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 880/1752] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:03:33.149084 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5fb42-258a-477d-87cd-e07acb197e73 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:33.193387 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5fb42-258a-477d-87cd-e07acb197e73 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:33.217888 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900fe7d-9076-4066-95b1-64a4e60f621d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:33.218935 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900fe7d-9076-4066-95b1-64a4e60f621d admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:33.220347 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900fe7d-9076-4066-95b1-64a4e60f621d admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:33.221157 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900fe7d-9076-4066-95b1-64a4e60f621d admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:33.221988 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900fe7d-9076-4066-95b1-64a4e60f621d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:33.228446 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900fe7d-9076-4066-95b1-64a4e60f621d admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:33.233230 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:33.306606 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-e3f55a94-8e57-4372-8a8d-ed64211ba84b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45ad4ca6aad64a509d4705bd592a67bb', 'request_id': 'req-e3f55a94-8e57-4372-8a8d-ed64211ba84b'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:33.316253 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-e3f55a94-8e57-4372-8a8d-ed64211ba84b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45ad4ca6aad64a509d4705bd592a67bb', 'request_id': 'req-e3f55a94-8e57-4372-8a8d-ed64211ba84b'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:33.343514 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-e3f55a94-8e57-4372-8a8d-ed64211ba84b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45ad4ca6aad64a509d4705bd592a67bb', 'request_id': 'req-e3f55a94-8e57-4372-8a8d-ed64211ba84b'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:33.417739 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 881/1753] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:03:33 2022] POST /identity/v3/projects => generated 365 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:33.422418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900fe7d-9076-4066-95b1-64a4e60f621d admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:33.450919 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-e3f55a94-8e57-4372-8a8d-ed64211ba84b admin admin] The token cache is being invalidate because project 45ad4ca6aad64a509d4705bd592a67bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:03:33.451632 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-e3f55a94-8e57-4372-8a8d-ed64211ba84b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:33.452406 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-e3f55a94-8e57-4372-8a8d-ed64211ba84b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:33.459867 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 873/1754] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:03:32 2022] DELETE /identity/v3/projects/45ad4ca6aad64a509d4705bd592a67bb => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:03:33.464392 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f55a94-8e57-4372-8a8d-ed64211ba84b admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:33.468308 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e3f55a94-8e57-4372-8a8d-ed64211ba84b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:33.643517 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900fe7d-9076-4066-95b1-64a4e60f621d admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:33.677424 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8f8d5-8a3a-4e5e-89d0-3b530a6cd0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:33.678073 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8f8d5-8a3a-4e5e-89d0-3b530a6cd0f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:33.678352 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8f8d5-8a3a-4e5e-89d0-3b530a6cd0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:33.678633 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8f8d5-8a3a-4e5e-89d0-3b530a6cd0f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:33.679259 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff8f8d5-8a3a-4e5e-89d0-3b530a6cd0f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:33.681617 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff8f8d5-8a3a-4e5e-89d0-3b530a6cd0f0 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:33.704348 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f55a94-8e57-4372-8a8d-ed64211ba84b admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:33.721616 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6b737-8161-42c2-bde5-fe535bddd844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:33.726477 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6b737-8161-42c2-bde5-fe535bddd844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:33.728795 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6b737-8161-42c2-bde5-fe535bddd844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:33.729719 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6b737-8161-42c2-bde5-fe535bddd844 admin admin] PATH_INFO: `/v3/users/bfc9c96ac0c14007b7d8da83a1cb0773` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:33.733528 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6b737-8161-42c2-bde5-fe535bddd844 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfc9c96ac0c14007b7d8da83a1cb0773)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:33.741369 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6b737-8161-42c2-bde5-fe535bddd844 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:34.040065 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 882/1755] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:03:33 2022] POST /identity/v3/users => generated 283 bytes in 599 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:03:34.057723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8f8d5-8a3a-4e5e-89d0-3b530a6cd0f0 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:34.062401 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-cff8f8d5-8a3a-4e5e-89d0-3b530a6cd0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:34.096206 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8f8d5-8a3a-4e5e-89d0-3b530a6cd0f0 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:34.113319 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310dbfb-0058-425e-aee8-ae59ad53b3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:34.116298 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310dbfb-0058-425e-aee8-ae59ad53b3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:34.116941 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310dbfb-0058-425e-aee8-ae59ad53b3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:34.117313 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310dbfb-0058-425e-aee8-ae59ad53b3c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:34.119292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310dbfb-0058-425e-aee8-ae59ad53b3c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:34.121484 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310dbfb-0058-425e-aee8-ae59ad53b3c9 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:34.151691 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 883/1756] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:34.152847 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310dbfb-0058-425e-aee8-ae59ad53b3c9 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:34.173047 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310dbfb-0058-425e-aee8-ae59ad53b3c9 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:34.189314 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2b13e-0dd8-468e-bd2f-b25f955fb998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:34.190769 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2b13e-0dd8-468e-bd2f-b25f955fb998 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:34.190769 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2b13e-0dd8-468e-bd2f-b25f955fb998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:34.190769 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2b13e-0dd8-468e-bd2f-b25f955fb998 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:34.192317 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2b13e-0dd8-468e-bd2f-b25f955fb998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:34.195927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2b13e-0dd8-468e-bd2f-b25f955fb998 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:34.224703 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 884/1757] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:34.228653 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2b13e-0dd8-468e-bd2f-b25f955fb998 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:34.246694 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2b13e-0dd8-468e-bd2f-b25f955fb998 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:34.255450 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e1d5c-a17d-4e1b-acfa-854849ddf408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:34.259611 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e1d5c-a17d-4e1b-acfa-854849ddf408 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:34.260393 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e1d5c-a17d-4e1b-acfa-854849ddf408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:34.261460 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e1d5c-a17d-4e1b-acfa-854849ddf408 admin admin] PATH_INFO: `/v3/projects/8955e34201fe440e9e05195b2860647f/users/452c4c150eb74375a95f1d4c31ea1308/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:34.305532 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e1d5c-a17d-4e1b-acfa-854849ddf408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8955e34201fe440e9e05195b2860647f, user_id=452c4c150eb74375a95f1d4c31ea1308, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:34.309160 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e1d5c-a17d-4e1b-acfa-854849ddf408 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:34.377236 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-fbb6b737-8161-42c2-bde5-fe535bddd844 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfc9c96ac0c14007b7d8da83a1cb0773'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:34.383867 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-fbb6b737-8161-42c2-bde5-fe535bddd844 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfc9c96ac0c14007b7d8da83a1cb0773'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:34.389648 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-fbb6b737-8161-42c2-bde5-fe535bddd844 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfc9c96ac0c14007b7d8da83a1cb0773'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:34.420401 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 885/1758] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:34 2022] PUT /identity/v3/projects/8955e34201fe440e9e05195b2860647f/users/452c4c150eb74375a95f1d4c31ea1308/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:03:34.431061 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea3daf-7813-4ca0-aa6d-4459ac53fef2 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:34.431331 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea3daf-7813-4ca0-aa6d-4459ac53fef2 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:34.431604 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea3daf-7813-4ca0-aa6d-4459ac53fef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:34.527457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-80ea3daf-7813-4ca0-aa6d-4459ac53fef2 None None] MFA Rules not processed for user `452c4c150eb74375a95f1d4c31ea1308`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:34.532999 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-80ea3daf-7813-4ca0-aa6d-4459ac53fef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:34.581895 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-fbb6b737-8161-42c2-bde5-fe535bddd844 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfc9c96ac0c14007b7d8da83a1cb0773'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:34.592495 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-fbb6b737-8161-42c2-bde5-fe535bddd844 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfc9c96ac0c14007b7d8da83a1cb0773'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:34.646207 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 874/1759] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:03:33 2022] DELETE /identity/v3/users/bfc9c96ac0c14007b7d8da83a1cb0773 => generated 0 bytes in 1182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:34.648278 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6b737-8161-42c2-bde5-fe535bddd844 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:34.650550 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-fbb6b737-8161-42c2-bde5-fe535bddd844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:34.769681 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6b737-8161-42c2-bde5-fe535bddd844 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:34.778758 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c69c0-c1c6-4ebb-9ec1-2d6f4ad49cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:34.779351 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c69c0-c1c6-4ebb-9ec1-2d6f4ad49cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:34.779774 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c69c0-c1c6-4ebb-9ec1-2d6f4ad49cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:34.780051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c69c0-c1c6-4ebb-9ec1-2d6f4ad49cb7 admin admin] PATH_INFO: `/v3/projects/d6a52a8a72464145a5efa837ad4d19eb` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:34.784847 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c69c0-c1c6-4ebb-9ec1-2d6f4ad49cb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6a52a8a72464145a5efa837ad4d19eb)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:34.786265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c69c0-c1c6-4ebb-9ec1-2d6f4ad49cb7 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:34.789203 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 886/1760] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:34.790454 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea3daf-7813-4ca0-aa6d-4459ac53fef2 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:34.792912 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-80ea3daf-7813-4ca0-aa6d-4459ac53fef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:34.894922 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:34.990791 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-128c69c0-c1c6-4ebb-9ec1-2d6f4ad49cb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6a52a8a72464145a5efa837ad4d19eb', 'request_id': 'req-128c69c0-c1c6-4ebb-9ec1-2d6f4ad49cb7'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:34.998936 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-128c69c0-c1c6-4ebb-9ec1-2d6f4ad49cb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6a52a8a72464145a5efa837ad4d19eb', 'request_id': 'req-128c69c0-c1c6-4ebb-9ec1-2d6f4ad49cb7'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:35.014584 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-128c69c0-c1c6-4ebb-9ec1-2d6f4ad49cb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6a52a8a72464145a5efa837ad4d19eb', 'request_id': 'req-128c69c0-c1c6-4ebb-9ec1-2d6f4ad49cb7'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:35.016579 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea3daf-7813-4ca0-aa6d-4459ac53fef2 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:35.167112 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-128c69c0-c1c6-4ebb-9ec1-2d6f4ad49cb7 admin admin] The token cache is being invalidate because project d6a52a8a72464145a5efa837ad4d19eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:03:35.167547 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-128c69c0-c1c6-4ebb-9ec1-2d6f4ad49cb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:35.168595 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-128c69c0-c1c6-4ebb-9ec1-2d6f4ad49cb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:35.180356 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634208d0-73cc-42fb-88b6-298549c64d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:35.181140 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 875/1761] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:03:34 2022] DELETE /identity/v3/projects/d6a52a8a72464145a5efa837ad4d19eb => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:35.182091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634208d0-73cc-42fb-88b6-298549c64d7b admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:35.182592 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634208d0-73cc-42fb-88b6-298549c64d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:35.183090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634208d0-73cc-42fb-88b6-298549c64d7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:35.183845 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c69c0-c1c6-4ebb-9ec1-2d6f4ad49cb7 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:35.184198 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634208d0-73cc-42fb-88b6-298549c64d7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:35.187515 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634208d0-73cc-42fb-88b6-298549c64d7b admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:35.197914 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-128c69c0-c1c6-4ebb-9ec1-2d6f4ad49cb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:35.457509 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c69c0-c1c6-4ebb-9ec1-2d6f4ad49cb7 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:35.457509 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a2eeb-0e6a-40e6-b725-016e64df4d59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:35.457509 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a2eeb-0e6a-40e6-b725-016e64df4d59 service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:35.457509 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a2eeb-0e6a-40e6-b725-016e64df4d59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:35.460061 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a2eeb-0e6a-40e6-b725-016e64df4d59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:35.460061 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-739a2eeb-0e6a-40e6-b725-016e64df4d59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:35.466683 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a2eeb-0e6a-40e6-b725-016e64df4d59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:35.468174 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a2eeb-0e6a-40e6-b725-016e64df4d59 service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:35.491540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 876/1762] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:35 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:35.492469 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a2eeb-0e6a-40e6-b725-016e64df4d59 service cinder] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:35.498642 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-739a2eeb-0e6a-40e6-b725-016e64df4d59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:35.530603 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a2eeb-0e6a-40e6-b725-016e64df4d59 service cinder] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:35.532503 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 887/1763] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:03:34 2022] POST /identity/v3/projects => generated 365 bytes in 743 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:35.537185 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634208d0-73cc-42fb-88b6-298549c64d7b admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:35.554949 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-634208d0-73cc-42fb-88b6-298549c64d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:35.772966 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:35.876025 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8028a-ddce-4fee-912a-1d2f1f25169e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:35.882427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8028a-ddce-4fee-912a-1d2f1f25169e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:35.882806 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8028a-ddce-4fee-912a-1d2f1f25169e admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:35.894144 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8028a-ddce-4fee-912a-1d2f1f25169e admin admin] PATH_INFO: `/v3/users/27c1bb568b214651aa56d7e0ba80d668` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:35.901896 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8028a-ddce-4fee-912a-1d2f1f25169e admin admin] RBAC: Authorizing `identity:delete_user(user_id=27c1bb568b214651aa56d7e0ba80d668)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:35.921026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8028a-ddce-4fee-912a-1d2f1f25169e admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:35.989328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634208d0-73cc-42fb-88b6-298549c64d7b admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:36.023327 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc7703-c6d3-46d5-b743-17c171fa662f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:36.023961 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc7703-c6d3-46d5-b743-17c171fa662f admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:36.024240 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc7703-c6d3-46d5-b743-17c171fa662f admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:36.024532 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc7703-c6d3-46d5-b743-17c171fa662f admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:36.025264 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc7703-c6d3-46d5-b743-17c171fa662f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:36.027250 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc7703-c6d3-46d5-b743-17c171fa662f admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:36.371858 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 888/1764] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:03:35 2022] POST /identity/v3/users => generated 289 bytes in 835 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:36.373185 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc7703-c6d3-46d5-b743-17c171fa662f admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:36.385139 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-abbc7703-c6d3-46d5-b743-17c171fa662f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:36.435108 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc7703-c6d3-46d5-b743-17c171fa662f admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:36.464340 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4780727-4b45-4251-adf7-3333dbbcb755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:36.464340 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4780727-4b45-4251-adf7-3333dbbcb755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:36.464889 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4780727-4b45-4251-adf7-3333dbbcb755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:36.465183 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4780727-4b45-4251-adf7-3333dbbcb755 admin admin] PATH_INFO: `/v3/projects/1252fc2f3c104a57af1dc6cae76e1a0c` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:36.468280 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4780727-4b45-4251-adf7-3333dbbcb755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1252fc2f3c104a57af1dc6cae76e1a0c)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:36.473664 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4780727-4b45-4251-adf7-3333dbbcb755 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:36.478745 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-20e8028a-ddce-4fee-912a-1d2f1f25169e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27c1bb568b214651aa56d7e0ba80d668'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:36.479534 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-20e8028a-ddce-4fee-912a-1d2f1f25169e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27c1bb568b214651aa56d7e0ba80d668'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:36.480311 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-20e8028a-ddce-4fee-912a-1d2f1f25169e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27c1bb568b214651aa56d7e0ba80d668'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:36.581394 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-20e8028a-ddce-4fee-912a-1d2f1f25169e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27c1bb568b214651aa56d7e0ba80d668'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:36.599986 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-20e8028a-ddce-4fee-912a-1d2f1f25169e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27c1bb568b214651aa56d7e0ba80d668'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:36.637529 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 877/1765] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:03:35 2022] DELETE /identity/v3/users/27c1bb568b214651aa56d7e0ba80d668 => generated 0 bytes in 1145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:36.639482 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8028a-ddce-4fee-912a-1d2f1f25169e admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:36.643635 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-20e8028a-ddce-4fee-912a-1d2f1f25169e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:36.663065 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-e4780727-4b45-4251-adf7-3333dbbcb755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1252fc2f3c104a57af1dc6cae76e1a0c', 'request_id': 'req-e4780727-4b45-4251-adf7-3333dbbcb755'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:36.756233 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8028a-ddce-4fee-912a-1d2f1f25169e admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:36.762192 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d953e9-7638-443c-9efe-bfd834ccda53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:36.763704 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d953e9-7638-443c-9efe-bfd834ccda53 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:36.763896 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d953e9-7638-443c-9efe-bfd834ccda53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:36.764135 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d953e9-7638-443c-9efe-bfd834ccda53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:36.764969 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d953e9-7638-443c-9efe-bfd834ccda53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:36.766863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d953e9-7638-443c-9efe-bfd834ccda53 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:36.790669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-e4780727-4b45-4251-adf7-3333dbbcb755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1252fc2f3c104a57af1dc6cae76e1a0c', 'request_id': 'req-e4780727-4b45-4251-adf7-3333dbbcb755'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:36.802640 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 878/1766] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:36.802640 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524dac5-be17-42ca-acc0-41f450f7e108 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:36.802640 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524dac5-be17-42ca-acc0-41f450f7e108 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:36.802640 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524dac5-be17-42ca-acc0-41f450f7e108 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:36.803504 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 879/1767] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 24 16:03:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:03:36.812235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-e4780727-4b45-4251-adf7-3333dbbcb755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1252fc2f3c104a57af1dc6cae76e1a0c', 'request_id': 'req-e4780727-4b45-4251-adf7-3333dbbcb755'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:36.814140 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e84b5-81d9-4442-80f9-d46edfdcf102 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:36.814427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e84b5-81d9-4442-80f9-d46edfdcf102 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:36.814699 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e84b5-81d9-4442-80f9-d46edfdcf102 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:36.820375 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 880/1768] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 24 16:03:36 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:03:36.821291 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e84b5-81d9-4442-80f9-d46edfdcf102 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:36.855136 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-e4780727-4b45-4251-adf7-3333dbbcb755 admin admin] The token cache is being invalidate because project 1252fc2f3c104a57af1dc6cae76e1a0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:03:36.855490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-e4780727-4b45-4251-adf7-3333dbbcb755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:36.856422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-e4780727-4b45-4251-adf7-3333dbbcb755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:36.859433 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 889/1769] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:03:36 2022] DELETE /identity/v3/projects/1252fc2f3c104a57af1dc6cae76e1a0c => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:36.863433 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed3a7e-9d6f-46ac-b80e-97fe6d221891 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:36.863433 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed3a7e-9d6f-46ac-b80e-97fe6d221891 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:36.863433 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed3a7e-9d6f-46ac-b80e-97fe6d221891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:36.870181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e84b5-81d9-4442-80f9-d46edfdcf102 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:36.891637 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-8bed3a7e-9d6f-46ac-b80e-97fe6d221891 None None] MFA Rules not processed for user `e5f0d8fe42e74d68bfa9a0e365bab4b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:36.894289 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-8bed3a7e-9d6f-46ac-b80e-97fe6d221891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:36.897509 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984b03b-a906-4e89-ae3e-380fa0eadd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:36.898348 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984b03b-a906-4e89-ae3e-380fa0eadd55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:36.898694 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984b03b-a906-4e89-ae3e-380fa0eadd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:36.899137 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984b03b-a906-4e89-ae3e-380fa0eadd55 admin admin] PATH_INFO: `/v3/projects/ff8592605964497f983569109c8cd291/users/c4ef1784342141b0a4c22d6f64741e67/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:36.946176 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984b03b-a906-4e89-ae3e-380fa0eadd55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff8592605964497f983569109c8cd291, user_id=c4ef1784342141b0a4c22d6f64741e67, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:36.949081 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984b03b-a906-4e89-ae3e-380fa0eadd55 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:37.087757 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 881/1770] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:36 2022] PUT /identity/v3/projects/ff8592605964497f983569109c8cd291/users/c4ef1784342141b0a4c22d6f64741e67/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:37.089750 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933db2f-af35-4e8d-9ab8-dd930ffca361 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:37.090083 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933db2f-af35-4e8d-9ab8-dd930ffca361 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:37.090383 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933db2f-af35-4e8d-9ab8-dd930ffca361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:37.097066 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 890/1771] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 24 16:03:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:37.099298 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3afcf6-9a3f-4c81-abd4-99d6dd8adedc None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:37.101378 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3afcf6-9a3f-4c81-abd4-99d6dd8adedc None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:37.102183 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3afcf6-9a3f-4c81-abd4-99d6dd8adedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:37.181184 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-0933db2f-af35-4e8d-9ab8-dd930ffca361 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:37.191166 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-0933db2f-af35-4e8d-9ab8-dd930ffca361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:37.197880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-3b3afcf6-9a3f-4c81-abd4-99d6dd8adedc None None] MFA Rules not processed for user `e5f0d8fe42e74d68bfa9a0e365bab4b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:37.199256 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-3b3afcf6-9a3f-4c81-abd4-99d6dd8adedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:37.435108 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 891/1772] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 24 16:03:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:37.439109 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3afcf6-9a3f-4c81-abd4-99d6dd8adedc None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:37.440149 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 882/1773] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:37.446404 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933db2f-af35-4e8d-9ab8-dd930ffca361 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:37.448654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-0933db2f-af35-4e8d-9ab8-dd930ffca361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:37.449580 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-3b3afcf6-9a3f-4c81-abd4-99d6dd8adedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:37.493818 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933db2f-af35-4e8d-9ab8-dd930ffca361 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:37.514633 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d0cb0-9273-4636-8b58-b9225e8851bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:37.515117 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d0cb0-9273-4636-8b58-b9225e8851bb service nova] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:37.515584 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d0cb0-9273-4636-8b58-b9225e8851bb service nova] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:37.516489 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d0cb0-9273-4636-8b58-b9225e8851bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:37.517905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3afcf6-9a3f-4c81-abd4-99d6dd8adedc None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:37.527314 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065196b-032d-4bed-9949-15c33f82fe09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:37.528092 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065196b-032d-4bed-9949-15c33f82fe09 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:37.528437 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065196b-032d-4bed-9949-15c33f82fe09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:37.528726 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065196b-032d-4bed-9949-15c33f82fe09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:37.529490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065196b-032d-4bed-9949-15c33f82fe09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:37.530068 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d0cb0-9273-4636-8b58-b9225e8851bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:37.531141 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065196b-032d-4bed-9949-15c33f82fe09 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:37.533327 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d0cb0-9273-4636-8b58-b9225e8851bb service nova] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:37.567049 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 883/1775] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:37.568570 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 892/1774] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:37.569983 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065196b-032d-4bed-9949-15c33f82fe09 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:37.570560 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c3fff-1ca1-4ecb-a411-e3678e362c8a None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:37.573013 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c3fff-1ca1-4ecb-a411-e3678e362c8a None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:37.573529 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c3fff-1ca1-4ecb-a411-e3678e362c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:37.592142 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065196b-032d-4bed-9949-15c33f82fe09 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:37.608788 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0aa906-6a3f-47cf-b55d-e1d1d6ab02b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:37.609854 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0aa906-6a3f-47cf-b55d-e1d1d6ab02b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:37.610379 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0aa906-6a3f-47cf-b55d-e1d1d6ab02b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:37.610693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0aa906-6a3f-47cf-b55d-e1d1d6ab02b1 admin admin] PATH_INFO: `/v3/projects/ff8592605964497f983569109c8cd291/users/c4ef1784342141b0a4c22d6f64741e67/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:37.623374 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0aa906-6a3f-47cf-b55d-e1d1d6ab02b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff8592605964497f983569109c8cd291, user_id=c4ef1784342141b0a4c22d6f64741e67, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:37.629997 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0aa906-6a3f-47cf-b55d-e1d1d6ab02b1 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:37.635810 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-108c3fff-1ca1-4ecb-a411-e3678e362c8a None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:37.637547 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-108c3fff-1ca1-4ecb-a411-e3678e362c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:37.668784 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 884/1777] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:37.681252 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 893/1777] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:37 2022] PUT /identity/v3/projects/ff8592605964497f983569109c8cd291/users/c4ef1784342141b0a4c22d6f64741e67/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:03:37.686035 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c3fff-1ca1-4ecb-a411-e3678e362c8a None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:37.693011 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84181501-4a43-4f64-89a4-43d4a64e9374 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:37.701246 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84181501-4a43-4f64-89a4-43d4a64e9374 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:37.703777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c3fff-1ca1-4ecb-a411-e3678e362c8a None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:37.711396 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84181501-4a43-4f64-89a4-43d4a64e9374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:37.788300 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-84181501-4a43-4f64-89a4-43d4a64e9374 None None] MFA Rules not processed for user `c4ef1784342141b0a4c22d6f64741e67`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:37.795761 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-84181501-4a43-4f64-89a4-43d4a64e9374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:37.877593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea2828-9984-4152-9214-b0be32578a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:37.883673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea2828-9984-4152-9214-b0be32578a1f admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:37.883673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea2828-9984-4152-9214-b0be32578a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:37.883673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea2828-9984-4152-9214-b0be32578a1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:37.883673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea2828-9984-4152-9214-b0be32578a1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:03:37.883673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea2828-9984-4152-9214-b0be32578a1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:37.885492 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea2828-9984-4152-9214-b0be32578a1f admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:37.919398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 885/1778] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:03:37.924310 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea2828-9984-4152-9214-b0be32578a1f admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:37.952938 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea2828-9984-4152-9214-b0be32578a1f admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:37.962917 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 894/1779] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:37 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:37.970238 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b087260-743b-47fa-a748-70efef493771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:37.971143 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b087260-743b-47fa-a748-70efef493771 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:37.971676 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b087260-743b-47fa-a748-70efef493771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:37.971959 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b087260-743b-47fa-a748-70efef493771 admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:37.972658 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b087260-743b-47fa-a748-70efef493771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:37.974566 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b087260-743b-47fa-a748-70efef493771 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:37.975903 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84181501-4a43-4f64-89a4-43d4a64e9374 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:37.980420 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-84181501-4a43-4f64-89a4-43d4a64e9374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:38.155282 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84181501-4a43-4f64-89a4-43d4a64e9374 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:38.155282 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356eb28f-f7c8-4e8f-9b4b-75d34e5d084b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:38.155282 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356eb28f-f7c8-4e8f-9b4b-75d34e5d084b service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:38.155282 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356eb28f-f7c8-4e8f-9b4b-75d34e5d084b service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:38.156043 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356eb28f-f7c8-4e8f-9b4b-75d34e5d084b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:38.156043 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356eb28f-f7c8-4e8f-9b4b-75d34e5d084b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:38.156043 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356eb28f-f7c8-4e8f-9b4b-75d34e5d084b service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:38.173301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 895/1780] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:37 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:38.270418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356eb28f-f7c8-4e8f-9b4b-75d34e5d084b service cinder] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:38.332114 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 886/1781] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:03:37 2022] POST /identity/v3/projects => generated 367 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:38.336738 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b087260-743b-47fa-a748-70efef493771 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:38.425917 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356eb28f-f7c8-4e8f-9b4b-75d34e5d084b service cinder] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:38.455283 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b087260-743b-47fa-a748-70efef493771 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:38.462479 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54a071-98a6-4712-9c40-5b2c4c3ba873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:38.463200 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54a071-98a6-4712-9c40-5b2c4c3ba873 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:38.463556 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54a071-98a6-4712-9c40-5b2c4c3ba873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:38.463907 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54a071-98a6-4712-9c40-5b2c4c3ba873 admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:38.464645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54a071-98a6-4712-9c40-5b2c4c3ba873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:38.468162 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54a071-98a6-4712-9c40-5b2c4c3ba873 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:38.581995 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 887/1782] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:03:38 2022] POST /identity/v3/users => generated 284 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:38.584602 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54a071-98a6-4712-9c40-5b2c4c3ba873 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:38.596924 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54a071-98a6-4712-9c40-5b2c4c3ba873 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:38.597220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec4633-33cd-4022-87d6-1f14bbf8770a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:38.598845 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec4633-33cd-4022-87d6-1f14bbf8770a service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:38.599233 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec4633-33cd-4022-87d6-1f14bbf8770a service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:38.599528 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec4633-33cd-4022-87d6-1f14bbf8770a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:38.621599 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc545adc-f118-4fb2-a3c5-9c610f5a413f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:38.621599 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc545adc-f118-4fb2-a3c5-9c610f5a413f admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:38.621599 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc545adc-f118-4fb2-a3c5-9c610f5a413f admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:38.621599 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc545adc-f118-4fb2-a3c5-9c610f5a413f admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:38.621928 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc545adc-f118-4fb2-a3c5-9c610f5a413f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:38.621928 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc545adc-f118-4fb2-a3c5-9c610f5a413f admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:38.623695 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec4633-33cd-4022-87d6-1f14bbf8770a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:38.626957 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec4633-33cd-4022-87d6-1f14bbf8770a service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:38.645671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 896/1783] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:03:38.667055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 888/1784] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:38.676161 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec4633-33cd-4022-87d6-1f14bbf8770a service nova] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:38.704869 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec4633-33cd-4022-87d6-1f14bbf8770a service nova] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:38.721292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab9b42-0702-493f-b63f-51579e0db864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:38.722339 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab9b42-0702-493f-b63f-51579e0db864 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:38.723140 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab9b42-0702-493f-b63f-51579e0db864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:38.723582 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab9b42-0702-493f-b63f-51579e0db864 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:38.725839 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab9b42-0702-493f-b63f-51579e0db864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:38.727724 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab9b42-0702-493f-b63f-51579e0db864 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:38.749524 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:38.751724 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 897/1785] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:38.752731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc545adc-f118-4fb2-a3c5-9c610f5a413f admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:38.779791 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc545adc-f118-4fb2-a3c5-9c610f5a413f admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:38.821068 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bd0e5-bc44-4ca5-89b7-091557baaa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:38.821068 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bd0e5-bc44-4ca5-89b7-091557baaa30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:38.821068 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bd0e5-bc44-4ca5-89b7-091557baaa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:38.821068 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bd0e5-bc44-4ca5-89b7-091557baaa30 admin admin] PATH_INFO: `/v3/projects/d1b77dec6ef646d5aae2890bcdc39775/users/fbc3d06a420842308c0aaff3568f3280/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:38.821851 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bd0e5-bc44-4ca5-89b7-091557baaa30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1b77dec6ef646d5aae2890bcdc39775, user_id=fbc3d06a420842308c0aaff3568f3280, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:38.821851 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bd0e5-bc44-4ca5-89b7-091557baaa30 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:39.005627 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:39.085290 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 889/1786] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:38 2022] PUT /identity/v3/projects/d1b77dec6ef646d5aae2890bcdc39775/users/fbc3d06a420842308c0aaff3568f3280/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:39.100930 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7ffa2-0873-414d-9e9c-4b5dd448cc89 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:39.101417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7ffa2-0873-414d-9e9c-4b5dd448cc89 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:39.102499 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7ffa2-0873-414d-9e9c-4b5dd448cc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:39.170164 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-c2d7ffa2-0873-414d-9e9c-4b5dd448cc89 None None] MFA Rules not processed for user `fbc3d06a420842308c0aaff3568f3280`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:39.193328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-c2d7ffa2-0873-414d-9e9c-4b5dd448cc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:39.394035 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 898/1787] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:39.399627 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bd0e5-bc44-4ca5-89b7-091557baaa30 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:39.593120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bd0e5-bc44-4ca5-89b7-091557baaa30 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:39.593120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda3255-b788-40e8-a074-755fa002bcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:39.593120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda3255-b788-40e8-a074-755fa002bcca admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:39.593120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda3255-b788-40e8-a074-755fa002bcca admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:39.595123 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda3255-b788-40e8-a074-755fa002bcca admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:39.595123 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda3255-b788-40e8-a074-755fa002bcca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:39.595123 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda3255-b788-40e8-a074-755fa002bcca admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:39.773291 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 890/1788] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:03:39 2022] POST /identity/v3/projects => generated 367 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:39.777236 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7ffa2-0873-414d-9e9c-4b5dd448cc89 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:39.800844 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7ffa2-0873-414d-9e9c-4b5dd448cc89 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:39.925724 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624cd9e9-58ca-46bd-ae88-3d36f1a5adf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:39.926296 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624cd9e9-58ca-46bd-ae88-3d36f1a5adf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:39.926577 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624cd9e9-58ca-46bd-ae88-3d36f1a5adf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:39.926850 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624cd9e9-58ca-46bd-ae88-3d36f1a5adf4 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:39.927665 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624cd9e9-58ca-46bd-ae88-3d36f1a5adf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:39.930449 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624cd9e9-58ca-46bd-ae88-3d36f1a5adf4 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:39.972818 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda3255-b788-40e8-a074-755fa002bcca admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:39.974853 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-1cda3255-b788-40e8-a074-755fa002bcca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:40.007993 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda3255-b788-40e8-a074-755fa002bcca admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:40.019829 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b700396-efea-4cde-ad2a-84f291c667e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:40.023116 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b700396-efea-4cde-ad2a-84f291c667e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:40.023488 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b700396-efea-4cde-ad2a-84f291c667e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:40.023840 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b700396-efea-4cde-ad2a-84f291c667e6 admin admin] PATH_INFO: `/v3/projects/33b5a5b7aa394efb9374b1581b4aefd1` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:40.025944 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b700396-efea-4cde-ad2a-84f291c667e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33b5a5b7aa394efb9374b1581b4aefd1)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:40.028781 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b700396-efea-4cde-ad2a-84f291c667e6 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:40.219627 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 899/1789] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:03:39 2022] POST /identity/v3/users => generated 290 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:40.222489 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624cd9e9-58ca-46bd-ae88-3d36f1a5adf4 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:40.254989 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624cd9e9-58ca-46bd-ae88-3d36f1a5adf4 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:40.259961 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0b700396-efea-4cde-ad2a-84f291c667e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33b5a5b7aa394efb9374b1581b4aefd1', 'request_id': 'req-0b700396-efea-4cde-ad2a-84f291c667e6'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:40.269069 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0b700396-efea-4cde-ad2a-84f291c667e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33b5a5b7aa394efb9374b1581b4aefd1', 'request_id': 'req-0b700396-efea-4cde-ad2a-84f291c667e6'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:40.277725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0b700396-efea-4cde-ad2a-84f291c667e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33b5a5b7aa394efb9374b1581b4aefd1', 'request_id': 'req-0b700396-efea-4cde-ad2a-84f291c667e6'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:40.380135 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a094b32-c417-46ef-842b-66532f2f05ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:40.380982 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a094b32-c417-46ef-842b-66532f2f05ea admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:40.381437 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a094b32-c417-46ef-842b-66532f2f05ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:40.381947 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a094b32-c417-46ef-842b-66532f2f05ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:40.382603 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a094b32-c417-46ef-842b-66532f2f05ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:40.385140 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a094b32-c417-46ef-842b-66532f2f05ea admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:40.404286 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0b700396-efea-4cde-ad2a-84f291c667e6 admin admin] The token cache is being invalidate because project 33b5a5b7aa394efb9374b1581b4aefd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:03:40.404842 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0b700396-efea-4cde-ad2a-84f291c667e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:40.405660 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0b700396-efea-4cde-ad2a-84f291c667e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:40.407912 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 891/1790] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:03:39 2022] DELETE /identity/v3/projects/33b5a5b7aa394efb9374b1581b4aefd1 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:03:40.411908 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b700396-efea-4cde-ad2a-84f291c667e6 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:40.416493 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-0b700396-efea-4cde-ad2a-84f291c667e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:40.427983 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 900/1791] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:40.430304 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e71ab-ebfc-486a-b917-05a5d4407787 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:40.432152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e71ab-ebfc-486a-b917-05a5d4407787 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:40.432761 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e71ab-ebfc-486a-b917-05a5d4407787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:40.443906 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b700396-efea-4cde-ad2a-84f291c667e6 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:40.451353 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a497f-3461-4d76-94e4-699d774bd6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:40.460118 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a497f-3461-4d76-94e4-699d774bd6a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:40.460118 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a497f-3461-4d76-94e4-699d774bd6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:40.460118 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a497f-3461-4d76-94e4-699d774bd6a4 admin admin] PATH_INFO: `/v3/users/452c4c150eb74375a95f1d4c31ea1308` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:40.460118 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a497f-3461-4d76-94e4-699d774bd6a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=452c4c150eb74375a95f1d4c31ea1308)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:40.460118 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a497f-3461-4d76-94e4-699d774bd6a4 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:40.472565 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-e15e71ab-ebfc-486a-b917-05a5d4407787 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:40.474797 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-e15e71ab-ebfc-486a-b917-05a5d4407787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:40.540679 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 901/1792] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:40.544101 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e71ab-ebfc-486a-b917-05a5d4407787 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:40.548324 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-e15e71ab-ebfc-486a-b917-05a5d4407787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:40.597879 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e71ab-ebfc-486a-b917-05a5d4407787 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:40.604781 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e5053-1b5f-4c83-bb40-c4268edf4413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:40.606050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e5053-1b5f-4c83-bb40-c4268edf4413 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:40.606752 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e5053-1b5f-4c83-bb40-c4268edf4413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:40.606752 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e5053-1b5f-4c83-bb40-c4268edf4413 admin admin] PATH_INFO: `/v3/projects/da76e218f3164ad79a3ab10b929bf253/users/b08442d6ceca42d195ab0b6714898050/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:40.644361 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e5053-1b5f-4c83-bb40-c4268edf4413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da76e218f3164ad79a3ab10b929bf253, user_id=b08442d6ceca42d195ab0b6714898050, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:40.651256 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e5053-1b5f-4c83-bb40-c4268edf4413 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:40.751311 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 902/1793] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:40 2022] PUT /identity/v3/projects/da76e218f3164ad79a3ab10b929bf253/users/b08442d6ceca42d195ab0b6714898050/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:40.753015 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed185c2-7221-482a-8b57-42cf37d9dfbb None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:40.753220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed185c2-7221-482a-8b57-42cf37d9dfbb None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:40.753467 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed185c2-7221-482a-8b57-42cf37d9dfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:40.774733 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-e08a497f-3461-4d76-94e4-699d774bd6a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '452c4c150eb74375a95f1d4c31ea1308'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:40.775817 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-e08a497f-3461-4d76-94e4-699d774bd6a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '452c4c150eb74375a95f1d4c31ea1308'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:40.776534 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-e08a497f-3461-4d76-94e4-699d774bd6a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '452c4c150eb74375a95f1d4c31ea1308'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:40.789994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-0ed185c2-7221-482a-8b57-42cf37d9dfbb None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:40.803779 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-0ed185c2-7221-482a-8b57-42cf37d9dfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:40.939589 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 903/1794] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:40.943304 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed185c2-7221-482a-8b57-42cf37d9dfbb None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:40.946569 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-0ed185c2-7221-482a-8b57-42cf37d9dfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:40.965568 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed185c2-7221-482a-8b57-42cf37d9dfbb None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:40.973122 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418289db-42fa-4b69-995d-ec73c6ff0162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:40.977530 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418289db-42fa-4b69-995d-ec73c6ff0162 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:40.977855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418289db-42fa-4b69-995d-ec73c6ff0162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:40.978131 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418289db-42fa-4b69-995d-ec73c6ff0162 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:40.979006 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418289db-42fa-4b69-995d-ec73c6ff0162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:40.981059 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418289db-42fa-4b69-995d-ec73c6ff0162 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:40.996564 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 904/1795] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:41.001473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418289db-42fa-4b69-995d-ec73c6ff0162 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:41.021794 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418289db-42fa-4b69-995d-ec73c6ff0162 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:41.032753 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dcd5dc-9827-4ef4-8019-657fde61048c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:41.034551 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcd5dc-9827-4ef4-8019-657fde61048c admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:41.034804 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcd5dc-9827-4ef4-8019-657fde61048c admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:41.035078 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcd5dc-9827-4ef4-8019-657fde61048c admin admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:41.038133 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dcd5dc-9827-4ef4-8019-657fde61048c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:03:41.038315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dcd5dc-9827-4ef4-8019-657fde61048c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:41.039974 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dcd5dc-9827-4ef4-8019-657fde61048c admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:41.064710 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 905/1796] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:03:41.066593 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dcd5dc-9827-4ef4-8019-657fde61048c admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:41.103479 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dcd5dc-9827-4ef4-8019-657fde61048c admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:41.103479 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b35a05-eceb-43cf-931b-04b10878d8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:41.103479 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b35a05-eceb-43cf-931b-04b10878d8a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:41.103479 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b35a05-eceb-43cf-931b-04b10878d8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:41.103779 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b35a05-eceb-43cf-931b-04b10878d8a9 admin admin] PATH_INFO: `/v3/projects/da76e218f3164ad79a3ab10b929bf253/users/b08442d6ceca42d195ab0b6714898050/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:41.103779 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b35a05-eceb-43cf-931b-04b10878d8a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da76e218f3164ad79a3ab10b929bf253, user_id=b08442d6ceca42d195ab0b6714898050, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:41.103779 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b35a05-eceb-43cf-931b-04b10878d8a9 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:41.120670 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 906/1797] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:41 2022] PUT /identity/v3/projects/da76e218f3164ad79a3ab10b929bf253/users/b08442d6ceca42d195ab0b6714898050/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:41.120670 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b35a05-eceb-43cf-931b-04b10878d8a9 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:41.126621 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-e08a497f-3461-4d76-94e4-699d774bd6a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '452c4c150eb74375a95f1d4c31ea1308'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:41.137753 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-e08a497f-3461-4d76-94e4-699d774bd6a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '452c4c150eb74375a95f1d4c31ea1308'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:41.180390 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 892/1798] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:03:40 2022] DELETE /identity/v3/users/452c4c150eb74375a95f1d4c31ea1308 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:41.181385 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fe730-1448-4a5f-9df6-caa727cf7c38 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:41.181670 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fe730-1448-4a5f-9df6-caa727cf7c38 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:41.181943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fe730-1448-4a5f-9df6-caa727cf7c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:41.231620 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-b89fe730-1448-4a5f-9df6-caa727cf7c38 None None] MFA Rules not processed for user `b08442d6ceca42d195ab0b6714898050`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:41.233722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-b89fe730-1448-4a5f-9df6-caa727cf7c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:41.250539 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b35a05-eceb-43cf-931b-04b10878d8a9 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:41.326673 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a85170-8a6f-4116-b06b-c71a51a5a50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:41.327292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a85170-8a6f-4116-b06b-c71a51a5a50c admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:41.327568 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a85170-8a6f-4116-b06b-c71a51a5a50c admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:41.327892 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a85170-8a6f-4116-b06b-c71a51a5a50c admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:41.329054 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a85170-8a6f-4116-b06b-c71a51a5a50c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:41.330974 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a85170-8a6f-4116-b06b-c71a51a5a50c admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:41.352685 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 893/1799] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:41.352685 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9691bc-8666-4316-8179-54ec41254166 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:41.352685 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9691bc-8666-4316-8179-54ec41254166 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:41.352685 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9691bc-8666-4316-8179-54ec41254166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:41.372410 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-cb9691bc-8666-4316-8179-54ec41254166 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:41.377232 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-cb9691bc-8666-4316-8179-54ec41254166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:41.382773 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 894/1800] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:41.383679 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9691bc-8666-4316-8179-54ec41254166 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:41.385070 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-cb9691bc-8666-4316-8179-54ec41254166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:41.460118 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9691bc-8666-4316-8179-54ec41254166 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:41.469679 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc75128-c9ff-46cb-8c9e-20e5de2c4104 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:41.470539 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc75128-c9ff-46cb-8c9e-20e5de2c4104 service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:41.470819 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc75128-c9ff-46cb-8c9e-20e5de2c4104 service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:41.471302 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc75128-c9ff-46cb-8c9e-20e5de2c4104 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:41.488142 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc75128-c9ff-46cb-8c9e-20e5de2c4104 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:41.489679 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc75128-c9ff-46cb-8c9e-20e5de2c4104 service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:41.501025 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 895/1801] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:41 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:41.501939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc75128-c9ff-46cb-8c9e-20e5de2c4104 service cinder] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:41.503470 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-2fc75128-c9ff-46cb-8c9e-20e5de2c4104 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:41.590846 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc75128-c9ff-46cb-8c9e-20e5de2c4104 service cinder] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:41.595826 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce01b0c-7587-4588-b551-b146e12bd9ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:41.596353 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce01b0c-7587-4588-b551-b146e12bd9ac service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:41.596811 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce01b0c-7587-4588-b551-b146e12bd9ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:41.597303 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce01b0c-7587-4588-b551-b146e12bd9ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:41.610252 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce01b0c-7587-4588-b551-b146e12bd9ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:41.610820 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce01b0c-7587-4588-b551-b146e12bd9ac service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:41.623671 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 896/1802] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:41.720590 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 907/1803] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:03:41 2022] POST /identity/v3/projects => generated 367 bytes in 603 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:41.724391 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce01b0c-7587-4588-b551-b146e12bd9ac service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:41.736395 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce01b0c-7587-4588-b551-b146e12bd9ac service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:41.841262 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bbd1c-c353-43d0-9613-452ba406e070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:41.842653 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bbd1c-c353-43d0-9613-452ba406e070 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:41.843118 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bbd1c-c353-43d0-9613-452ba406e070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:41.845047 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bbd1c-c353-43d0-9613-452ba406e070 admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:41.846002 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2bbd1c-c353-43d0-9613-452ba406e070 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:41.848234 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2bbd1c-c353-43d0-9613-452ba406e070 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:42.103403 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 897/1804] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:03:41 2022] POST /identity/v3/users => generated 284 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:42.107788 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a85170-8a6f-4116-b06b-c71a51a5a50c admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:42.120561 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a85170-8a6f-4116-b06b-c71a51a5a50c admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:42.130011 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf62ae-c6d8-4c40-a7ac-10d6cff03d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:42.130011 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf62ae-c6d8-4c40-a7ac-10d6cff03d8f admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:42.130011 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf62ae-c6d8-4c40-a7ac-10d6cff03d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:42.130011 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf62ae-c6d8-4c40-a7ac-10d6cff03d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:42.131088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf62ae-c6d8-4c40-a7ac-10d6cff03d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:42.133495 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf62ae-c6d8-4c40-a7ac-10d6cff03d8f admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:42.155703 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 908/1805] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:42.170701 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bbd1c-c353-43d0-9613-452ba406e070 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:42.188983 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:42.191023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bbd1c-c353-43d0-9613-452ba406e070 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:42.207646 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b58f6-ed65-40e7-8efc-653dbe2ce81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:42.208422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b58f6-ed65-40e7-8efc-653dbe2ce81a admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:42.208742 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b58f6-ed65-40e7-8efc-653dbe2ce81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:42.209014 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b58f6-ed65-40e7-8efc-653dbe2ce81a admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:42.210504 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b58f6-ed65-40e7-8efc-653dbe2ce81a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:42.211858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b58f6-ed65-40e7-8efc-653dbe2ce81a admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:42.227371 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 898/1806] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:42.234500 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf62ae-c6d8-4c40-a7ac-10d6cff03d8f admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:42.252783 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:42.256740 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf62ae-c6d8-4c40-a7ac-10d6cff03d8f admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:42.261893 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d54db-0727-4e0a-8a1e-e2d72e53f634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:42.262559 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d54db-0727-4e0a-8a1e-e2d72e53f634 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:42.262874 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d54db-0727-4e0a-8a1e-e2d72e53f634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:42.263150 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d54db-0727-4e0a-8a1e-e2d72e53f634 admin admin] PATH_INFO: `/v3/projects/0ce85dbac5ef41d694efa548fe6e0841/users/ad2441c20ce9422aa09d15f740bf625e/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:42.278490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d54db-0727-4e0a-8a1e-e2d72e53f634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce85dbac5ef41d694efa548fe6e0841, user_id=ad2441c20ce9422aa09d15f740bf625e, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:42.283226 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d54db-0727-4e0a-8a1e-e2d72e53f634 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:42.398741 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b58f6-ed65-40e7-8efc-653dbe2ce81a admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:42.400504 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 909/1807] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:42 2022] PUT /identity/v3/projects/0ce85dbac5ef41d694efa548fe6e0841/users/ad2441c20ce9422aa09d15f740bf625e/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:03:42.407923 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-a84b58f6-ed65-40e7-8efc-653dbe2ce81a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:42.410539 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f544678-d980-40d5-a910-73eacc52efa4 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:42.410828 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f544678-d980-40d5-a910-73eacc52efa4 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:42.411104 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f544678-d980-40d5-a910-73eacc52efa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:42.431042 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b58f6-ed65-40e7-8efc-653dbe2ce81a admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:42.444073 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-7f544678-d980-40d5-a910-73eacc52efa4 None None] MFA Rules not processed for user `ad2441c20ce9422aa09d15f740bf625e`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:42.445370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-7f544678-d980-40d5-a910-73eacc52efa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:42.487393 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9fd48-4fcb-4461-9c39-d9d627872135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:42.488076 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9fd48-4fcb-4461-9c39-d9d627872135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:42.488359 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9fd48-4fcb-4461-9c39-d9d627872135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:42.488648 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9fd48-4fcb-4461-9c39-d9d627872135 admin admin] PATH_INFO: `/v3/projects/8955e34201fe440e9e05195b2860647f` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:42.489803 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9fd48-4fcb-4461-9c39-d9d627872135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8955e34201fe440e9e05195b2860647f)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:42.491715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9fd48-4fcb-4461-9c39-d9d627872135 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:42.519277 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 910/1808] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:42.523638 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f544678-d980-40d5-a910-73eacc52efa4 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:42.535158 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f544678-d980-40d5-a910-73eacc52efa4 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:42.540588 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4312c-cd5f-44ad-9e4e-436d18dfb733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:42.541222 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4312c-cd5f-44ad-9e4e-436d18dfb733 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:42.541500 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4312c-cd5f-44ad-9e4e-436d18dfb733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:42.541769 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4312c-cd5f-44ad-9e4e-436d18dfb733 admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:42.542386 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a4312c-cd5f-44ad-9e4e-436d18dfb733 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:42.544318 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a4312c-cd5f-44ad-9e4e-436d18dfb733 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:42.604357 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-66e9fd48-4fcb-4461-9c39-d9d627872135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8955e34201fe440e9e05195b2860647f', 'request_id': 'req-66e9fd48-4fcb-4461-9c39-d9d627872135'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:42.610508 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-66e9fd48-4fcb-4461-9c39-d9d627872135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8955e34201fe440e9e05195b2860647f', 'request_id': 'req-66e9fd48-4fcb-4461-9c39-d9d627872135'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:42.619880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-66e9fd48-4fcb-4461-9c39-d9d627872135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8955e34201fe440e9e05195b2860647f', 'request_id': 'req-66e9fd48-4fcb-4461-9c39-d9d627872135'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:42.666112 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 911/1809] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:03:42 2022] POST /identity/v3/projects => generated 367 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:03:42.671324 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4312c-cd5f-44ad-9e4e-436d18dfb733 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:42.698396 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-66e9fd48-4fcb-4461-9c39-d9d627872135 admin admin] The token cache is being invalidate because project 8955e34201fe440e9e05195b2860647f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:03:42.701771 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-66e9fd48-4fcb-4461-9c39-d9d627872135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:42.701771 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-66e9fd48-4fcb-4461-9c39-d9d627872135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:42.701771 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 899/1810] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:03:42 2022] DELETE /identity/v3/projects/8955e34201fe440e9e05195b2860647f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:42.705119 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9fd48-4fcb-4461-9c39-d9d627872135 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:42.706472 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-66e9fd48-4fcb-4461-9c39-d9d627872135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:42.732352 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4312c-cd5f-44ad-9e4e-436d18dfb733 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:42.738287 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf3402-b7dc-4d0b-bf37-9cbbf027ff24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:42.738885 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf3402-b7dc-4d0b-bf37-9cbbf027ff24 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:42.740202 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf3402-b7dc-4d0b-bf37-9cbbf027ff24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:42.740202 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf3402-b7dc-4d0b-bf37-9cbbf027ff24 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:42.740202 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf3402-b7dc-4d0b-bf37-9cbbf027ff24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:42.742044 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf3402-b7dc-4d0b-bf37-9cbbf027ff24 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:42.774426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9fd48-4fcb-4461-9c39-d9d627872135 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:42.776254 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8f378-6de1-4576-bfb1-6072bbeff33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:42.776921 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8f378-6de1-4576-bfb1-6072bbeff33c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:42.777206 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8f378-6de1-4576-bfb1-6072bbeff33c admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:42.777481 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8f378-6de1-4576-bfb1-6072bbeff33c admin admin] PATH_INFO: `/v3/users/c4ef1784342141b0a4c22d6f64741e67` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:42.778624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8f378-6de1-4576-bfb1-6072bbeff33c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4ef1784342141b0a4c22d6f64741e67)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:42.780640 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8f378-6de1-4576-bfb1-6072bbeff33c admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:42.830454 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 912/1811] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:03:42 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:03:42.835111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf3402-b7dc-4d0b-bf37-9cbbf027ff24 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:42.835943 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-21bf3402-b7dc-4d0b-bf37-9cbbf027ff24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:42.848264 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf3402-b7dc-4d0b-bf37-9cbbf027ff24 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:42.853004 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed178fe-b198-4f09-b950-b5ee7b157e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:42.853588 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed178fe-b198-4f09-b950-b5ee7b157e3d admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:42.853875 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed178fe-b198-4f09-b950-b5ee7b157e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:42.854149 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed178fe-b198-4f09-b950-b5ee7b157e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:42.854782 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed178fe-b198-4f09-b950-b5ee7b157e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:42.856350 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed178fe-b198-4f09-b950-b5ee7b157e3d admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:42.867145 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 913/1812] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:42.872327 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed178fe-b198-4f09-b950-b5ee7b157e3d admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:42.882137 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed178fe-b198-4f09-b950-b5ee7b157e3d admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:42.886925 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1e8e1-ee9c-4b49-a835-fa76fbdf49b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:42.887569 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1e8e1-ee9c-4b49-a835-fa76fbdf49b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:42.887863 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1e8e1-ee9c-4b49-a835-fa76fbdf49b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:42.888157 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1e8e1-ee9c-4b49-a835-fa76fbdf49b2 admin admin] PATH_INFO: `/v3/projects/ed0c2e24d6034215ab62fd730e64219d/users/aa87b1dd88f44d26bf688b418ca8a7a0/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:42.903902 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1e8e1-ee9c-4b49-a835-fa76fbdf49b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed0c2e24d6034215ab62fd730e64219d, user_id=aa87b1dd88f44d26bf688b418ca8a7a0, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:42.907510 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1e8e1-ee9c-4b49-a835-fa76fbdf49b2 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:43.056449 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 914/1813] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:42 2022] PUT /identity/v3/projects/ed0c2e24d6034215ab62fd730e64219d/users/aa87b1dd88f44d26bf688b418ca8a7a0/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:03:43.061297 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1e8e1-ee9c-4b49-a835-fa76fbdf49b2 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:43.063217 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c9f8f378-6de1-4576-bfb1-6072bbeff33c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4ef1784342141b0a4c22d6f64741e67'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:43.064411 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c9f8f378-6de1-4576-bfb1-6072bbeff33c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4ef1784342141b0a4c22d6f64741e67'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:43.065054 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c9f8f378-6de1-4576-bfb1-6072bbeff33c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4ef1784342141b0a4c22d6f64741e67'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:43.128846 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1e8e1-ee9c-4b49-a835-fa76fbdf49b2 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:43.133658 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e851281-ded1-4e05-af66-96c4a87494e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:43.134266 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e851281-ded1-4e05-af66-96c4a87494e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:43.134545 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e851281-ded1-4e05-af66-96c4a87494e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:43.134814 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e851281-ded1-4e05-af66-96c4a87494e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:43.135488 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e851281-ded1-4e05-af66-96c4a87494e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:43.137105 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e851281-ded1-4e05-af66-96c4a87494e8 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:43.147755 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c9f8f378-6de1-4576-bfb1-6072bbeff33c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4ef1784342141b0a4c22d6f64741e67'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:43.151657 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 915/1814] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:43.152752 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e851281-ded1-4e05-af66-96c4a87494e8 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:43.160538 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-3e851281-ded1-4e05-af66-96c4a87494e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:43.161146 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c9f8f378-6de1-4576-bfb1-6072bbeff33c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4ef1784342141b0a4c22d6f64741e67'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:43.170057 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e851281-ded1-4e05-af66-96c4a87494e8 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:43.175740 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e14e5-b3b7-44ee-a724-12bb4f410099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:43.176418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e14e5-b3b7-44ee-a724-12bb4f410099 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:43.176731 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e14e5-b3b7-44ee-a724-12bb4f410099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:43.177156 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e14e5-b3b7-44ee-a724-12bb4f410099 admin admin] PATH_INFO: `/v3/projects/ed0c2e24d6034215ab62fd730e64219d/users/aa87b1dd88f44d26bf688b418ca8a7a0/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:43.177597 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 900/1815] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:03:42 2022] DELETE /identity/v3/users/c4ef1784342141b0a4c22d6f64741e67 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:03:43.179086 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e14e5-b3b7-44ee-a724-12bb4f410099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed0c2e24d6034215ab62fd730e64219d, user_id=aa87b1dd88f44d26bf688b418ca8a7a0, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:43.181789 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e14e5-b3b7-44ee-a724-12bb4f410099 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:43.192359 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 916/1816] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:43 2022] PUT /identity/v3/projects/ed0c2e24d6034215ab62fd730e64219d/users/aa87b1dd88f44d26bf688b418ca8a7a0/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:43.204515 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187796f4-0e20-4aef-b7d2-874d2134de9a None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:43.204846 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187796f4-0e20-4aef-b7d2-874d2134de9a None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:43.205119 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187796f4-0e20-4aef-b7d2-874d2134de9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:43.238721 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-187796f4-0e20-4aef-b7d2-874d2134de9a None None] MFA Rules not processed for user `aa87b1dd88f44d26bf688b418ca8a7a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:43.239956 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-187796f4-0e20-4aef-b7d2-874d2134de9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:43.336516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 901/1817] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:43.349634 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e14e5-b3b7-44ee-a724-12bb4f410099 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:43.351464 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-844e14e5-b3b7-44ee-a724-12bb4f410099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:43.418915 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e14e5-b3b7-44ee-a724-12bb4f410099 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:43.423539 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724422aa-4a5f-4f00-a6e2-b1d88e4b38be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:43.426812 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724422aa-4a5f-4f00-a6e2-b1d88e4b38be service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:43.426812 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724422aa-4a5f-4f00-a6e2-b1d88e4b38be service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:43.426812 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724422aa-4a5f-4f00-a6e2-b1d88e4b38be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:43.434848 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724422aa-4a5f-4f00-a6e2-b1d88e4b38be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:43.436439 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724422aa-4a5f-4f00-a6e2-b1d88e4b38be service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:43.448394 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 917/1818] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:43 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:43.661017 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187796f4-0e20-4aef-b7d2-874d2134de9a None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:43.663106 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-187796f4-0e20-4aef-b7d2-874d2134de9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:43.730672 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187796f4-0e20-4aef-b7d2-874d2134de9a None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:43.735144 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ff94c-e833-49bd-b446-bc2de6243b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:43.736006 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ff94c-e833-49bd-b446-bc2de6243b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:43.736300 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ff94c-e833-49bd-b446-bc2de6243b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:43.736584 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ff94c-e833-49bd-b446-bc2de6243b01 admin admin] PATH_INFO: `/v3/projects/ff8592605964497f983569109c8cd291` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:43.737833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ff94c-e833-49bd-b446-bc2de6243b01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff8592605964497f983569109c8cd291)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:43.739724 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ff94c-e833-49bd-b446-bc2de6243b01 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:43.778704 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724422aa-4a5f-4f00-a6e2-b1d88e4b38be service cinder] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:43.788215 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724422aa-4a5f-4f00-a6e2-b1d88e4b38be service cinder] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:43.791785 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21355d-ede5-4640-8b34-c7ebaa032449 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:43.792357 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21355d-ede5-4640-8b34-c7ebaa032449 service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:43.792659 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21355d-ede5-4640-8b34-c7ebaa032449 service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:43.792929 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21355d-ede5-4640-8b34-c7ebaa032449 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:43.794627 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-ad21355d-ede5-4640-8b34-c7ebaa032449 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:43.855699 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21355d-ede5-4640-8b34-c7ebaa032449 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:43.857218 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21355d-ede5-4640-8b34-c7ebaa032449 service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:43.867295 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 918/1819] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:03:43.876438 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-405ff94c-e833-49bd-b446-bc2de6243b01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff8592605964497f983569109c8cd291', 'request_id': 'req-405ff94c-e833-49bd-b446-bc2de6243b01'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:43.882072 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-405ff94c-e833-49bd-b446-bc2de6243b01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff8592605964497f983569109c8cd291', 'request_id': 'req-405ff94c-e833-49bd-b446-bc2de6243b01'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:43.888721 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-405ff94c-e833-49bd-b446-bc2de6243b01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff8592605964497f983569109c8cd291', 'request_id': 'req-405ff94c-e833-49bd-b446-bc2de6243b01'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:43.981132 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-405ff94c-e833-49bd-b446-bc2de6243b01 admin admin] The token cache is being invalidate because project ff8592605964497f983569109c8cd291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:03:43.981764 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-405ff94c-e833-49bd-b446-bc2de6243b01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:43.982391 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-405ff94c-e833-49bd-b446-bc2de6243b01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:43.983956 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 902/1820] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:03:43 2022] DELETE /identity/v3/projects/ff8592605964497f983569109c8cd291 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:43.989358 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74b9c1-9dae-4947-82f5-4918c5175e67 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:43.989712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74b9c1-9dae-4947-82f5-4918c5175e67 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:43.990052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74b9c1-9dae-4947-82f5-4918c5175e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:44.009557 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-ce74b9c1-9dae-4947-82f5-4918c5175e67 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:44.010743 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-ce74b9c1-9dae-4947-82f5-4918c5175e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:44.074897 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 919/1821] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:44.088848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77babb-c194-4313-9d66-8f358cc46973 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:44.088848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77babb-c194-4313-9d66-8f358cc46973 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:44.088848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77babb-c194-4313-9d66-8f358cc46973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:44.112842 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-1a77babb-c194-4313-9d66-8f358cc46973 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:44.113378 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-1a77babb-c194-4313-9d66-8f358cc46973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:44.132812 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 903/1822] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:44.133364 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74b9c1-9dae-4947-82f5-4918c5175e67 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:44.143955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74b9c1-9dae-4947-82f5-4918c5175e67 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:44.149179 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052f4b9-f8f4-437a-96a4-35057b172edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:44.150015 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052f4b9-f8f4-437a-96a4-35057b172edb admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:44.150451 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052f4b9-f8f4-437a-96a4-35057b172edb admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:44.150877 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052f4b9-f8f4-437a-96a4-35057b172edb admin admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:44.151692 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052f4b9-f8f4-437a-96a4-35057b172edb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:03:44.152149 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052f4b9-f8f4-437a-96a4-35057b172edb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:44.153920 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052f4b9-f8f4-437a-96a4-35057b172edb admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:44.170477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 920/1823] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:03:44.171693 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77babb-c194-4313-9d66-8f358cc46973 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:44.182569 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77babb-c194-4313-9d66-8f358cc46973 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:44.188988 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc72d0-0578-407a-9016-40e8d9090d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:44.189619 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc72d0-0578-407a-9016-40e8d9090d6c admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:44.189902 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc72d0-0578-407a-9016-40e8d9090d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:44.190175 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc72d0-0578-407a-9016-40e8d9090d6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:44.192670 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc72d0-0578-407a-9016-40e8d9090d6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:44.192836 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc72d0-0578-407a-9016-40e8d9090d6c admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:44.306077 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052f4b9-f8f4-437a-96a4-35057b172edb admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:44.319800 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 904/1824] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:03:44 2022] POST /identity/v3/projects => generated 369 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:44.322190 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052f4b9-f8f4-437a-96a4-35057b172edb admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:44.379507 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a189467-1763-42cc-83f8-379dc097ac44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:44.380116 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a189467-1763-42cc-83f8-379dc097ac44 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:44.380397 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a189467-1763-42cc-83f8-379dc097ac44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:44.380709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a189467-1763-42cc-83f8-379dc097ac44 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:44.381336 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a189467-1763-42cc-83f8-379dc097ac44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:44.383248 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a189467-1763-42cc-83f8-379dc097ac44 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:44.488805 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 921/1825] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:03:44 2022] POST /identity/v3/users => generated 285 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:03:44.492978 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc72d0-0578-407a-9016-40e8d9090d6c admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:44.504015 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc72d0-0578-407a-9016-40e8d9090d6c admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:44.509417 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0274ef-272e-4f3e-8f57-e41635eb2ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:44.510108 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0274ef-272e-4f3e-8f57-e41635eb2ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:44.510957 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0274ef-272e-4f3e-8f57-e41635eb2ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:44.510957 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0274ef-272e-4f3e-8f57-e41635eb2ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:44.511517 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0274ef-272e-4f3e-8f57-e41635eb2ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:44.513351 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0274ef-272e-4f3e-8f57-e41635eb2ce1 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:44.538886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 905/1826] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:44.540895 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a189467-1763-42cc-83f8-379dc097ac44 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:44.559783 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a189467-1763-42cc-83f8-379dc097ac44 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:44.585331 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a623b5-34b0-41a2-8aad-e29cd314cd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:44.588259 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a623b5-34b0-41a2-8aad-e29cd314cd74 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:44.588646 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a623b5-34b0-41a2-8aad-e29cd314cd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:44.589401 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a623b5-34b0-41a2-8aad-e29cd314cd74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:44.599232 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a623b5-34b0-41a2-8aad-e29cd314cd74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:44.599960 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a623b5-34b0-41a2-8aad-e29cd314cd74 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:44.623630 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 922/1827] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:44.634346 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0274ef-272e-4f3e-8f57-e41635eb2ce1 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:44.659401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0274ef-272e-4f3e-8f57-e41635eb2ce1 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:44.672348 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff08d0c-a94d-42ef-86d8-53cec90ae820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:44.673510 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff08d0c-a94d-42ef-86d8-53cec90ae820 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:44.685315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff08d0c-a94d-42ef-86d8-53cec90ae820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:44.685315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff08d0c-a94d-42ef-86d8-53cec90ae820 admin admin] PATH_INFO: `/v3/projects/862c3f1563734d529262d3a9809ff10c/users/f46ead6870744ee5b3109f6ecda7c11c/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:44.708359 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff08d0c-a94d-42ef-86d8-53cec90ae820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=862c3f1563734d529262d3a9809ff10c, user_id=f46ead6870744ee5b3109f6ecda7c11c, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:44.715231 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff08d0c-a94d-42ef-86d8-53cec90ae820 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:44.799013 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 906/1828] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:44 2022] PUT /identity/v3/projects/862c3f1563734d529262d3a9809ff10c/users/f46ead6870744ee5b3109f6ecda7c11c/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:44.810892 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973409f-9150-403a-9e87-941f471eba42 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:44.811374 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973409f-9150-403a-9e87-941f471eba42 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:44.811813 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973409f-9150-403a-9e87-941f471eba42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:44.876824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-4973409f-9150-403a-9e87-941f471eba42 None None] MFA Rules not processed for user `f46ead6870744ee5b3109f6ecda7c11c`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:44.878468 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-4973409f-9150-403a-9e87-941f471eba42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:44.998410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 923/1829] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:45.002742 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff08d0c-a94d-42ef-86d8-53cec90ae820 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:45.086568 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff08d0c-a94d-42ef-86d8-53cec90ae820 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:45.091459 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29181c-ac2f-4f69-9027-97b1a0a5b382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:45.092386 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29181c-ac2f-4f69-9027-97b1a0a5b382 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:45.092866 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29181c-ac2f-4f69-9027-97b1a0a5b382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:45.093998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29181c-ac2f-4f69-9027-97b1a0a5b382 admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:45.094740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29181c-ac2f-4f69-9027-97b1a0a5b382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:45.097098 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29181c-ac2f-4f69-9027-97b1a0a5b382 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:45.195856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 907/1830] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:03:45 2022] POST /identity/v3/projects => generated 369 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:45.199252 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973409f-9150-403a-9e87-941f471eba42 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:45.216176 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973409f-9150-403a-9e87-941f471eba42 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:45.260155 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:45.304793 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4354c0-453c-47a7-897d-75e8245141dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:45.305527 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4354c0-453c-47a7-897d-75e8245141dd admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:45.306558 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4354c0-453c-47a7-897d-75e8245141dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:45.306558 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4354c0-453c-47a7-897d-75e8245141dd admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:45.307154 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4354c0-453c-47a7-897d-75e8245141dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:45.309240 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4354c0-453c-47a7-897d-75e8245141dd admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:45.312941 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:45.434672 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 924/1831] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:03:45 2022] POST /identity/v3/users => generated 291 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:45.438972 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29181c-ac2f-4f69-9027-97b1a0a5b382 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:45.449582 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29181c-ac2f-4f69-9027-97b1a0a5b382 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:45.456194 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35f286-c25f-4c26-ab96-28f8b518e413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:45.456989 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35f286-c25f-4c26-ab96-28f8b518e413 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:45.457518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35f286-c25f-4c26-ab96-28f8b518e413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:45.457864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35f286-c25f-4c26-ab96-28f8b518e413 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:45.458597 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f35f286-c25f-4c26-ab96-28f8b518e413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:45.460337 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f35f286-c25f-4c26-ab96-28f8b518e413 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:45.473028 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 908/1832] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:45.477371 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4354c0-453c-47a7-897d-75e8245141dd admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:45.487649 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4354c0-453c-47a7-897d-75e8245141dd admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:45.494378 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a866d0-722a-4fed-b427-67cbd9d155e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:45.494378 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a866d0-722a-4fed-b427-67cbd9d155e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:45.494378 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a866d0-722a-4fed-b427-67cbd9d155e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:45.494378 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a866d0-722a-4fed-b427-67cbd9d155e6 admin admin] PATH_INFO: `/v3/projects/579e28615af745c891d6cd8901db5185/users/83a07718b74345cabf6f2b0d55462c36/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:45.509445 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a866d0-722a-4fed-b427-67cbd9d155e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=579e28615af745c891d6cd8901db5185, user_id=83a07718b74345cabf6f2b0d55462c36, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:45.512317 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a866d0-722a-4fed-b427-67cbd9d155e6 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:45.602313 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 925/1833] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:45 2022] PUT /identity/v3/projects/579e28615af745c891d6cd8901db5185/users/83a07718b74345cabf6f2b0d55462c36/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:03:45.606291 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35f286-c25f-4c26-ab96-28f8b518e413 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:45.616793 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35f286-c25f-4c26-ab96-28f8b518e413 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:45.676743 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45b901-8689-4fed-afb2-80095c606f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:45.677404 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45b901-8689-4fed-afb2-80095c606f2f admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:45.677663 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45b901-8689-4fed-afb2-80095c606f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:45.677935 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45b901-8689-4fed-afb2-80095c606f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:45.678573 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45b901-8689-4fed-afb2-80095c606f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:45.680273 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45b901-8689-4fed-afb2-80095c606f2f admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:45.691288 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 909/1834] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:45.701228 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a866d0-722a-4fed-b427-67cbd9d155e6 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:45.713031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45b901-8689-4fed-afb2-80095c606f2f admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:45.715109 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-fe45b901-8689-4fed-afb2-80095c606f2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:45.716579 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a866d0-722a-4fed-b427-67cbd9d155e6 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:45.722877 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abfa7e-8b19-4d3c-89a7-63d2d45d9c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:45.723547 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abfa7e-8b19-4d3c-89a7-63d2d45d9c2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:45.723831 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abfa7e-8b19-4d3c-89a7-63d2d45d9c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:45.724107 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abfa7e-8b19-4d3c-89a7-63d2d45d9c2c admin admin] PATH_INFO: `/v3/projects/579e28615af745c891d6cd8901db5185/users/83a07718b74345cabf6f2b0d55462c36/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:45.726239 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69abfa7e-8b19-4d3c-89a7-63d2d45d9c2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=579e28615af745c891d6cd8901db5185, user_id=83a07718b74345cabf6f2b0d55462c36, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:45.728895 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69abfa7e-8b19-4d3c-89a7-63d2d45d9c2c admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:45.729821 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45b901-8689-4fed-afb2-80095c606f2f admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:45.735303 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c12e6-5153-4a76-bcba-326c9ee64c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:45.736375 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c12e6-5153-4a76-bcba-326c9ee64c53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:45.736503 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c12e6-5153-4a76-bcba-326c9ee64c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:45.736747 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c12e6-5153-4a76-bcba-326c9ee64c53 admin admin] PATH_INFO: `/v3/users/fbc3d06a420842308c0aaff3568f3280` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:45.737959 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c12e6-5153-4a76-bcba-326c9ee64c53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbc3d06a420842308c0aaff3568f3280)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:45.739808 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c12e6-5153-4a76-bcba-326c9ee64c53 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:45.750437 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 926/1835] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:45 2022] PUT /identity/v3/projects/579e28615af745c891d6cd8901db5185/users/83a07718b74345cabf6f2b0d55462c36/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:45.757732 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4483e62-1fe9-4af8-bd09-31bf54014183 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:45.757732 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4483e62-1fe9-4af8-bd09-31bf54014183 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:45.757732 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4483e62-1fe9-4af8-bd09-31bf54014183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:45.786346 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-f4483e62-1fe9-4af8-bd09-31bf54014183 None None] MFA Rules not processed for user `83a07718b74345cabf6f2b0d55462c36`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:45.786346 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-f4483e62-1fe9-4af8-bd09-31bf54014183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:45.856237 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 927/1836] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:45.922256 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-116c12e6-5153-4a76-bcba-326c9ee64c53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbc3d06a420842308c0aaff3568f3280'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:45.924224 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-116c12e6-5153-4a76-bcba-326c9ee64c53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbc3d06a420842308c0aaff3568f3280'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:45.924515 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-116c12e6-5153-4a76-bcba-326c9ee64c53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbc3d06a420842308c0aaff3568f3280'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:45.929151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4483e62-1fe9-4af8-bd09-31bf54014183 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:45.930573 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-f4483e62-1fe9-4af8-bd09-31bf54014183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:45.988365 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4483e62-1fe9-4af8-bd09-31bf54014183 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:45.992078 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2964e5f-2057-4135-8e40-57956532e1ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:45.992785 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2964e5f-2057-4135-8e40-57956532e1ef service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:46.000127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2964e5f-2057-4135-8e40-57956532e1ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:46.000127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2964e5f-2057-4135-8e40-57956532e1ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:46.000127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-f2964e5f-2057-4135-8e40-57956532e1ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:46.006828 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2964e5f-2057-4135-8e40-57956532e1ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:46.008243 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2964e5f-2057-4135-8e40-57956532e1ef service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:46.018122 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 928/1837] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:03:46.107367 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-116c12e6-5153-4a76-bcba-326c9ee64c53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbc3d06a420842308c0aaff3568f3280'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:46.118528 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-116c12e6-5153-4a76-bcba-326c9ee64c53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbc3d06a420842308c0aaff3568f3280'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:46.146833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 910/1838] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:03:45 2022] DELETE /identity/v3/users/fbc3d06a420842308c0aaff3568f3280 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:46.154598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff2f1b-8b0f-49f9-9424-737aa04e8022 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:46.155345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff2f1b-8b0f-49f9-9424-737aa04e8022 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:46.155657 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff2f1b-8b0f-49f9-9424-737aa04e8022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:46.158218 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c12e6-5153-4a76-bcba-326c9ee64c53 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:46.159667 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-116c12e6-5153-4a76-bcba-326c9ee64c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:46.180416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-dbff2f1b-8b0f-49f9-9424-737aa04e8022 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:46.182294 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-dbff2f1b-8b0f-49f9-9424-737aa04e8022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:46.257555 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c12e6-5153-4a76-bcba-326c9ee64c53 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:46.272331 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 929/1839] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:46.282907 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff2f1b-8b0f-49f9-9424-737aa04e8022 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:46.283512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-dbff2f1b-8b0f-49f9-9424-737aa04e8022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:46.288994 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37bd99-f4f0-46e6-a720-50534e177c85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:46.289738 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37bd99-f4f0-46e6-a720-50534e177c85 service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:46.290022 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37bd99-f4f0-46e6-a720-50534e177c85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:46.290290 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37bd99-f4f0-46e6-a720-50534e177c85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:46.292305 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-0d37bd99-f4f0-46e6-a720-50534e177c85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:46.356470 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff2f1b-8b0f-49f9-9424-737aa04e8022 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:46.360942 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319cfe6e-63df-4375-b7ed-e92ac4a187ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:46.361664 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319cfe6e-63df-4375-b7ed-e92ac4a187ef service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:46.361949 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319cfe6e-63df-4375-b7ed-e92ac4a187ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:46.362222 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319cfe6e-63df-4375-b7ed-e92ac4a187ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:46.369969 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37bd99-f4f0-46e6-a720-50534e177c85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:46.371441 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37bd99-f4f0-46e6-a720-50534e177c85 service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:46.371615 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319cfe6e-63df-4375-b7ed-e92ac4a187ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:46.373098 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319cfe6e-63df-4375-b7ed-e92ac4a187ef service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:46.383403 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 911/1840] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:03:46.384345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 930/1841] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:46.951877 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37bd99-f4f0-46e6-a720-50534e177c85 service cinder] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:46.951877 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-0d37bd99-f4f0-46e6-a720-50534e177c85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:46.964597 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37bd99-f4f0-46e6-a720-50534e177c85 service cinder] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:46.969709 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573aae3-1485-47db-8a32-bc526ebfd615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:46.971762 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573aae3-1485-47db-8a32-bc526ebfd615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:46.971762 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573aae3-1485-47db-8a32-bc526ebfd615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:46.971762 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573aae3-1485-47db-8a32-bc526ebfd615 admin admin] PATH_INFO: `/v3/projects/d1b77dec6ef646d5aae2890bcdc39775` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:46.972108 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573aae3-1485-47db-8a32-bc526ebfd615 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1b77dec6ef646d5aae2890bcdc39775)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:46.974056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573aae3-1485-47db-8a32-bc526ebfd615 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:47.088564 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a573aae3-1485-47db-8a32-bc526ebfd615 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1b77dec6ef646d5aae2890bcdc39775', 'request_id': 'req-a573aae3-1485-47db-8a32-bc526ebfd615'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:47.094666 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a573aae3-1485-47db-8a32-bc526ebfd615 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1b77dec6ef646d5aae2890bcdc39775', 'request_id': 'req-a573aae3-1485-47db-8a32-bc526ebfd615'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:47.101359 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a573aae3-1485-47db-8a32-bc526ebfd615 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1b77dec6ef646d5aae2890bcdc39775', 'request_id': 'req-a573aae3-1485-47db-8a32-bc526ebfd615'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:47.170845 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a573aae3-1485-47db-8a32-bc526ebfd615 admin admin] The token cache is being invalidate because project d1b77dec6ef646d5aae2890bcdc39775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:03:47.170845 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a573aae3-1485-47db-8a32-bc526ebfd615 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:47.172720 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a573aae3-1485-47db-8a32-bc526ebfd615 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:47.174476 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 912/1842] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:03:46 2022] DELETE /identity/v3/projects/d1b77dec6ef646d5aae2890bcdc39775 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:47.178144 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319cfe6e-63df-4375-b7ed-e92ac4a187ef service neutron] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:47.187880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319cfe6e-63df-4375-b7ed-e92ac4a187ef service neutron] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:47.250257 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02a5ed-9551-44c0-8e81-401dbac5122c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:47.250995 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02a5ed-9551-44c0-8e81-401dbac5122c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:47.251280 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02a5ed-9551-44c0-8e81-401dbac5122c admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:47.251583 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02a5ed-9551-44c0-8e81-401dbac5122c admin admin] PATH_INFO: `/v3/users/b08442d6ceca42d195ab0b6714898050` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:47.252748 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02a5ed-9551-44c0-8e81-401dbac5122c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b08442d6ceca42d195ab0b6714898050)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:47.254674 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02a5ed-9551-44c0-8e81-401dbac5122c admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:47.388009 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:47.428426 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-7c02a5ed-9551-44c0-8e81-401dbac5122c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b08442d6ceca42d195ab0b6714898050'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:47.429284 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-7c02a5ed-9551-44c0-8e81-401dbac5122c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b08442d6ceca42d195ab0b6714898050'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:47.430593 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-7c02a5ed-9551-44c0-8e81-401dbac5122c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b08442d6ceca42d195ab0b6714898050'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:47.456879 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-7c02a5ed-9551-44c0-8e81-401dbac5122c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b08442d6ceca42d195ab0b6714898050'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:47.527539 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:47.528155 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-7c02a5ed-9551-44c0-8e81-401dbac5122c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b08442d6ceca42d195ab0b6714898050'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:47.544502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 931/1843] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:03:47 2022] DELETE /identity/v3/users/b08442d6ceca42d195ab0b6714898050 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:48.063397 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573aae3-1485-47db-8a32-bc526ebfd615 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:48.064969 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-a573aae3-1485-47db-8a32-bc526ebfd615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:48.081587 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573aae3-1485-47db-8a32-bc526ebfd615 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:48.152503 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506b3a2-61a6-4734-87d5-4c45b6eacbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:48.153247 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506b3a2-61a6-4734-87d5-4c45b6eacbff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:48.153595 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506b3a2-61a6-4734-87d5-4c45b6eacbff admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:48.153935 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506b3a2-61a6-4734-87d5-4c45b6eacbff admin admin] PATH_INFO: `/v3/projects/da76e218f3164ad79a3ab10b929bf253` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:48.155344 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506b3a2-61a6-4734-87d5-4c45b6eacbff admin admin] RBAC: Authorizing `identity:delete_project(project_id=da76e218f3164ad79a3ab10b929bf253)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:48.157841 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506b3a2-61a6-4734-87d5-4c45b6eacbff admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:48.274418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-5506b3a2-61a6-4734-87d5-4c45b6eacbff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da76e218f3164ad79a3ab10b929bf253', 'request_id': 'req-5506b3a2-61a6-4734-87d5-4c45b6eacbff'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:48.285784 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-5506b3a2-61a6-4734-87d5-4c45b6eacbff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da76e218f3164ad79a3ab10b929bf253', 'request_id': 'req-5506b3a2-61a6-4734-87d5-4c45b6eacbff'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:48.296436 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-5506b3a2-61a6-4734-87d5-4c45b6eacbff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da76e218f3164ad79a3ab10b929bf253', 'request_id': 'req-5506b3a2-61a6-4734-87d5-4c45b6eacbff'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:48.357751 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-5506b3a2-61a6-4734-87d5-4c45b6eacbff admin admin] The token cache is being invalidate because project da76e218f3164ad79a3ab10b929bf253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:03:48.358530 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-5506b3a2-61a6-4734-87d5-4c45b6eacbff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:48.358793 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-5506b3a2-61a6-4734-87d5-4c45b6eacbff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:48.361369 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 913/1844] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:03:48 2022] DELETE /identity/v3/projects/da76e218f3164ad79a3ab10b929bf253 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:48.366529 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87b850-3f85-4e68-b348-19709a2742a5 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:48.366815 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87b850-3f85-4e68-b348-19709a2742a5 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:48.367117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87b850-3f85-4e68-b348-19709a2742a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:48.390851 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-ce87b850-3f85-4e68-b348-19709a2742a5 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:48.392214 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-ce87b850-3f85-4e68-b348-19709a2742a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:48.454494 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 932/1845] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:48.465050 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2d9cb-3fd1-4003-8734-37987bd6c00d None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:48.465343 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2d9cb-3fd1-4003-8734-37987bd6c00d None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:48.465625 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2d9cb-3fd1-4003-8734-37987bd6c00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:48.491664 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-d7e2d9cb-3fd1-4003-8734-37987bd6c00d None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:48.491664 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-d7e2d9cb-3fd1-4003-8734-37987bd6c00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:48.496641 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 914/1846] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:48.501854 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87b850-3f85-4e68-b348-19709a2742a5 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:48.514749 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87b850-3f85-4e68-b348-19709a2742a5 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:48.517602 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4f14c-67d5-46a3-bd0a-823393068d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:48.518235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4f14c-67d5-46a3-bd0a-823393068d7e admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:48.521629 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4f14c-67d5-46a3-bd0a-823393068d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:48.521629 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4f14c-67d5-46a3-bd0a-823393068d7e admin admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:48.521629 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4f14c-67d5-46a3-bd0a-823393068d7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:03:48.521629 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4f14c-67d5-46a3-bd0a-823393068d7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:48.521952 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4f14c-67d5-46a3-bd0a-823393068d7e admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:48.537468 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 933/1847] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:03:48.547861 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2d9cb-3fd1-4003-8734-37987bd6c00d None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:48.562429 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2d9cb-3fd1-4003-8734-37987bd6c00d None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:48.578683 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795f2a7-2e26-4f10-845d-5c8d3eb9eecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:48.579429 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795f2a7-2e26-4f10-845d-5c8d3eb9eecd admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:48.579837 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795f2a7-2e26-4f10-845d-5c8d3eb9eecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:48.580570 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795f2a7-2e26-4f10-845d-5c8d3eb9eecd admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:48.580771 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795f2a7-2e26-4f10-845d-5c8d3eb9eecd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:48.582639 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795f2a7-2e26-4f10-845d-5c8d3eb9eecd admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:48.621353 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:48.728616 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 915/1848] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:03:48 2022] POST /identity/v3/projects => generated 379 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:48.733016 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4f14c-67d5-46a3-bd0a-823393068d7e admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:48.750449 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4f14c-67d5-46a3-bd0a-823393068d7e admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:48.811514 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6c247-7b4a-46bd-a985-e90dd42d2630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:48.812975 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6c247-7b4a-46bd-a985-e90dd42d2630 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:48.813369 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6c247-7b4a-46bd-a985-e90dd42d2630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:48.813639 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6c247-7b4a-46bd-a985-e90dd42d2630 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:48.814276 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6c247-7b4a-46bd-a985-e90dd42d2630 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:48.817287 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6c247-7b4a-46bd-a985-e90dd42d2630 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:48.922141 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 934/1849] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:03:48 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:48.925919 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795f2a7-2e26-4f10-845d-5c8d3eb9eecd admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:48.942999 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795f2a7-2e26-4f10-845d-5c8d3eb9eecd admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:48.950199 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c2f7f-96ff-4913-ab90-f957cb39bcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:48.950952 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c2f7f-96ff-4913-ab90-f957cb39bcd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:48.951150 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c2f7f-96ff-4913-ab90-f957cb39bcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:48.951450 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c2f7f-96ff-4913-ab90-f957cb39bcd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:48.952092 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c2f7f-96ff-4913-ab90-f957cb39bcd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:48.954164 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c2f7f-96ff-4913-ab90-f957cb39bcd8 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:48.965377 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 916/1850] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:48.976236 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6c247-7b4a-46bd-a985-e90dd42d2630 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:48.987467 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6c247-7b4a-46bd-a985-e90dd42d2630 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:48.992219 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b82e13-b826-4d28-96fc-88cac46dbdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:48.992855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b82e13-b826-4d28-96fc-88cac46dbdfa admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:48.993139 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b82e13-b826-4d28-96fc-88cac46dbdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:48.993412 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b82e13-b826-4d28-96fc-88cac46dbdfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:48.994061 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b82e13-b826-4d28-96fc-88cac46dbdfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:48.995682 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b82e13-b826-4d28-96fc-88cac46dbdfa admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:49.008101 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 935/1851] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:49.011740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c2f7f-96ff-4913-ab90-f957cb39bcd8 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:49.024891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c2f7f-96ff-4913-ab90-f957cb39bcd8 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:49.029953 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9b696-e588-4534-a767-fe0a7beaf088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:49.030608 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9b696-e588-4534-a767-fe0a7beaf088 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:49.030918 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9b696-e588-4534-a767-fe0a7beaf088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:49.031188 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9b696-e588-4534-a767-fe0a7beaf088 admin admin] PATH_INFO: `/v3/projects/f6bd19fba3b64646a7554232f7ad48b9/users/72ebf117085147c99398bf346b1cde0e/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:49.048973 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9b696-e588-4534-a767-fe0a7beaf088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6bd19fba3b64646a7554232f7ad48b9, user_id=72ebf117085147c99398bf346b1cde0e, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:49.053063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9b696-e588-4534-a767-fe0a7beaf088 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:49.195161 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 917/1852] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:49 2022] PUT /identity/v3/projects/f6bd19fba3b64646a7554232f7ad48b9/users/72ebf117085147c99398bf346b1cde0e/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:03:49.205671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7e750-7d16-4285-8fe9-acf26a800f41 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:49.205959 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7e750-7d16-4285-8fe9-acf26a800f41 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:49.206236 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7e750-7d16-4285-8fe9-acf26a800f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:49.233015 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-7cc7e750-7d16-4285-8fe9-acf26a800f41 None None] MFA Rules not processed for user `72ebf117085147c99398bf346b1cde0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:49.235041 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-7cc7e750-7d16-4285-8fe9-acf26a800f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:49.337724 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 936/1853] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:49.343159 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9b696-e588-4534-a767-fe0a7beaf088 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:49.413368 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9b696-e588-4534-a767-fe0a7beaf088 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:49.418533 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f109e-7fb6-41f3-89ed-6a1ac32a6d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:49.418748 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f109e-7fb6-41f3-89ed-6a1ac32a6d57 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:49.419045 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f109e-7fb6-41f3-89ed-6a1ac32a6d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:49.419317 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f109e-7fb6-41f3-89ed-6a1ac32a6d57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:49.419950 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f109e-7fb6-41f3-89ed-6a1ac32a6d57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:49.422958 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f109e-7fb6-41f3-89ed-6a1ac32a6d57 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:49.513818 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 918/1854] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:03:49 2022] POST /identity/v3/projects => generated 377 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:49.517728 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7e750-7d16-4285-8fe9-acf26a800f41 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:49.528528 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7e750-7d16-4285-8fe9-acf26a800f41 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:49.585704 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7492635-1275-4820-b879-8fbed3102293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:49.586351 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7492635-1275-4820-b879-8fbed3102293 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:49.586633 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7492635-1275-4820-b879-8fbed3102293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:49.586908 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7492635-1275-4820-b879-8fbed3102293 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:49.587550 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7492635-1275-4820-b879-8fbed3102293 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:49.589502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7492635-1275-4820-b879-8fbed3102293 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:49.592485 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:49.670451 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 937/1855] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:03:49 2022] POST /identity/v3/users => generated 295 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:49.673707 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f109e-7fb6-41f3-89ed-6a1ac32a6d57 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:49.684601 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f109e-7fb6-41f3-89ed-6a1ac32a6d57 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:49.690408 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148f776-fbd0-4d71-a818-059335631d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:49.691031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148f776-fbd0-4d71-a818-059335631d76 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:49.691308 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148f776-fbd0-4d71-a818-059335631d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:49.691605 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148f776-fbd0-4d71-a818-059335631d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:49.692243 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148f776-fbd0-4d71-a818-059335631d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:49.693909 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148f776-fbd0-4d71-a818-059335631d76 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:49.704994 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 919/1856] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:49.709119 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7492635-1275-4820-b879-8fbed3102293 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:49.719526 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7492635-1275-4820-b879-8fbed3102293 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:49.724314 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79522c07-0d31-466d-82d7-b62ccd6a1545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:49.725001 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79522c07-0d31-466d-82d7-b62ccd6a1545 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:49.725284 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79522c07-0d31-466d-82d7-b62ccd6a1545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:49.725564 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79522c07-0d31-466d-82d7-b62ccd6a1545 admin admin] PATH_INFO: `/v3/projects/b15128a96d88465cb736b4e19cf016eb/users/c6d478afcbb547d7934e227812207b7d/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:49.741126 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79522c07-0d31-466d-82d7-b62ccd6a1545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b15128a96d88465cb736b4e19cf016eb, user_id=c6d478afcbb547d7934e227812207b7d, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:49.743802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79522c07-0d31-466d-82d7-b62ccd6a1545 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:49.821703 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 938/1857] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:49 2022] PUT /identity/v3/projects/b15128a96d88465cb736b4e19cf016eb/users/c6d478afcbb547d7934e227812207b7d/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:49.825789 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148f776-fbd0-4d71-a818-059335631d76 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:49.836177 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148f776-fbd0-4d71-a818-059335631d76 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:49.893675 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ac1f1-a643-409e-a75d-c1c0cc410691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:49.894283 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ac1f1-a643-409e-a75d-c1c0cc410691 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:49.894559 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ac1f1-a643-409e-a75d-c1c0cc410691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:49.894828 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ac1f1-a643-409e-a75d-c1c0cc410691 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:49.895509 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ac1f1-a643-409e-a75d-c1c0cc410691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:49.897200 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ac1f1-a643-409e-a75d-c1c0cc410691 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:49.906860 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 920/1858] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:49.911190 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79522c07-0d31-466d-82d7-b62ccd6a1545 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:49.922157 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79522c07-0d31-466d-82d7-b62ccd6a1545 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:49.927618 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7084d4-54df-4194-8f21-164f9f4ac140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:49.928271 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7084d4-54df-4194-8f21-164f9f4ac140 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:49.928271 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7084d4-54df-4194-8f21-164f9f4ac140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:49.928271 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7084d4-54df-4194-8f21-164f9f4ac140 admin admin] PATH_INFO: `/v3/projects/b15128a96d88465cb736b4e19cf016eb/users/c6d478afcbb547d7934e227812207b7d/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:49.930195 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7084d4-54df-4194-8f21-164f9f4ac140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b15128a96d88465cb736b4e19cf016eb, user_id=c6d478afcbb547d7934e227812207b7d, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:49.932991 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7084d4-54df-4194-8f21-164f9f4ac140 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:49.944441 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 939/1859] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:49 2022] PUT /identity/v3/projects/b15128a96d88465cb736b4e19cf016eb/users/c6d478afcbb547d7934e227812207b7d/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:49.957853 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a8e15-9573-4797-9d95-5a926328f602 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:49.958148 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a8e15-9573-4797-9d95-5a926328f602 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:49.958420 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a8e15-9573-4797-9d95-5a926328f602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:49.993638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-778a8e15-9573-4797-9d95-5a926328f602 None None] MFA Rules not processed for user `c6d478afcbb547d7934e227812207b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:49.995316 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-778a8e15-9573-4797-9d95-5a926328f602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:50.074049 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 921/1860] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:50.090217 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7084d4-54df-4194-8f21-164f9f4ac140 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:50.092082 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-3a7084d4-54df-4194-8f21-164f9f4ac140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:50.122868 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a8e15-9573-4797-9d95-5a926328f602 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:50.124338 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-778a8e15-9573-4797-9d95-5a926328f602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:50.163637 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:50.175393 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7084d4-54df-4194-8f21-164f9f4ac140 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:50.185391 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496bffc6-9e12-49fa-bc3d-832f0f56de4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:50.186238 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496bffc6-9e12-49fa-bc3d-832f0f56de4d service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:50.186538 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496bffc6-9e12-49fa-bc3d-832f0f56de4d service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:50.189010 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496bffc6-9e12-49fa-bc3d-832f0f56de4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:50.235793 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a8e15-9573-4797-9d95-5a926328f602 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:50.241334 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0becc-1f1d-4170-9578-902fd0440bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:50.241991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0becc-1f1d-4170-9578-902fd0440bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:50.242273 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0becc-1f1d-4170-9578-902fd0440bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:50.242551 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0becc-1f1d-4170-9578-902fd0440bb2 admin admin] PATH_INFO: `/v3/users/ad2441c20ce9422aa09d15f740bf625e` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:50.243704 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0becc-1f1d-4170-9578-902fd0440bb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad2441c20ce9422aa09d15f740bf625e)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:50.245881 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0becc-1f1d-4170-9578-902fd0440bb2 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:50.265239 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496bffc6-9e12-49fa-bc3d-832f0f56de4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:50.267906 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496bffc6-9e12-49fa-bc3d-832f0f56de4d service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:50.278998 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 940/1861] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:50.438768 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a1f0becc-1f1d-4170-9578-902fd0440bb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad2441c20ce9422aa09d15f740bf625e'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:50.439508 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a1f0becc-1f1d-4170-9578-902fd0440bb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad2441c20ce9422aa09d15f740bf625e'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:50.440149 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a1f0becc-1f1d-4170-9578-902fd0440bb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad2441c20ce9422aa09d15f740bf625e'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:50.489496 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a1f0becc-1f1d-4170-9578-902fd0440bb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad2441c20ce9422aa09d15f740bf625e'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:50.496955 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a1f0becc-1f1d-4170-9578-902fd0440bb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad2441c20ce9422aa09d15f740bf625e'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:50.514992 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 922/1862] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:03:50 2022] DELETE /identity/v3/users/ad2441c20ce9422aa09d15f740bf625e => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:03:50.523373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada22e6-7383-4daa-a6b0-f239c4363c60 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:50.523849 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada22e6-7383-4daa-a6b0-f239c4363c60 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:50.523936 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada22e6-7383-4daa-a6b0-f239c4363c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:50.543455 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-9ada22e6-7383-4daa-a6b0-f239c4363c60 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:50.544718 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-9ada22e6-7383-4daa-a6b0-f239c4363c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:50.608279 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 941/1863] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:03:50.620283 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0becc-1f1d-4170-9578-902fd0440bb2 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:50.621716 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-a1f0becc-1f1d-4170-9578-902fd0440bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:50.681770 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0becc-1f1d-4170-9578-902fd0440bb2 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:50.685574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb967c-4190-472c-8608-6806c2d20158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:50.686225 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb967c-4190-472c-8608-6806c2d20158 service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:50.686478 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb967c-4190-472c-8608-6806c2d20158 service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:50.686757 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb967c-4190-472c-8608-6806c2d20158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:50.697532 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb967c-4190-472c-8608-6806c2d20158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:50.698855 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb967c-4190-472c-8608-6806c2d20158 service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:50.709127 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 923/1864] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:03:51.172392 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada22e6-7383-4daa-a6b0-f239c4363c60 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:51.173886 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-9ada22e6-7383-4daa-a6b0-f239c4363c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:51.191625 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada22e6-7383-4daa-a6b0-f239c4363c60 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:51.196846 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a368e0-c377-40d7-998c-d68388d5c97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:51.197494 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a368e0-c377-40d7-998c-d68388d5c97b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:51.198033 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a368e0-c377-40d7-998c-d68388d5c97b admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:51.198033 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a368e0-c377-40d7-998c-d68388d5c97b admin admin] PATH_INFO: `/v3/projects/0ce85dbac5ef41d694efa548fe6e0841` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:51.199324 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a368e0-c377-40d7-998c-d68388d5c97b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ce85dbac5ef41d694efa548fe6e0841)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:51.201454 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a368e0-c377-40d7-998c-d68388d5c97b admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:51.337523 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-c0a368e0-c377-40d7-998c-d68388d5c97b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ce85dbac5ef41d694efa548fe6e0841', 'request_id': 'req-c0a368e0-c377-40d7-998c-d68388d5c97b'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:51.430176 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-c0a368e0-c377-40d7-998c-d68388d5c97b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ce85dbac5ef41d694efa548fe6e0841', 'request_id': 'req-c0a368e0-c377-40d7-998c-d68388d5c97b'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:51.446048 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-c0a368e0-c377-40d7-998c-d68388d5c97b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ce85dbac5ef41d694efa548fe6e0841', 'request_id': 'req-c0a368e0-c377-40d7-998c-d68388d5c97b'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:51.458054 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-c0a368e0-c377-40d7-998c-d68388d5c97b admin admin] The token cache is being invalidate because project 0ce85dbac5ef41d694efa548fe6e0841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:03:51.458352 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-c0a368e0-c377-40d7-998c-d68388d5c97b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:51.459026 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-c0a368e0-c377-40d7-998c-d68388d5c97b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:51.460572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 942/1865] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:03:51 2022] DELETE /identity/v3/projects/0ce85dbac5ef41d694efa548fe6e0841 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:51.464637 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb967c-4190-472c-8608-6806c2d20158 service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:51.482365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb967c-4190-472c-8608-6806c2d20158 service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:51.559311 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c1e25-a757-4c02-b3df-e224d15313af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:51.560035 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c1e25-a757-4c02-b3df-e224d15313af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:51.560315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c1e25-a757-4c02-b3df-e224d15313af admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:51.560583 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c1e25-a757-4c02-b3df-e224d15313af admin admin] PATH_INFO: `/v3/users/aa87b1dd88f44d26bf688b418ca8a7a0` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:51.561711 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c1e25-a757-4c02-b3df-e224d15313af admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa87b1dd88f44d26bf688b418ca8a7a0)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:51.564823 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c1e25-a757-4c02-b3df-e224d15313af admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:51.782198 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a368e0-c377-40d7-998c-d68388d5c97b admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:51.784170 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-c0a368e0-c377-40d7-998c-d68388d5c97b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:51.785155 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c15c1e25-a757-4c02-b3df-e224d15313af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa87b1dd88f44d26bf688b418ca8a7a0'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:51.785879 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c15c1e25-a757-4c02-b3df-e224d15313af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa87b1dd88f44d26bf688b418ca8a7a0'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:51.786489 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c15c1e25-a757-4c02-b3df-e224d15313af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa87b1dd88f44d26bf688b418ca8a7a0'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:51.799540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a368e0-c377-40d7-998c-d68388d5c97b admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:51.804345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce4bbc-432b-4500-8edf-fb12c8384faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:51.805083 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce4bbc-432b-4500-8edf-fb12c8384faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:51.805450 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce4bbc-432b-4500-8edf-fb12c8384faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:51.805792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce4bbc-432b-4500-8edf-fb12c8384faa admin admin] PATH_INFO: `/v3/users/f46ead6870744ee5b3109f6ecda7c11c` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:51.807006 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce4bbc-432b-4500-8edf-fb12c8384faa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f46ead6870744ee5b3109f6ecda7c11c)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:51.809086 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce4bbc-432b-4500-8edf-fb12c8384faa admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:51.895080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c15c1e25-a757-4c02-b3df-e224d15313af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa87b1dd88f44d26bf688b418ca8a7a0'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:51.902465 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c15c1e25-a757-4c02-b3df-e224d15313af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa87b1dd88f44d26bf688b418ca8a7a0'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:51.920459 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 924/1866] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:03:51 2022] DELETE /identity/v3/users/aa87b1dd88f44d26bf688b418ca8a7a0 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:51.923842 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:52.071997 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c1e25-a757-4c02-b3df-e224d15313af admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:52.073700 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-c15c1e25-a757-4c02-b3df-e224d15313af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:52.084036 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-afce4bbc-432b-4500-8edf-fb12c8384faa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f46ead6870744ee5b3109f6ecda7c11c'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:52.084877 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-afce4bbc-432b-4500-8edf-fb12c8384faa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f46ead6870744ee5b3109f6ecda7c11c'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:52.085676 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-afce4bbc-432b-4500-8edf-fb12c8384faa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f46ead6870744ee5b3109f6ecda7c11c'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:52.099044 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-afce4bbc-432b-4500-8edf-fb12c8384faa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f46ead6870744ee5b3109f6ecda7c11c'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:52.135962 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c1e25-a757-4c02-b3df-e224d15313af admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:52.139633 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ddb3b-81ee-4a0d-a97a-3b08f56ab235 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:52.140980 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ddb3b-81ee-4a0d-a97a-3b08f56ab235 service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:52.141273 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ddb3b-81ee-4a0d-a97a-3b08f56ab235 service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:52.141577 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ddb3b-81ee-4a0d-a97a-3b08f56ab235 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:52.143513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-f33ddb3b-81ee-4a0d-a97a-3b08f56ab235 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:52.214500 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ddb3b-81ee-4a0d-a97a-3b08f56ab235 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:52.214500 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ddb3b-81ee-4a0d-a97a-3b08f56ab235 service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:52.222751 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 925/1867] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:03:52.464368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-afce4bbc-432b-4500-8edf-fb12c8384faa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f46ead6870744ee5b3109f6ecda7c11c'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:52.478781 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 943/1868] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:03:51 2022] DELETE /identity/v3/users/f46ead6870744ee5b3109f6ecda7c11c => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:52.483429 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f410a0b-3e2d-4990-869c-d93db3d09627 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:52.484347 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f410a0b-3e2d-4990-869c-d93db3d09627 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:52.484806 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f410a0b-3e2d-4990-869c-d93db3d09627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:52.532269 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-1f410a0b-3e2d-4990-869c-d93db3d09627 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:52.534698 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-1f410a0b-3e2d-4990-869c-d93db3d09627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:52.672898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 926/1869] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:52.683678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce4bbc-432b-4500-8edf-fb12c8384faa admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:52.685233 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-afce4bbc-432b-4500-8edf-fb12c8384faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:52.768750 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce4bbc-432b-4500-8edf-fb12c8384faa admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:52.773924 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f2c8a-4eea-420f-aacd-579d2f562542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:52.777530 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f2c8a-4eea-420f-aacd-579d2f562542 service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:52.777530 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f2c8a-4eea-420f-aacd-579d2f562542 service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:52.777530 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f2c8a-4eea-420f-aacd-579d2f562542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:52.791437 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0f2c8a-4eea-420f-aacd-579d2f562542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:52.796114 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0f2c8a-4eea-420f-aacd-579d2f562542 service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:52.813259 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 944/1870] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:52.945578 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:53.014379 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f410a0b-3e2d-4990-869c-d93db3d09627 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:53.021755 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-1f410a0b-3e2d-4990-869c-d93db3d09627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:53.072159 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f410a0b-3e2d-4990-869c-d93db3d09627 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:53.083340 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d37aa-0503-41fc-a027-1dd6db45494d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:53.085167 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d37aa-0503-41fc-a027-1dd6db45494d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:53.085561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d37aa-0503-41fc-a027-1dd6db45494d admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:53.085944 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d37aa-0503-41fc-a027-1dd6db45494d admin admin] PATH_INFO: `/v3/projects/ed0c2e24d6034215ab62fd730e64219d` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:53.089557 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d37aa-0503-41fc-a027-1dd6db45494d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed0c2e24d6034215ab62fd730e64219d)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:53.096835 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d37aa-0503-41fc-a027-1dd6db45494d admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:53.355656 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-b00d37aa-0503-41fc-a027-1dd6db45494d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed0c2e24d6034215ab62fd730e64219d', 'request_id': 'req-b00d37aa-0503-41fc-a027-1dd6db45494d'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:53.386333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-b00d37aa-0503-41fc-a027-1dd6db45494d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed0c2e24d6034215ab62fd730e64219d', 'request_id': 'req-b00d37aa-0503-41fc-a027-1dd6db45494d'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:53.396906 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-b00d37aa-0503-41fc-a027-1dd6db45494d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed0c2e24d6034215ab62fd730e64219d', 'request_id': 'req-b00d37aa-0503-41fc-a027-1dd6db45494d'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:53.526806 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-b00d37aa-0503-41fc-a027-1dd6db45494d admin admin] The token cache is being invalidate because project ed0c2e24d6034215ab62fd730e64219d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:03:53.534397 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-b00d37aa-0503-41fc-a027-1dd6db45494d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:53.534397 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-b00d37aa-0503-41fc-a027-1dd6db45494d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:53.536278 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2153c-cb11-4d4b-b61c-0755d1f4669b None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:53.536748 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2153c-cb11-4d4b-b61c-0755d1f4669b None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:53.537169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2153c-cb11-4d4b-b61c-0755d1f4669b None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:53.539946 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 945/1872] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 24 16:03:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:03:53.540970 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 927/1872] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:03:53 2022] DELETE /identity/v3/projects/ed0c2e24d6034215ab62fd730e64219d => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:53.541785 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad76ed-9fa7-4cf6-8d25-79f839b4370b None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:53.542068 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad76ed-9fa7-4cf6-8d25-79f839b4370b None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:53.542343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad76ed-9fa7-4cf6-8d25-79f839b4370b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:53.561691 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b9d7c-75b2-4f3f-9689-aef2e6aac2a7 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:53.561691 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b9d7c-75b2-4f3f-9689-aef2e6aac2a7 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:53.561691 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b9d7c-75b2-4f3f-9689-aef2e6aac2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:53.577678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-64ad76ed-9fa7-4cf6-8d25-79f839b4370b None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:53.579577 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-64ad76ed-9fa7-4cf6-8d25-79f839b4370b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:53.591464 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-db8b9d7c-75b2-4f3f-9689-aef2e6aac2a7 None None] MFA Rules not processed for user `e5f0d8fe42e74d68bfa9a0e365bab4b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:53.593352 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-db8b9d7c-75b2-4f3f-9689-aef2e6aac2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:53.706739 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 946/1873] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:03:53.716429 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0559fad-4a56-45bd-ba18-450dd4c576b0 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:53.716983 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0559fad-4a56-45bd-ba18-450dd4c576b0 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:53.717425 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0559fad-4a56-45bd-ba18-450dd4c576b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:53.758143 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 928/1874] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 24 16:03:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:53.771099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-d0559fad-4a56-45bd-ba18-450dd4c576b0 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:53.772735 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-d0559fad-4a56-45bd-ba18-450dd4c576b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:53.779670 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b9d7c-75b2-4f3f-9689-aef2e6aac2a7 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:53.785421 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-db8b9d7c-75b2-4f3f-9689-aef2e6aac2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:53.786070 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 947/1875] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:53.798232 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0559fad-4a56-45bd-ba18-450dd4c576b0 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:53.809847 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b9d7c-75b2-4f3f-9689-aef2e6aac2a7 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:53.811027 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0559fad-4a56-45bd-ba18-450dd4c576b0 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:53.818522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320ae88-a6b9-4cbf-8a21-bad4b132fb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:53.819424 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320ae88-a6b9-4cbf-8a21-bad4b132fb53 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:53.819858 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320ae88-a6b9-4cbf-8a21-bad4b132fb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:53.820278 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320ae88-a6b9-4cbf-8a21-bad4b132fb53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:53.821843 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320ae88-a6b9-4cbf-8a21-bad4b132fb53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:03:53.822318 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320ae88-a6b9-4cbf-8a21-bad4b132fb53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:53.824263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320ae88-a6b9-4cbf-8a21-bad4b132fb53 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:53.829393 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb86c1-0fbf-49cb-bee2-6861d0ceba47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:53.830865 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb86c1-0fbf-49cb-bee2-6861d0ceba47 service nova] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:53.830865 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb86c1-0fbf-49cb-bee2-6861d0ceba47 service nova] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:53.830865 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb86c1-0fbf-49cb-bee2-6861d0ceba47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:53.847200 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 948/1876] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:03:53.848522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320ae88-a6b9-4cbf-8a21-bad4b132fb53 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:53.857410 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb86c1-0fbf-49cb-bee2-6861d0ceba47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:53.859589 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb86c1-0fbf-49cb-bee2-6861d0ceba47 service nova] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:53.860590 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320ae88-a6b9-4cbf-8a21-bad4b132fb53 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:53.868531 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c6a34-8e03-4465-be5f-d7fdce2cab9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:53.869376 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c6a34-8e03-4465-be5f-d7fdce2cab9d admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:53.869812 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c6a34-8e03-4465-be5f-d7fdce2cab9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:53.870531 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c6a34-8e03-4465-be5f-d7fdce2cab9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:53.871491 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c6a34-8e03-4465-be5f-d7fdce2cab9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:53.873620 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c6a34-8e03-4465-be5f-d7fdce2cab9d admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:53.886799 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 929/1877] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:03:54.007917 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 949/1878] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:03:53 2022] POST /identity/v3/projects => generated 359 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:54.009631 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb86c1-0fbf-49cb-bee2-6861d0ceba47 service nova] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:54.026044 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c6a34-8e03-4465-be5f-d7fdce2cab9d admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:54.028397 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-065c6a34-8e03-4465-be5f-d7fdce2cab9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:54.029010 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb86c1-0fbf-49cb-bee2-6861d0ceba47 service nova] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:54.124769 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:54.166529 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c103ac-7e25-41fd-9447-b655836132ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:54.167154 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c103ac-7e25-41fd-9447-b655836132ba admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:54.167613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c103ac-7e25-41fd-9447-b655836132ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:54.168044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c103ac-7e25-41fd-9447-b655836132ba admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:54.168975 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c103ac-7e25-41fd-9447-b655836132ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:54.170639 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c103ac-7e25-41fd-9447-b655836132ba admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:54.181229 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c6a34-8e03-4465-be5f-d7fdce2cab9d admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:54.196093 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19626ab7-8593-452e-8057-82fdd9acf473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:54.198083 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19626ab7-8593-452e-8057-82fdd9acf473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:54.199040 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19626ab7-8593-452e-8057-82fdd9acf473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:54.199539 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19626ab7-8593-452e-8057-82fdd9acf473 admin admin] PATH_INFO: `/v3/projects/862c3f1563734d529262d3a9809ff10c` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:54.201767 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19626ab7-8593-452e-8057-82fdd9acf473 admin admin] RBAC: Authorizing `identity:delete_project(project_id=862c3f1563734d529262d3a9809ff10c)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:54.228083 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19626ab7-8593-452e-8057-82fdd9acf473 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:54.354783 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 930/1879] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:03:54 2022] POST /identity/v3/users => generated 280 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:54.358499 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c103ac-7e25-41fd-9447-b655836132ba admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:54.367530 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-19626ab7-8593-452e-8057-82fdd9acf473 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '862c3f1563734d529262d3a9809ff10c', 'request_id': 'req-19626ab7-8593-452e-8057-82fdd9acf473'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:54.376470 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c103ac-7e25-41fd-9447-b655836132ba admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:54.448292 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67246257-9a25-4625-a6e1-ceba6fc554d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:54.448982 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67246257-9a25-4625-a6e1-ceba6fc554d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:54.449270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67246257-9a25-4625-a6e1-ceba6fc554d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:54.449543 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67246257-9a25-4625-a6e1-ceba6fc554d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:54.450207 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67246257-9a25-4625-a6e1-ceba6fc554d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:54.451797 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67246257-9a25-4625-a6e1-ceba6fc554d7 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:54.462456 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 931/1880] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:54.466258 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67246257-9a25-4625-a6e1-ceba6fc554d7 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:54.478406 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67246257-9a25-4625-a6e1-ceba6fc554d7 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:54.487883 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd3b5e-4ab1-4ff1-a97f-e2251fcee199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:54.490264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd3b5e-4ab1-4ff1-a97f-e2251fcee199 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:54.490264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd3b5e-4ab1-4ff1-a97f-e2251fcee199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:54.490465 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-19626ab7-8593-452e-8057-82fdd9acf473 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '862c3f1563734d529262d3a9809ff10c', 'request_id': 'req-19626ab7-8593-452e-8057-82fdd9acf473'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:54.490649 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd3b5e-4ab1-4ff1-a97f-e2251fcee199 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:54.490649 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd3b5e-4ab1-4ff1-a97f-e2251fcee199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:54.491610 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd3b5e-4ab1-4ff1-a97f-e2251fcee199 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:54.504847 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 932/1881] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:03:54.506782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd3b5e-4ab1-4ff1-a97f-e2251fcee199 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:54.509544 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-19626ab7-8593-452e-8057-82fdd9acf473 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '862c3f1563734d529262d3a9809ff10c', 'request_id': 'req-19626ab7-8593-452e-8057-82fdd9acf473'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:54.517902 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd3b5e-4ab1-4ff1-a97f-e2251fcee199 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:54.529774 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fb75e-3f94-48ba-9f5f-26fb9af2eca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:54.530403 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-19626ab7-8593-452e-8057-82fdd9acf473 admin admin] The token cache is being invalidate because project 862c3f1563734d529262d3a9809ff10c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:03:54.530403 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-19626ab7-8593-452e-8057-82fdd9acf473 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:54.531211 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fb75e-3f94-48ba-9f5f-26fb9af2eca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:54.531211 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fb75e-3f94-48ba-9f5f-26fb9af2eca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:54.531211 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fb75e-3f94-48ba-9f5f-26fb9af2eca2 admin admin] PATH_INFO: `/v3/projects/26a61e7428fc45afb41b8c0c945e4ce3/users/610d353de53a4b9b9d1285b6c72c1c9a/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:54.531526 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-19626ab7-8593-452e-8057-82fdd9acf473 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:54.531526 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 950/1882] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:03:54 2022] DELETE /identity/v3/projects/862c3f1563734d529262d3a9809ff10c => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:03:54.533000 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19626ab7-8593-452e-8057-82fdd9acf473 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:54.537099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-19626ab7-8593-452e-8057-82fdd9acf473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:54.541385 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fb75e-3f94-48ba-9f5f-26fb9af2eca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26a61e7428fc45afb41b8c0c945e4ce3, user_id=610d353de53a4b9b9d1285b6c72c1c9a, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:54.544173 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fb75e-3f94-48ba-9f5f-26fb9af2eca2 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:54.554545 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19626ab7-8593-452e-8057-82fdd9acf473 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:54.559345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2944a84-4c84-4fc3-bfcf-b63632e4e6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:54.567278 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2944a84-4c84-4fc3-bfcf-b63632e4e6c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:54.567278 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2944a84-4c84-4fc3-bfcf-b63632e4e6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:54.567278 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2944a84-4c84-4fc3-bfcf-b63632e4e6c7 admin admin] PATH_INFO: `/v3/users/83a07718b74345cabf6f2b0d55462c36` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:54.567278 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2944a84-4c84-4fc3-bfcf-b63632e4e6c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83a07718b74345cabf6f2b0d55462c36)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:54.567278 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2944a84-4c84-4fc3-bfcf-b63632e4e6c7 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:54.622025 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 933/1883] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:54 2022] PUT /identity/v3/projects/26a61e7428fc45afb41b8c0c945e4ce3/users/610d353de53a4b9b9d1285b6c72c1c9a/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:03:54.634928 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bc403-57e6-48be-9e4a-44182897fc9a None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:54.635124 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bc403-57e6-48be-9e4a-44182897fc9a None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:54.635413 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bc403-57e6-48be-9e4a-44182897fc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:54.666752 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-a29bc403-57e6-48be-9e4a-44182897fc9a None None] MFA Rules not processed for user `610d353de53a4b9b9d1285b6c72c1c9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:54.668412 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-a29bc403-57e6-48be-9e4a-44182897fc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:54.738092 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 934/1884] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:54 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:03:54.770676 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-c2944a84-4c84-4fc3-bfcf-b63632e4e6c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83a07718b74345cabf6f2b0d55462c36'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:54.771427 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-c2944a84-4c84-4fc3-bfcf-b63632e4e6c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83a07718b74345cabf6f2b0d55462c36'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:54.772654 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-c2944a84-4c84-4fc3-bfcf-b63632e4e6c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83a07718b74345cabf6f2b0d55462c36'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:54.777428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bc403-57e6-48be-9e4a-44182897fc9a None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:54.778872 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-a29bc403-57e6-48be-9e4a-44182897fc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:54.790548 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-c2944a84-4c84-4fc3-bfcf-b63632e4e6c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83a07718b74345cabf6f2b0d55462c36'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:54.843735 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bc403-57e6-48be-9e4a-44182897fc9a None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:54.847498 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a8927-fa38-42e6-b44b-96168636175c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:54.848107 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a8927-fa38-42e6-b44b-96168636175c service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:54.848421 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a8927-fa38-42e6-b44b-96168636175c service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:54.848718 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a8927-fa38-42e6-b44b-96168636175c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:54.850435 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-869a8927-fa38-42e6-b44b-96168636175c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:54.858165 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-c2944a84-4c84-4fc3-bfcf-b63632e4e6c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83a07718b74345cabf6f2b0d55462c36'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:54.868069 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a8927-fa38-42e6-b44b-96168636175c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:54.868069 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a8927-fa38-42e6-b44b-96168636175c service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:54.872154 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 951/1885] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:03:54 2022] DELETE /identity/v3/users/83a07718b74345cabf6f2b0d55462c36 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:03:54.874800 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 935/1886] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:54 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:03:54.890873 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2944a84-4c84-4fc3-bfcf-b63632e4e6c7 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:54.892544 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-c2944a84-4c84-4fc3-bfcf-b63632e4e6c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:54.959852 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2944a84-4c84-4fc3-bfcf-b63632e4e6c7 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:54.964644 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8739d-c336-422b-a23c-32b40b709834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:54.965574 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8739d-c336-422b-a23c-32b40b709834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:54.965966 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8739d-c336-422b-a23c-32b40b709834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:54.966084 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8739d-c336-422b-a23c-32b40b709834 admin admin] PATH_INFO: `/v3/users/610d353de53a4b9b9d1285b6c72c1c9a` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:54.967156 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8739d-c336-422b-a23c-32b40b709834 admin admin] RBAC: Authorizing `identity:delete_user(user_id=610d353de53a4b9b9d1285b6c72c1c9a)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:54.970114 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8739d-c336-422b-a23c-32b40b709834 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:55.166613 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-b6c8739d-c336-422b-a23c-32b40b709834 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '610d353de53a4b9b9d1285b6c72c1c9a'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:55.167467 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-b6c8739d-c336-422b-a23c-32b40b709834 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '610d353de53a4b9b9d1285b6c72c1c9a'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:55.168744 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-b6c8739d-c336-422b-a23c-32b40b709834 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '610d353de53a4b9b9d1285b6c72c1c9a'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:55.182169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-b6c8739d-c336-422b-a23c-32b40b709834 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '610d353de53a4b9b9d1285b6c72c1c9a'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:55.290005 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-b6c8739d-c336-422b-a23c-32b40b709834 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '610d353de53a4b9b9d1285b6c72c1c9a'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:55.322124 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a8927-fa38-42e6-b44b-96168636175c service cinder] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:55.322124 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-869a8927-fa38-42e6-b44b-96168636175c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:55.336940 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 952/1887] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:03:54 2022] DELETE /identity/v3/users/610d353de53a4b9b9d1285b6c72c1c9a => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:55.339653 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d102b-cd6f-40b6-97a8-9bb897384044 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:55.339956 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d102b-cd6f-40b6-97a8-9bb897384044 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:55.340232 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d102b-cd6f-40b6-97a8-9bb897384044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:55.370279 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-6b4d102b-cd6f-40b6-97a8-9bb897384044 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:55.371546 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-6b4d102b-cd6f-40b6-97a8-9bb897384044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:55.456921 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a8927-fa38-42e6-b44b-96168636175c service cinder] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:55.489956 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 953/1888] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:55.496777 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d102b-cd6f-40b6-97a8-9bb897384044 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:55.498285 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-6b4d102b-cd6f-40b6-97a8-9bb897384044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:55.553147 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86025b42-bff5-4949-af8e-b3d9842c4a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:55.553940 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86025b42-bff5-4949-af8e-b3d9842c4a27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:55.554513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86025b42-bff5-4949-af8e-b3d9842c4a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:55.555120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86025b42-bff5-4949-af8e-b3d9842c4a27 admin admin] PATH_INFO: `/v3/projects/579e28615af745c891d6cd8901db5185` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:55.556958 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86025b42-bff5-4949-af8e-b3d9842c4a27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=579e28615af745c891d6cd8901db5185)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:55.559544 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86025b42-bff5-4949-af8e-b3d9842c4a27 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:55.581226 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d102b-cd6f-40b6-97a8-9bb897384044 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:55.586362 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f55e00-0500-434d-b266-0e80072276ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:55.587135 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f55e00-0500-434d-b266-0e80072276ac service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:55.587261 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f55e00-0500-434d-b266-0e80072276ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:55.587532 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f55e00-0500-434d-b266-0e80072276ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:55.599292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f55e00-0500-434d-b266-0e80072276ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:55.600760 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f55e00-0500-434d-b266-0e80072276ac service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:55.611040 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 954/1889] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:03:55.710961 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:55.714024 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-86025b42-bff5-4949-af8e-b3d9842c4a27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '579e28615af745c891d6cd8901db5185', 'request_id': 'req-86025b42-bff5-4949-af8e-b3d9842c4a27'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:55.724587 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-86025b42-bff5-4949-af8e-b3d9842c4a27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '579e28615af745c891d6cd8901db5185', 'request_id': 'req-86025b42-bff5-4949-af8e-b3d9842c4a27'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:55.740183 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-86025b42-bff5-4949-af8e-b3d9842c4a27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '579e28615af745c891d6cd8901db5185', 'request_id': 'req-86025b42-bff5-4949-af8e-b3d9842c4a27'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:55.806784 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-86025b42-bff5-4949-af8e-b3d9842c4a27 admin admin] The token cache is being invalidate because project 579e28615af745c891d6cd8901db5185 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:03:55.807158 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-86025b42-bff5-4949-af8e-b3d9842c4a27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:55.811441 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-86025b42-bff5-4949-af8e-b3d9842c4a27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:55.811441 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 936/1890] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:03:55 2022] DELETE /identity/v3/projects/579e28615af745c891d6cd8901db5185 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:03:55.815909 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca8a61-dc5a-4839-9202-0c783691dea3 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:55.816196 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca8a61-dc5a-4839-9202-0c783691dea3 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:55.816474 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca8a61-dc5a-4839-9202-0c783691dea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:55.837162 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-f2ca8a61-dc5a-4839-9202-0c783691dea3 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:55.838394 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-f2ca8a61-dc5a-4839-9202-0c783691dea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:55.923562 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 955/1891] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:55.931482 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570aa1b-3f8e-4b17-914d-293116b36eeb None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:55.931770 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570aa1b-3f8e-4b17-914d-293116b36eeb None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:55.932045 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570aa1b-3f8e-4b17-914d-293116b36eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:55.956081 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-7570aa1b-3f8e-4b17-914d-293116b36eeb None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:55.957562 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-7570aa1b-3f8e-4b17-914d-293116b36eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:55.973019 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 937/1892] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:55.974281 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca8a61-dc5a-4839-9202-0c783691dea3 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:56.000384 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca8a61-dc5a-4839-9202-0c783691dea3 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:56.010781 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed1f2b-6959-409d-9af0-e55cb3fd26bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:56.011726 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed1f2b-6959-409d-9af0-e55cb3fd26bf admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:56.012585 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed1f2b-6959-409d-9af0-e55cb3fd26bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:56.012981 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed1f2b-6959-409d-9af0-e55cb3fd26bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:56.014146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed1f2b-6959-409d-9af0-e55cb3fd26bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:03:56.014453 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed1f2b-6959-409d-9af0-e55cb3fd26bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:56.017308 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed1f2b-6959-409d-9af0-e55cb3fd26bf admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:56.042189 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 956/1893] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:03:56.042306 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570aa1b-3f8e-4b17-914d-293116b36eeb None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:56.058786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570aa1b-3f8e-4b17-914d-293116b36eeb None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:56.068272 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517c7b4-b5e6-46fe-a879-f14b226c0e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:56.068879 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517c7b4-b5e6-46fe-a879-f14b226c0e5a admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:56.069160 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517c7b4-b5e6-46fe-a879-f14b226c0e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:56.069433 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517c7b4-b5e6-46fe-a879-f14b226c0e5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:56.070062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517c7b4-b5e6-46fe-a879-f14b226c0e5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:56.072366 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517c7b4-b5e6-46fe-a879-f14b226c0e5a admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:56.079038 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed1f2b-6959-409d-9af0-e55cb3fd26bf admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:56.080898 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-83ed1f2b-6959-409d-9af0-e55cb3fd26bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:56.101429 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed1f2b-6959-409d-9af0-e55cb3fd26bf admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:56.113271 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48f7fa-64cb-437c-8edf-b1c1b54fe392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:56.118165 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48f7fa-64cb-437c-8edf-b1c1b54fe392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:56.118165 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48f7fa-64cb-437c-8edf-b1c1b54fe392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:56.118165 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48f7fa-64cb-437c-8edf-b1c1b54fe392 admin admin] PATH_INFO: `/v3/users/0aea1adf50f64e70a5553a10c3bfb3d8` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:56.118165 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48f7fa-64cb-437c-8edf-b1c1b54fe392 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aea1adf50f64e70a5553a10c3bfb3d8)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:56.129226 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48f7fa-64cb-437c-8edf-b1c1b54fe392 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:56.236153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 938/1894] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:03:56 2022] POST /identity/v3/projects => generated 387 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:56.236153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517c7b4-b5e6-46fe-a879-f14b226c0e5a admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:56.237452 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-d517c7b4-b5e6-46fe-a879-f14b226c0e5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:56.306779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517c7b4-b5e6-46fe-a879-f14b226c0e5a admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:56.311474 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8aa446-7331-4d57-a321-850ca9b3bd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:56.312135 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8aa446-7331-4d57-a321-850ca9b3bd32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:56.312594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8aa446-7331-4d57-a321-850ca9b3bd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:56.312899 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8aa446-7331-4d57-a321-850ca9b3bd32 admin admin] PATH_INFO: `/v3/projects/26a61e7428fc45afb41b8c0c945e4ce3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:56.314026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8aa446-7331-4d57-a321-850ca9b3bd32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26a61e7428fc45afb41b8c0c945e4ce3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:56.315930 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8aa446-7331-4d57-a321-850ca9b3bd32 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:56.370608 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-4a48f7fa-64cb-437c-8edf-b1c1b54fe392 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aea1adf50f64e70a5553a10c3bfb3d8'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:56.371258 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-4a48f7fa-64cb-437c-8edf-b1c1b54fe392 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aea1adf50f64e70a5553a10c3bfb3d8'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:56.371911 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-4a48f7fa-64cb-437c-8edf-b1c1b54fe392 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aea1adf50f64e70a5553a10c3bfb3d8'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:56.385931 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-4a48f7fa-64cb-437c-8edf-b1c1b54fe392 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aea1adf50f64e70a5553a10c3bfb3d8'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:56.446980 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-ff8aa446-7331-4d57-a321-850ca9b3bd32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26a61e7428fc45afb41b8c0c945e4ce3', 'request_id': 'req-ff8aa446-7331-4d57-a321-850ca9b3bd32'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:56.452923 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-ff8aa446-7331-4d57-a321-850ca9b3bd32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26a61e7428fc45afb41b8c0c945e4ce3', 'request_id': 'req-ff8aa446-7331-4d57-a321-850ca9b3bd32'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:56.455435 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:56.457007 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-4a48f7fa-64cb-437c-8edf-b1c1b54fe392 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aea1adf50f64e70a5553a10c3bfb3d8'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:56.459461 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-ff8aa446-7331-4d57-a321-850ca9b3bd32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26a61e7428fc45afb41b8c0c945e4ce3', 'request_id': 'req-ff8aa446-7331-4d57-a321-850ca9b3bd32'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:56.470808 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 957/1895] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:03:56 2022] DELETE /identity/v3/users/0aea1adf50f64e70a5553a10c3bfb3d8 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:56.471877 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48f7fa-64cb-437c-8edf-b1c1b54fe392 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:56.473325 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-4a48f7fa-64cb-437c-8edf-b1c1b54fe392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:56.540607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-ff8aa446-7331-4d57-a321-850ca9b3bd32 admin admin] The token cache is being invalidate because project 26a61e7428fc45afb41b8c0c945e4ce3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:03:56.541190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-ff8aa446-7331-4d57-a321-850ca9b3bd32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:56.542000 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-ff8aa446-7331-4d57-a321-850ca9b3bd32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:56.545448 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48f7fa-64cb-437c-8edf-b1c1b54fe392 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:56.547239 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 939/1896] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:03:56 2022] DELETE /identity/v3/projects/26a61e7428fc45afb41b8c0c945e4ce3 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:56.552669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f8b31-75cf-4e0d-aba4-fa53732b9029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:56.552831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb81ea-b2cb-4bfc-b47d-b9daca5645e1 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:56.553360 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f8b31-75cf-4e0d-aba4-fa53732b9029 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:56.553487 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb81ea-b2cb-4bfc-b47d-b9daca5645e1 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:56.553941 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f8b31-75cf-4e0d-aba4-fa53732b9029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:56.554048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb81ea-b2cb-4bfc-b47d-b9daca5645e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:56.554142 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f8b31-75cf-4e0d-aba4-fa53732b9029 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:56.554508 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f8b31-75cf-4e0d-aba4-fa53732b9029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:56.556827 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f8b31-75cf-4e0d-aba4-fa53732b9029 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:56.586521 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-f2bb81ea-b2cb-4bfc-b47d-b9daca5645e1 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:56.588822 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-f2bb81ea-b2cb-4bfc-b47d-b9daca5645e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:56.600043 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 940/1897] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:56.601714 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de267bce-dca5-4728-bd66-ffc248bd1096 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:56.602128 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de267bce-dca5-4728-bd66-ffc248bd1096 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:56.602541 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de267bce-dca5-4728-bd66-ffc248bd1096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:56.633329 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-de267bce-dca5-4728-bd66-ffc248bd1096 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:56.634714 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-de267bce-dca5-4728-bd66-ffc248bd1096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:56.652428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 941/1898] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:56.654133 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de267bce-dca5-4728-bd66-ffc248bd1096 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:56.657232 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-de267bce-dca5-4728-bd66-ffc248bd1096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:56.678859 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 958/1899] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:03:56 2022] POST /identity/v3/users => generated 294 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:56.681148 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74160d4-a51b-45e4-be33-5450102e737d None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:56.681148 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74160d4-a51b-45e4-be33-5450102e737d None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:56.681148 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74160d4-a51b-45e4-be33-5450102e737d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:56.729817 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-f74160d4-a51b-45e4-be33-5450102e737d None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:56.732605 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-f74160d4-a51b-45e4-be33-5450102e737d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:56.745332 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 959/1900] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:56.746229 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74160d4-a51b-45e4-be33-5450102e737d None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:56.749254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-f74160d4-a51b-45e4-be33-5450102e737d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:56.773494 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74160d4-a51b-45e4-be33-5450102e737d None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:56.774774 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de267bce-dca5-4728-bd66-ffc248bd1096 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:56.779749 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8aaf5-2d08-4a2e-b416-a33e2bbeaf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:56.781458 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8aaf5-2d08-4a2e-b416-a33e2bbeaf07 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:56.781458 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8aaf5-2d08-4a2e-b416-a33e2bbeaf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:56.782025 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8aaf5-2d08-4a2e-b416-a33e2bbeaf07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:56.782454 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb18982-d597-4fa9-a170-076fa4a1492a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:56.782886 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a8aaf5-2d08-4a2e-b416-a33e2bbeaf07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:56.783090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb18982-d597-4fa9-a170-076fa4a1492a service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:56.783372 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb18982-d597-4fa9-a170-076fa4a1492a service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:56.783892 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb18982-d597-4fa9-a170-076fa4a1492a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:56.785155 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a8aaf5-2d08-4a2e-b416-a33e2bbeaf07 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:56.796769 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb18982-d597-4fa9-a170-076fa4a1492a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:56.798214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb18982-d597-4fa9-a170-076fa4a1492a service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:56.799415 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 960/1901] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:56.800391 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8aaf5-2d08-4a2e-b416-a33e2bbeaf07 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:56.816641 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8aaf5-2d08-4a2e-b416-a33e2bbeaf07 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:56.823519 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af200e0-3cd7-459e-bf0d-6ef8a2f07fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:56.824784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af200e0-3cd7-459e-bf0d-6ef8a2f07fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:56.824899 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 942/1902] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:56.825455 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af200e0-3cd7-459e-bf0d-6ef8a2f07fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:56.825854 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af200e0-3cd7-459e-bf0d-6ef8a2f07fc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:56.826112 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb18982-d597-4fa9-a170-076fa4a1492a service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:56.826650 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af200e0-3cd7-459e-bf0d-6ef8a2f07fc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:03:56.826964 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af200e0-3cd7-459e-bf0d-6ef8a2f07fc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:56.829200 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af200e0-3cd7-459e-bf0d-6ef8a2f07fc1 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:56.837624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb18982-d597-4fa9-a170-076fa4a1492a service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:56.843892 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc6ba6-45fd-4a85-99a2-aefda815d6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:56.844557 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc6ba6-45fd-4a85-99a2-aefda815d6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:56.844878 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc6ba6-45fd-4a85-99a2-aefda815d6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:56.845286 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc6ba6-45fd-4a85-99a2-aefda815d6c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:56.846417 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc6ba6-45fd-4a85-99a2-aefda815d6c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:56.848271 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 961/1903] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:03:56.852210 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc6ba6-45fd-4a85-99a2-aefda815d6c2 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:56.853185 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af200e0-3cd7-459e-bf0d-6ef8a2f07fc1 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:56.867262 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 943/1904] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:56.870883 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af200e0-3cd7-459e-bf0d-6ef8a2f07fc1 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:56.872670 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc6ba6-45fd-4a85-99a2-aefda815d6c2 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:56.882032 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d552e6-560f-4113-8509-da45fb133ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:56.882032 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d552e6-560f-4113-8509-da45fb133ffd admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:56.882032 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d552e6-560f-4113-8509-da45fb133ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:56.882032 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d552e6-560f-4113-8509-da45fb133ffd admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:56.882529 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d552e6-560f-4113-8509-da45fb133ffd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:56.883982 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d552e6-560f-4113-8509-da45fb133ffd admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:56.890593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc6ba6-45fd-4a85-99a2-aefda815d6c2 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:56.898036 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ef393-a3d3-4a4c-a02d-8318018c6ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:56.898610 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ef393-a3d3-4a4c-a02d-8318018c6ffe admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:56.898960 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ef393-a3d3-4a4c-a02d-8318018c6ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:56.899479 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ef393-a3d3-4a4c-a02d-8318018c6ffe admin admin] PATH_INFO: `/v3/projects/e02efd44c5f646fc9f09991c76bed18d/users/a52fb4601d084fb78f6d3e3f30817a30/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:56.924018 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ef393-a3d3-4a4c-a02d-8318018c6ffe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e02efd44c5f646fc9f09991c76bed18d, user_id=a52fb4601d084fb78f6d3e3f30817a30, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:56.928050 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ef393-a3d3-4a4c-a02d-8318018c6ffe admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:57.023817 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 962/1905] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:03:56 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:03:57.037839 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 944/1906] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:56 2022] PUT /identity/v3/projects/e02efd44c5f646fc9f09991c76bed18d/users/a52fb4601d084fb78f6d3e3f30817a30/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:57.039053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d552e6-560f-4113-8509-da45fb133ffd admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:57.049477 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25e2e7-af9f-4c93-bfb7-5310292bb813 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:57.049771 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25e2e7-af9f-4c93-bfb7-5310292bb813 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:57.050058 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25e2e7-af9f-4c93-bfb7-5310292bb813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:57.147239 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-fa25e2e7-af9f-4c93-bfb7-5310292bb813 None None] MFA Rules not processed for user `a52fb4601d084fb78f6d3e3f30817a30`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:57.149414 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-fa25e2e7-af9f-4c93-bfb7-5310292bb813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:57.163919 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d552e6-560f-4113-8509-da45fb133ffd admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:57.277336 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 945/1907] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:03:57.281597 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25e2e7-af9f-4c93-bfb7-5310292bb813 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:57.284860 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-fa25e2e7-af9f-4c93-bfb7-5310292bb813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:57.303663 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20238fb2-2170-45cc-ac8e-6094c87913a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:57.306209 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20238fb2-2170-45cc-ac8e-6094c87913a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:57.306496 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20238fb2-2170-45cc-ac8e-6094c87913a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:57.306779 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20238fb2-2170-45cc-ac8e-6094c87913a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:57.307447 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20238fb2-2170-45cc-ac8e-6094c87913a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:57.310201 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20238fb2-2170-45cc-ac8e-6094c87913a4 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:57.315243 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25e2e7-af9f-4c93-bfb7-5310292bb813 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:57.330048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d3824-7172-44cd-9ced-5688ecaafe48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:57.330854 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d3824-7172-44cd-9ced-5688ecaafe48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:57.331140 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d3824-7172-44cd-9ced-5688ecaafe48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:57.332074 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d3824-7172-44cd-9ced-5688ecaafe48 admin admin] PATH_INFO: `/v3/users/72ebf117085147c99398bf346b1cde0e` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:57.334370 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2d3824-7172-44cd-9ced-5688ecaafe48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72ebf117085147c99398bf346b1cde0e)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:57.336329 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2d3824-7172-44cd-9ced-5688ecaafe48 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:57.454066 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 963/1908] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:03:57 2022] POST /identity/v3/users => generated 293 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:57.454066 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20238fb2-2170-45cc-ac8e-6094c87913a4 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:57.481207 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20238fb2-2170-45cc-ac8e-6094c87913a4 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:57.488000 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42c443-4dae-4b57-b235-9a76ad52eb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:57.489067 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42c443-4dae-4b57-b235-9a76ad52eb61 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:57.489067 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42c443-4dae-4b57-b235-9a76ad52eb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:57.489281 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42c443-4dae-4b57-b235-9a76ad52eb61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:57.490004 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42c443-4dae-4b57-b235-9a76ad52eb61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:57.493585 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42c443-4dae-4b57-b235-9a76ad52eb61 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:57.562858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-ca2d3824-7172-44cd-9ced-5688ecaafe48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72ebf117085147c99398bf346b1cde0e'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:57.564010 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-ca2d3824-7172-44cd-9ced-5688ecaafe48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72ebf117085147c99398bf346b1cde0e'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:57.564726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-ca2d3824-7172-44cd-9ced-5688ecaafe48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72ebf117085147c99398bf346b1cde0e'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:57.627153 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 964/1909] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:03:57 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:57.628132 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42c443-4dae-4b57-b235-9a76ad52eb61 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:57.630874 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-2b42c443-4dae-4b57-b235-9a76ad52eb61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:57.633109 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-ca2d3824-7172-44cd-9ced-5688ecaafe48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72ebf117085147c99398bf346b1cde0e'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:57.644479 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-ca2d3824-7172-44cd-9ced-5688ecaafe48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72ebf117085147c99398bf346b1cde0e'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:57.692143 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 946/1910] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:03:57 2022] DELETE /identity/v3/users/72ebf117085147c99398bf346b1cde0e => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:57.698191 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d3824-7172-44cd-9ced-5688ecaafe48 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:57.701383 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-ca2d3824-7172-44cd-9ced-5688ecaafe48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:57.720705 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:57.740992 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42c443-4dae-4b57-b235-9a76ad52eb61 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:57.821185 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d3824-7172-44cd-9ced-5688ecaafe48 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:57.827079 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf42223-478b-41bb-a7a9-484860642f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:57.828377 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf42223-478b-41bb-a7a9-484860642f6a admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:57.828721 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf42223-478b-41bb-a7a9-484860642f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:57.828966 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf42223-478b-41bb-a7a9-484860642f6a admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:57.829698 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf42223-478b-41bb-a7a9-484860642f6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:57.832513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf42223-478b-41bb-a7a9-484860642f6a admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:57.836413 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e20a52-23d9-4fd5-9e5a-3c26495d5f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:57.837116 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e20a52-23d9-4fd5-9e5a-3c26495d5f0c admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:57.837407 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e20a52-23d9-4fd5-9e5a-3c26495d5f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:57.837681 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e20a52-23d9-4fd5-9e5a-3c26495d5f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:57.838329 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e20a52-23d9-4fd5-9e5a-3c26495d5f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:57.843389 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e20a52-23d9-4fd5-9e5a-3c26495d5f0c admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:57.857449 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 965/1911] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:57.859415 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb304681-7e32-480c-905e-7840175b47ca None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:57.859887 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb304681-7e32-480c-905e-7840175b47ca None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:57.860473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb304681-7e32-480c-905e-7840175b47ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:57.893833 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-bb304681-7e32-480c-905e-7840175b47ca None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:57.895237 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-bb304681-7e32-480c-905e-7840175b47ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:57.905017 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 966/1912] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:57.918235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb304681-7e32-480c-905e-7840175b47ca None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:57.931030 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb304681-7e32-480c-905e-7840175b47ca None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:57.938075 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1ad34-d9f3-4315-9da7-f242b6e4a851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:57.938934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1ad34-d9f3-4315-9da7-f242b6e4a851 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:57.945489 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1ad34-d9f3-4315-9da7-f242b6e4a851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:57.945489 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1ad34-d9f3-4315-9da7-f242b6e4a851 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:57.945489 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca1ad34-d9f3-4315-9da7-f242b6e4a851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:57.945489 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca1ad34-d9f3-4315-9da7-f242b6e4a851 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:57.952905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 967/1913] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:57.954389 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1ad34-d9f3-4315-9da7-f242b6e4a851 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:57.958039 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-8ca1ad34-d9f3-4315-9da7-f242b6e4a851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:57.977064 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 947/1914] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:03:57 2022] POST /identity/v3/users => generated 299 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:57.977064 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf42223-478b-41bb-a7a9-484860642f6a admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:57.984452 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf42223-478b-41bb-a7a9-484860642f6a admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:57.989444 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d29ea1-bf88-4e6b-b521-453bff360193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:57.990105 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d29ea1-bf88-4e6b-b521-453bff360193 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:57.990385 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d29ea1-bf88-4e6b-b521-453bff360193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:57.990661 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d29ea1-bf88-4e6b-b521-453bff360193 admin admin] PATH_INFO: `/v3/projects/17c8d3185ba646f5abaeac13f3fb8012/users/ec24ca00072646c2b3821d795cd235a4/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:58.015211 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d29ea1-bf88-4e6b-b521-453bff360193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17c8d3185ba646f5abaeac13f3fb8012, user_id=ec24ca00072646c2b3821d795cd235a4, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:58.018107 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d29ea1-bf88-4e6b-b521-453bff360193 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:58.034769 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1ad34-d9f3-4315-9da7-f242b6e4a851 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:58.038544 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ec3ac-1279-47c5-842c-c41d2bca812a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:58.039157 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ec3ac-1279-47c5-842c-c41d2bca812a service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:58.039442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ec3ac-1279-47c5-842c-c41d2bca812a service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:58.039717 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ec3ac-1279-47c5-842c-c41d2bca812a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:58.049076 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ec3ac-1279-47c5-842c-c41d2bca812a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:58.050509 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ec3ac-1279-47c5-842c-c41d2bca812a service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:58.060105 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 968/1915] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:58.060919 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ec3ac-1279-47c5-842c-c41d2bca812a service neutron] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:58.070260 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ec3ac-1279-47c5-842c-c41d2bca812a service neutron] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:58.075128 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62d629-33c7-4cd2-bd92-24ca0d180f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:58.075739 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62d629-33c7-4cd2-bd92-24ca0d180f3c admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:58.076008 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62d629-33c7-4cd2-bd92-24ca0d180f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:58.076277 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62d629-33c7-4cd2-bd92-24ca0d180f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:58.076955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62d629-33c7-4cd2-bd92-24ca0d180f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:58.079555 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62d629-33c7-4cd2-bd92-24ca0d180f3c admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:58.090181 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 969/1916] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:58.095568 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62d629-33c7-4cd2-bd92-24ca0d180f3c admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:58.105685 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62d629-33c7-4cd2-bd92-24ca0d180f3c admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:58.111423 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a71e9d-d69c-4cf6-a8cb-769f89647c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:58.112138 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a71e9d-d69c-4cf6-a8cb-769f89647c6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:58.112410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a71e9d-d69c-4cf6-a8cb-769f89647c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:58.112713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a71e9d-d69c-4cf6-a8cb-769f89647c6b admin admin] PATH_INFO: `/v3/projects/3243c5f4ad3942318cba4b6948802994/users/95d62e7086cd49f8b9317fba1f7d4bc3/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:58.118731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 948/1917] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:57 2022] PUT /identity/v3/projects/17c8d3185ba646f5abaeac13f3fb8012/users/ec24ca00072646c2b3821d795cd235a4/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:58.123643 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d29ea1-bf88-4e6b-b521-453bff360193 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:58.125915 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-54d29ea1-bf88-4e6b-b521-453bff360193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:58.146265 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a71e9d-d69c-4cf6-a8cb-769f89647c6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3243c5f4ad3942318cba4b6948802994, user_id=95d62e7086cd49f8b9317fba1f7d4bc3, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:58.149919 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a71e9d-d69c-4cf6-a8cb-769f89647c6b admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:58.205439 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d29ea1-bf88-4e6b-b521-453bff360193 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:58.211930 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3b289-3da5-4ae1-9973-6b9360c5b9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:58.212588 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3b289-3da5-4ae1-9973-6b9360c5b9f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:58.212891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3b289-3da5-4ae1-9973-6b9360c5b9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:58.213280 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3b289-3da5-4ae1-9973-6b9360c5b9f8 admin admin] PATH_INFO: `/v3/projects/5618e315b5394b8e94d58dfe8e7e7658` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:58.214417 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3b289-3da5-4ae1-9973-6b9360c5b9f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5618e315b5394b8e94d58dfe8e7e7658)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:58.216471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3b289-3da5-4ae1-9973-6b9360c5b9f8 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:58.233786 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 970/1918] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:58 2022] PUT /identity/v3/projects/3243c5f4ad3942318cba4b6948802994/users/95d62e7086cd49f8b9317fba1f7d4bc3/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:58.235807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339cc1c-facc-46ac-a9e9-8610a8ccb967 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:58.235807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339cc1c-facc-46ac-a9e9-8610a8ccb967 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:58.236041 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339cc1c-facc-46ac-a9e9-8610a8ccb967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:58.270583 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-4339cc1c-facc-46ac-a9e9-8610a8ccb967 None None] MFA Rules not processed for user `ec24ca00072646c2b3821d795cd235a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:58.271813 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-4339cc1c-facc-46ac-a9e9-8610a8ccb967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:58.342608 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 971/1919] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:58.344009 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339cc1c-facc-46ac-a9e9-8610a8ccb967 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:58.393712 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-3bd3b289-3da5-4ae1-9973-6b9360c5b9f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5618e315b5394b8e94d58dfe8e7e7658', 'request_id': 'req-3bd3b289-3da5-4ae1-9973-6b9360c5b9f8'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:58.402883 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:58.406888 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-3bd3b289-3da5-4ae1-9973-6b9360c5b9f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5618e315b5394b8e94d58dfe8e7e7658', 'request_id': 'req-3bd3b289-3da5-4ae1-9973-6b9360c5b9f8'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:58.416858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-3bd3b289-3da5-4ae1-9973-6b9360c5b9f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5618e315b5394b8e94d58dfe8e7e7658', 'request_id': 'req-3bd3b289-3da5-4ae1-9973-6b9360c5b9f8'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:58.443439 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339cc1c-facc-46ac-a9e9-8610a8ccb967 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:58.500856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-3bd3b289-3da5-4ae1-9973-6b9360c5b9f8 admin admin] The token cache is being invalidate because project 5618e315b5394b8e94d58dfe8e7e7658 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:03:58.501242 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-3bd3b289-3da5-4ae1-9973-6b9360c5b9f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:58.502979 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-3bd3b289-3da5-4ae1-9973-6b9360c5b9f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:58.509093 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 949/1920] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:03:58 2022] DELETE /identity/v3/projects/5618e315b5394b8e94d58dfe8e7e7658 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:03:58.509093 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3b289-3da5-4ae1-9973-6b9360c5b9f8 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:58.509981 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-3bd3b289-3da5-4ae1-9973-6b9360c5b9f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:58.526622 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f8afa-73ac-4201-af1d-5f947d60fe96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:58.527830 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f8afa-73ac-4201-af1d-5f947d60fe96 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:58.535685 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f8afa-73ac-4201-af1d-5f947d60fe96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:58.535685 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f8afa-73ac-4201-af1d-5f947d60fe96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:58.535685 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f8afa-73ac-4201-af1d-5f947d60fe96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:58.535685 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f8afa-73ac-4201-af1d-5f947d60fe96 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:58.550419 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 972/1921] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:58.551600 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f8afa-73ac-4201-af1d-5f947d60fe96 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:58.554142 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-107f8afa-73ac-4201-af1d-5f947d60fe96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:58.568291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f8afa-73ac-4201-af1d-5f947d60fe96 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:58.578266 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744cb0a-cac8-413e-bb42-19a30937a50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:58.579614 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744cb0a-cac8-413e-bb42-19a30937a50e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:58.580096 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744cb0a-cac8-413e-bb42-19a30937a50e admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:58.580598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744cb0a-cac8-413e-bb42-19a30937a50e admin admin] PATH_INFO: `/v3/users/e63ad27fd1a54c96851ec953018425c0` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:58.582009 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744cb0a-cac8-413e-bb42-19a30937a50e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e63ad27fd1a54c96851ec953018425c0)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:58.585143 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744cb0a-cac8-413e-bb42-19a30937a50e admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:58.600745 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3b289-3da5-4ae1-9973-6b9360c5b9f8 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:58.605774 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c33046-7fa4-46e3-bf92-33e3e4466758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:58.606389 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c33046-7fa4-46e3-bf92-33e3e4466758 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:58.607426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c33046-7fa4-46e3-bf92-33e3e4466758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:58.607426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c33046-7fa4-46e3-bf92-33e3e4466758 admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:58.607630 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c33046-7fa4-46e3-bf92-33e3e4466758 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:58.617364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c33046-7fa4-46e3-bf92-33e3e4466758 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:58.722489 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 950/1922] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:03:58 2022] POST /identity/v3/projects => generated 385 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:58.727348 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c33046-7fa4-46e3-bf92-33e3e4466758 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:58.727348 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-48c33046-7fa4-46e3-bf92-33e3e4466758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:58.795190 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-7744cb0a-cac8-413e-bb42-19a30937a50e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e63ad27fd1a54c96851ec953018425c0'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:58.796743 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-7744cb0a-cac8-413e-bb42-19a30937a50e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e63ad27fd1a54c96851ec953018425c0'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:58.802448 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-7744cb0a-cac8-413e-bb42-19a30937a50e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e63ad27fd1a54c96851ec953018425c0'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:58.803300 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c33046-7fa4-46e3-bf92-33e3e4466758 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:58.809287 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a780052-86ef-45e4-8f68-512b50b2e2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:58.809966 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a780052-86ef-45e4-8f68-512b50b2e2d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:58.810250 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a780052-86ef-45e4-8f68-512b50b2e2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:58.810524 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a780052-86ef-45e4-8f68-512b50b2e2d3 admin admin] PATH_INFO: `/v3/projects/3243c5f4ad3942318cba4b6948802994/users/95d62e7086cd49f8b9317fba1f7d4bc3/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:58.813425 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a780052-86ef-45e4-8f68-512b50b2e2d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3243c5f4ad3942318cba4b6948802994, user_id=95d62e7086cd49f8b9317fba1f7d4bc3, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:58.814412 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-7744cb0a-cac8-413e-bb42-19a30937a50e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e63ad27fd1a54c96851ec953018425c0'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:58.816055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a780052-86ef-45e4-8f68-512b50b2e2d3 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:58.827265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 951/1923] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:58 2022] PUT /identity/v3/projects/3243c5f4ad3942318cba4b6948802994/users/95d62e7086cd49f8b9317fba1f7d4bc3/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:58.836520 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a780052-86ef-45e4-8f68-512b50b2e2d3 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:58.836520 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-4a780052-86ef-45e4-8f68-512b50b2e2d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:58.900942 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-7744cb0a-cac8-413e-bb42-19a30937a50e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e63ad27fd1a54c96851ec953018425c0'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:58.907358 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a780052-86ef-45e4-8f68-512b50b2e2d3 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:58.920490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624e660-0e10-4fed-8c01-4af5aa1181ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:58.920490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624e660-0e10-4fed-8c01-4af5aa1181ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:58.920490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624e660-0e10-4fed-8c01-4af5aa1181ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:58.920490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624e660-0e10-4fed-8c01-4af5aa1181ed admin admin] PATH_INFO: `/v3/projects/f6bd19fba3b64646a7554232f7ad48b9` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:58.922484 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624e660-0e10-4fed-8c01-4af5aa1181ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6bd19fba3b64646a7554232f7ad48b9)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:58.922484 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624e660-0e10-4fed-8c01-4af5aa1181ed admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:58.953463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 973/1924] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:03:58 2022] DELETE /identity/v3/users/e63ad27fd1a54c96851ec953018425c0 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:58.953463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744cb0a-cac8-413e-bb42-19a30937a50e admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:58.953463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-7744cb0a-cac8-413e-bb42-19a30937a50e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:59.026608 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744cb0a-cac8-413e-bb42-19a30937a50e admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:59.032835 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf91de-52c7-449d-ab8b-2e463b4dbd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:59.033465 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf91de-52c7-449d-ab8b-2e463b4dbd9f admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:59.033732 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf91de-52c7-449d-ab8b-2e463b4dbd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:59.034003 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf91de-52c7-449d-ab8b-2e463b4dbd9f admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:59.034699 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf91de-52c7-449d-ab8b-2e463b4dbd9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:59.036650 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf91de-52c7-449d-ab8b-2e463b4dbd9f admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:59.153807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 974/1925] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:03:58 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:03:59.155311 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79a853-f030-4415-b85e-1929992ed2af None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:59.155600 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79a853-f030-4415-b85e-1929992ed2af None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:59.155875 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79a853-f030-4415-b85e-1929992ed2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:59.176136 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-8624e660-0e10-4fed-8c01-4af5aa1181ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6bd19fba3b64646a7554232f7ad48b9', 'request_id': 'req-8624e660-0e10-4fed-8c01-4af5aa1181ed'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:59.191580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-8624e660-0e10-4fed-8c01-4af5aa1181ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6bd19fba3b64646a7554232f7ad48b9', 'request_id': 'req-8624e660-0e10-4fed-8c01-4af5aa1181ed'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:59.203513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-8624e660-0e10-4fed-8c01-4af5aa1181ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6bd19fba3b64646a7554232f7ad48b9', 'request_id': 'req-8624e660-0e10-4fed-8c01-4af5aa1181ed'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:59.214790 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-bd79a853-f030-4415-b85e-1929992ed2af None None] MFA Rules not processed for user `95d62e7086cd49f8b9317fba1f7d4bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:03:59.216061 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-bd79a853-f030-4415-b85e-1929992ed2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:59.307439 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-8624e660-0e10-4fed-8c01-4af5aa1181ed admin admin] The token cache is being invalidate because project f6bd19fba3b64646a7554232f7ad48b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:03:59.307439 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-8624e660-0e10-4fed-8c01-4af5aa1181ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:59.307897 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-8624e660-0e10-4fed-8c01-4af5aa1181ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:59.310959 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 952/1926] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:03:58 2022] DELETE /identity/v3/projects/f6bd19fba3b64646a7554232f7ad48b9 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:59.315987 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624e660-0e10-4fed-8c01-4af5aa1181ed admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:59.317561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-8624e660-0e10-4fed-8c01-4af5aa1181ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:59.354613 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 975/1927] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:03:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:03:59.355598 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79a853-f030-4415-b85e-1929992ed2af None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:59.357058 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-bd79a853-f030-4415-b85e-1929992ed2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:59.412146 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624e660-0e10-4fed-8c01-4af5aa1181ed admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:59.417110 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14096df-c4b6-433a-8609-577b79db7fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:59.418190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14096df-c4b6-433a-8609-577b79db7fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:59.418190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14096df-c4b6-433a-8609-577b79db7fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:59.418190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14096df-c4b6-433a-8609-577b79db7fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:59.418664 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14096df-c4b6-433a-8609-577b79db7fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:59.420281 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14096df-c4b6-433a-8609-577b79db7fe8 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:59.431772 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79a853-f030-4415-b85e-1929992ed2af None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:59.432024 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 953/1928] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:59.432871 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14096df-c4b6-433a-8609-577b79db7fe8 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:59.434783 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-a14096df-c4b6-433a-8609-577b79db7fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:59.441597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf2014-2445-41dd-ae78-df23ff80f929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:59.441953 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf2014-2445-41dd-ae78-df23ff80f929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:59.442236 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf2014-2445-41dd-ae78-df23ff80f929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:59.442515 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf2014-2445-41dd-ae78-df23ff80f929 admin admin] PATH_INFO: `/v3/users/c6d478afcbb547d7934e227812207b7d` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:59.443684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf2014-2445-41dd-ae78-df23ff80f929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6d478afcbb547d7934e227812207b7d)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:59.445645 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf2014-2445-41dd-ae78-df23ff80f929 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:59.500204 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14096df-c4b6-433a-8609-577b79db7fe8 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:59.504113 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7fd288-dbf5-4ed0-ae4e-2e66d9a5bbfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:59.504765 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fd288-dbf5-4ed0-ae4e-2e66d9a5bbfd service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:59.505245 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fd288-dbf5-4ed0-ae4e-2e66d9a5bbfd service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:59.505379 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fd288-dbf5-4ed0-ae4e-2e66d9a5bbfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:59.516364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7fd288-dbf5-4ed0-ae4e-2e66d9a5bbfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:59.518085 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7fd288-dbf5-4ed0-ae4e-2e66d9a5bbfd service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:59.527705 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 954/1929] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:03:59 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:03:59.528491 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7fd288-dbf5-4ed0-ae4e-2e66d9a5bbfd service cinder] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:59.540052 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7fd288-dbf5-4ed0-ae4e-2e66d9a5bbfd service cinder] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:59.544718 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e8f00-3533-4418-9ef2-9c61d24991db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:59.545335 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e8f00-3533-4418-9ef2-9c61d24991db admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:59.545603 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e8f00-3533-4418-9ef2-9c61d24991db admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:59.546397 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e8f00-3533-4418-9ef2-9c61d24991db admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:59.547036 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e8f00-3533-4418-9ef2-9c61d24991db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:59.548656 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e8f00-3533-4418-9ef2-9c61d24991db admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:59.560677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 955/1930] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:03:59.560952 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e8f00-3533-4418-9ef2-9c61d24991db admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:59.563279 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-1e2e8f00-3533-4418-9ef2-9c61d24991db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:59.576691 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e8f00-3533-4418-9ef2-9c61d24991db admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:59.582068 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19943fa6-94bc-4386-896b-c897e8bae170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:59.582795 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19943fa6-94bc-4386-896b-c897e8bae170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:59.583079 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19943fa6-94bc-4386-896b-c897e8bae170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:59.583359 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19943fa6-94bc-4386-896b-c897e8bae170 admin admin] PATH_INFO: `/v3/projects/4d0b78c7f3ee406587bf8e7504e59e01` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:59.584732 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19943fa6-94bc-4386-896b-c897e8bae170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d0b78c7f3ee406587bf8e7504e59e01)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:59.587529 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19943fa6-94bc-4386-896b-c897e8bae170 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:59.663090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-32bf2014-2445-41dd-ae78-df23ff80f929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6d478afcbb547d7934e227812207b7d'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:59.663764 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-32bf2014-2445-41dd-ae78-df23ff80f929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6d478afcbb547d7934e227812207b7d'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:59.664369 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-32bf2014-2445-41dd-ae78-df23ff80f929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6d478afcbb547d7934e227812207b7d'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:59.677246 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-32bf2014-2445-41dd-ae78-df23ff80f929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6d478afcbb547d7934e227812207b7d'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:59.696116 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-19943fa6-94bc-4386-896b-c897e8bae170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d0b78c7f3ee406587bf8e7504e59e01', 'request_id': 'req-19943fa6-94bc-4386-896b-c897e8bae170'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:59.701658 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-19943fa6-94bc-4386-896b-c897e8bae170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d0b78c7f3ee406587bf8e7504e59e01', 'request_id': 'req-19943fa6-94bc-4386-896b-c897e8bae170'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:59.708305 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-19943fa6-94bc-4386-896b-c897e8bae170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d0b78c7f3ee406587bf8e7504e59e01', 'request_id': 'req-19943fa6-94bc-4386-896b-c897e8bae170'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:59.794217 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-32bf2014-2445-41dd-ae78-df23ff80f929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6d478afcbb547d7934e227812207b7d'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:59.809062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 976/1931] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:03:59 2022] DELETE /identity/v3/users/c6d478afcbb547d7934e227812207b7d => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:59.820241 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf2014-2445-41dd-ae78-df23ff80f929 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:59.821862 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-32bf2014-2445-41dd-ae78-df23ff80f929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:59.854566 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-19943fa6-94bc-4386-896b-c897e8bae170 admin admin] The token cache is being invalidate because project 4d0b78c7f3ee406587bf8e7504e59e01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:03:59.854865 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-19943fa6-94bc-4386-896b-c897e8bae170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:59.860605 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-19943fa6-94bc-4386-896b-c897e8bae170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:03:59.865459 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 956/1932] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:03:59 2022] DELETE /identity/v3/projects/4d0b78c7f3ee406587bf8e7504e59e01 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:03:59.865459 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19943fa6-94bc-4386-896b-c897e8bae170 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:03:59.865459 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-19943fa6-94bc-4386-896b-c897e8bae170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:03:59.917351 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf2014-2445-41dd-ae78-df23ff80f929 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:59.929726 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b8468-8f99-40c9-9e62-1aceccc94927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:59.930428 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b8468-8f99-40c9-9e62-1aceccc94927 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:59.930887 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b8468-8f99-40c9-9e62-1aceccc94927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:59.931462 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b8468-8f99-40c9-9e62-1aceccc94927 admin admin] PATH_INFO: `/v3/projects/57d2b5c361de4ea39e309bf636f7ca2c/users/5ef537d9034e439790c70a3ca4c6f8a4/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:59.973628 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b8468-8f99-40c9-9e62-1aceccc94927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57d2b5c361de4ea39e309bf636f7ca2c, user_id=5ef537d9034e439790c70a3ca4c6f8a4, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:59.976243 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b8468-8f99-40c9-9e62-1aceccc94927 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:03:59.978908 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19943fa6-94bc-4386-896b-c897e8bae170 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:03:59.987594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd151d6-89a6-4d14-bd5b-cc1eb9e90e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:03:59.989858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd151d6-89a6-4d14-bd5b-cc1eb9e90e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:03:59.989858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd151d6-89a6-4d14-bd5b-cc1eb9e90e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:03:59.989858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd151d6-89a6-4d14-bd5b-cc1eb9e90e29 admin admin] PATH_INFO: `/v3/users/a52fb4601d084fb78f6d3e3f30817a30` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:03:59.989858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd151d6-89a6-4d14-bd5b-cc1eb9e90e29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a52fb4601d084fb78f6d3e3f30817a30)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:03:59.991712 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd151d6-89a6-4d14-bd5b-cc1eb9e90e29 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:00.106982 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 977/1933] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:03:59 2022] PUT /identity/v3/projects/57d2b5c361de4ea39e309bf636f7ca2c/users/5ef537d9034e439790c70a3ca4c6f8a4/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:00.106982 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee4410-17bd-4959-906a-79130b6774f9 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:00.106982 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee4410-17bd-4959-906a-79130b6774f9 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:00.106982 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee4410-17bd-4959-906a-79130b6774f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:00.132300 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-9bee4410-17bd-4959-906a-79130b6774f9 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:00.134443 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-9bee4410-17bd-4959-906a-79130b6774f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:00.209652 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:00.230341 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 978/1934] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:00.231866 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caab4e2-2e5a-444e-8ffb-b088e30c48c2 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:00.232304 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caab4e2-2e5a-444e-8ffb-b088e30c48c2 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:00.232819 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caab4e2-2e5a-444e-8ffb-b088e30c48c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:00.260203 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-5dd151d6-89a6-4d14-bd5b-cc1eb9e90e29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a52fb4601d084fb78f6d3e3f30817a30'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:00.263911 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-0caab4e2-2e5a-444e-8ffb-b088e30c48c2 None None] MFA Rules not processed for user `5ef537d9034e439790c70a3ca4c6f8a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:00.266313 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-5dd151d6-89a6-4d14-bd5b-cc1eb9e90e29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a52fb4601d084fb78f6d3e3f30817a30'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:00.266313 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-5dd151d6-89a6-4d14-bd5b-cc1eb9e90e29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a52fb4601d084fb78f6d3e3f30817a30'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:00.266601 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-0caab4e2-2e5a-444e-8ffb-b088e30c48c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:00.311953 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:00.341540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 979/1935] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:00.343641 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f227b6f-4749-4d64-9c71-26ef2c5a494b None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:00.343812 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f227b6f-4749-4d64-9c71-26ef2c5a494b None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:00.344241 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f227b6f-4749-4d64-9c71-26ef2c5a494b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:00.352420 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-5dd151d6-89a6-4d14-bd5b-cc1eb9e90e29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a52fb4601d084fb78f6d3e3f30817a30'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:00.364867 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-5dd151d6-89a6-4d14-bd5b-cc1eb9e90e29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a52fb4601d084fb78f6d3e3f30817a30'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:00.367457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-0f227b6f-4749-4d64-9c71-26ef2c5a494b None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:00.368783 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-0f227b6f-4749-4d64-9c71-26ef2c5a494b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:00.382517 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 980/1936] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:00.383523 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f227b6f-4749-4d64-9c71-26ef2c5a494b None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:00.384988 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-0f227b6f-4749-4d64-9c71-26ef2c5a494b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:00.390342 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 957/1937] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:03:59 2022] DELETE /identity/v3/users/a52fb4601d084fb78f6d3e3f30817a30 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:00.391641 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd151d6-89a6-4d14-bd5b-cc1eb9e90e29 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:00.400650 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f227b6f-4749-4d64-9c71-26ef2c5a494b None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:00.483492 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd151d6-89a6-4d14-bd5b-cc1eb9e90e29 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:00.489270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be25e0-02e9-4226-8937-12b631c1ac0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:00.489968 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be25e0-02e9-4226-8937-12b631c1ac0a admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:00.490390 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be25e0-02e9-4226-8937-12b631c1ac0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:00.490669 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be25e0-02e9-4226-8937-12b631c1ac0a admin admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:00.491335 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be25e0-02e9-4226-8937-12b631c1ac0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:04:00.491698 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be25e0-02e9-4226-8937-12b631c1ac0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:00.493461 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be25e0-02e9-4226-8937-12b631c1ac0a admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:00.504310 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f75ec-8066-480a-88b3-f0ace7d650e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:00.504310 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f75ec-8066-480a-88b3-f0ace7d650e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:00.504310 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f75ec-8066-480a-88b3-f0ace7d650e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:00.504310 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f75ec-8066-480a-88b3-f0ace7d650e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:00.504865 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f75ec-8066-480a-88b3-f0ace7d650e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:00.511811 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f75ec-8066-480a-88b3-f0ace7d650e9 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:00.516788 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 958/1938] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:04:00.518687 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca74f6-bd34-4a2d-be63-db6444c708a6 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:00.518984 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca74f6-bd34-4a2d-be63-db6444c708a6 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:00.519316 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca74f6-bd34-4a2d-be63-db6444c708a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:00.545993 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-3dca74f6-bd34-4a2d-be63-db6444c708a6 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:00.547446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-3dca74f6-bd34-4a2d-be63-db6444c708a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:00.557770 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 959/1939] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:00.558607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca74f6-bd34-4a2d-be63-db6444c708a6 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:00.559961 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-3dca74f6-bd34-4a2d-be63-db6444c708a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:00.577807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca74f6-bd34-4a2d-be63-db6444c708a6 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:00.583235 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98d121-fa35-480d-b462-19330c8eea86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:00.583831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98d121-fa35-480d-b462-19330c8eea86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:00.584113 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98d121-fa35-480d-b462-19330c8eea86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:00.584415 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98d121-fa35-480d-b462-19330c8eea86 admin admin] PATH_INFO: `/v3/projects/b15128a96d88465cb736b4e19cf016eb` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:00.585687 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98d121-fa35-480d-b462-19330c8eea86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b15128a96d88465cb736b4e19cf016eb)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:00.587617 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98d121-fa35-480d-b462-19330c8eea86 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:00.633616 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 981/1940] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:04:00 2022] POST /identity/v3/projects => generated 385 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:00.634505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f75ec-8066-480a-88b3-f0ace7d650e9 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:00.703684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f75ec-8066-480a-88b3-f0ace7d650e9 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:00.714095 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf77c9f-0fc3-4f1f-9183-77f2b7222393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:00.714968 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf77c9f-0fc3-4f1f-9183-77f2b7222393 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:00.714968 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf77c9f-0fc3-4f1f-9183-77f2b7222393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:00.715235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf77c9f-0fc3-4f1f-9183-77f2b7222393 admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:00.715860 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf77c9f-0fc3-4f1f-9183-77f2b7222393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:00.718267 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf77c9f-0fc3-4f1f-9183-77f2b7222393 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:00.735709 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0b98d121-fa35-480d-b462-19330c8eea86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b15128a96d88465cb736b4e19cf016eb', 'request_id': 'req-0b98d121-fa35-480d-b462-19330c8eea86'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:00.741489 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0b98d121-fa35-480d-b462-19330c8eea86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b15128a96d88465cb736b4e19cf016eb', 'request_id': 'req-0b98d121-fa35-480d-b462-19330c8eea86'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:00.748507 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0b98d121-fa35-480d-b462-19330c8eea86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b15128a96d88465cb736b4e19cf016eb', 'request_id': 'req-0b98d121-fa35-480d-b462-19330c8eea86'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:00.808907 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 982/1941] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:04:00 2022] POST /identity/v3/projects => generated 407 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:00.810242 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf77c9f-0fc3-4f1f-9183-77f2b7222393 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:00.812910 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-cdf77c9f-0fc3-4f1f-9183-77f2b7222393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:00.832277 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0b98d121-fa35-480d-b462-19330c8eea86 admin admin] The token cache is being invalidate because project b15128a96d88465cb736b4e19cf016eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:04:00.832569 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0b98d121-fa35-480d-b462-19330c8eea86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:00.833275 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0b98d121-fa35-480d-b462-19330c8eea86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:00.835125 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 960/1942] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:04:00 2022] DELETE /identity/v3/projects/b15128a96d88465cb736b4e19cf016eb => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:00.835734 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98d121-fa35-480d-b462-19330c8eea86 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:00.837084 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-0b98d121-fa35-480d-b462-19330c8eea86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:00.876764 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf77c9f-0fc3-4f1f-9183-77f2b7222393 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:00.881529 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2d7b0-37c1-4169-93a0-b6c6f5c0e3dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:00.882515 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2d7b0-37c1-4169-93a0-b6c6f5c0e3dd service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:00.883022 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2d7b0-37c1-4169-93a0-b6c6f5c0e3dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:00.883390 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2d7b0-37c1-4169-93a0-b6c6f5c0e3dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:00.885690 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-eeb2d7b0-37c1-4169-93a0-b6c6f5c0e3dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:00.912997 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98d121-fa35-480d-b462-19330c8eea86 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:00.960768 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2d7b0-37c1-4169-93a0-b6c6f5c0e3dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:00.962603 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2d7b0-37c1-4169-93a0-b6c6f5c0e3dd service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:00.973864 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 983/1943] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:04:00.975098 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2d7b0-37c1-4169-93a0-b6c6f5c0e3dd service neutron] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:00.976729 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-eeb2d7b0-37c1-4169-93a0-b6c6f5c0e3dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:00.981061 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b00b2-4bec-4a2e-af23-8b3ebaff8f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:00.981921 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b00b2-4bec-4a2e-af23-8b3ebaff8f5c admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:00.982355 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b00b2-4bec-4a2e-af23-8b3ebaff8f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:00.982771 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b00b2-4bec-4a2e-af23-8b3ebaff8f5c admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:00.984439 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b00b2-4bec-4a2e-af23-8b3ebaff8f5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:00.987778 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b00b2-4bec-4a2e-af23-8b3ebaff8f5c admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:00.990469 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2d7b0-37c1-4169-93a0-b6c6f5c0e3dd service neutron] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:00.996465 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004f33d-785e-4f5a-a28b-aa01f8943057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:00.997193 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004f33d-785e-4f5a-a28b-aa01f8943057 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:00.997480 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004f33d-785e-4f5a-a28b-aa01f8943057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:00.997759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004f33d-785e-4f5a-a28b-aa01f8943057 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:00.998404 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004f33d-785e-4f5a-a28b-aa01f8943057 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:01.001351 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004f33d-785e-4f5a-a28b-aa01f8943057 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:01.092670 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 961/1944] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:04:00 2022] POST /identity/v3/users => generated 299 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:01.092670 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589ad14-f8e5-477d-b21a-f63b75a3d27d None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:01.092670 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589ad14-f8e5-477d-b21a-f63b75a3d27d None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:01.092670 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589ad14-f8e5-477d-b21a-f63b75a3d27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:01.112102 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-b589ad14-f8e5-477d-b21a-f63b75a3d27d None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:01.113357 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-b589ad14-f8e5-477d-b21a-f63b75a3d27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:01.117679 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 984/1945] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:04:00 2022] POST /identity/v3/users => generated 304 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:01.119067 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004f33d-785e-4f5a-a28b-aa01f8943057 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:01.125503 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 962/1946] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:01.132261 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589ad14-f8e5-477d-b21a-f63b75a3d27d None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:01.137440 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589ad14-f8e5-477d-b21a-f63b75a3d27d None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:01.138828 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004f33d-785e-4f5a-a28b-aa01f8943057 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:01.143731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74fad2-7de7-4a60-8cbf-7e60565cf1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:01.148236 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74fad2-7de7-4a60-8cbf-7e60565cf1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:01.148236 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74fad2-7de7-4a60-8cbf-7e60565cf1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:01.148236 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74fad2-7de7-4a60-8cbf-7e60565cf1b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:01.148236 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74fad2-7de7-4a60-8cbf-7e60565cf1b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:01.148236 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74fad2-7de7-4a60-8cbf-7e60565cf1b6 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:01.150838 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a8020-3a11-4cdd-80e5-8c0fc114150e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:01.151470 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a8020-3a11-4cdd-80e5-8c0fc114150e admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:01.151750 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a8020-3a11-4cdd-80e5-8c0fc114150e admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:01.152025 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a8020-3a11-4cdd-80e5-8c0fc114150e admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:01.152709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a8020-3a11-4cdd-80e5-8c0fc114150e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:01.154740 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a8020-3a11-4cdd-80e5-8c0fc114150e admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:01.163638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 963/1947] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:01.165205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceddcd1-dc92-4071-b6f8-4ca31d439409 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:01.165490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceddcd1-dc92-4071-b6f8-4ca31d439409 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:01.166457 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceddcd1-dc92-4071-b6f8-4ca31d439409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:01.172553 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 985/1948] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:01.173872 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a8020-3a11-4cdd-80e5-8c0fc114150e admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:01.188760 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a8020-3a11-4cdd-80e5-8c0fc114150e admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:01.190329 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-dceddcd1-dc92-4071-b6f8-4ca31d439409 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:01.191545 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-dceddcd1-dc92-4071-b6f8-4ca31d439409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:01.195033 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f03f8-2c74-4d28-a972-afbc0e68a5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:01.195729 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f03f8-2c74-4d28-a972-afbc0e68a5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:01.196181 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f03f8-2c74-4d28-a972-afbc0e68a5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:01.196562 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f03f8-2c74-4d28-a972-afbc0e68a5a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:01.197248 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f03f8-2c74-4d28-a972-afbc0e68a5a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:01.198879 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f03f8-2c74-4d28-a972-afbc0e68a5a8 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:01.200399 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 964/1949] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:01.204545 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceddcd1-dc92-4071-b6f8-4ca31d439409 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:01.213250 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 986/1950] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:01.214407 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f03f8-2c74-4d28-a972-afbc0e68a5a8 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:01.214710 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceddcd1-dc92-4071-b6f8-4ca31d439409 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:01.221660 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344059f4-f5a6-465d-80f7-fde84cf5fb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:01.222342 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344059f4-f5a6-465d-80f7-fde84cf5fb56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:01.222678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344059f4-f5a6-465d-80f7-fde84cf5fb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:01.222991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344059f4-f5a6-465d-80f7-fde84cf5fb56 admin admin] PATH_INFO: `/v3/projects/3f28c09b97d54720a3399954bee424a1/users/75716f35213f42b7889455784eb16100/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:01.228775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f03f8-2c74-4d28-a972-afbc0e68a5a8 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:01.236665 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ebc28-747d-4312-a00f-4318ea516f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:01.237695 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ebc28-747d-4312-a00f-4318ea516f9b admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:01.237987 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ebc28-747d-4312-a00f-4318ea516f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:01.238264 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ebc28-747d-4312-a00f-4318ea516f9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:01.239283 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ebc28-747d-4312-a00f-4318ea516f9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:04:01.239593 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ebc28-747d-4312-a00f-4318ea516f9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:01.241279 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ebc28-747d-4312-a00f-4318ea516f9b admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:01.242806 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344059f4-f5a6-465d-80f7-fde84cf5fb56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f28c09b97d54720a3399954bee424a1, user_id=75716f35213f42b7889455784eb16100, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:01.245968 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344059f4-f5a6-465d-80f7-fde84cf5fb56 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:01.258654 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 987/1951] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:04:01.258654 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ebc28-747d-4312-a00f-4318ea516f9b admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:01.266368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ebc28-747d-4312-a00f-4318ea516f9b admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:01.271471 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14514aeb-411f-4bfd-a7d7-266e53ebe65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:01.272136 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14514aeb-411f-4bfd-a7d7-266e53ebe65c admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:01.272433 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14514aeb-411f-4bfd-a7d7-266e53ebe65c admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:01.272735 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14514aeb-411f-4bfd-a7d7-266e53ebe65c admin admin] PATH_INFO: `/v3/projects/6b71a5c1bc0d450985c389b0e1fa027c/users/125543e5c90249e4af9d83d295de53ce/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:01.290603 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14514aeb-411f-4bfd-a7d7-266e53ebe65c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b71a5c1bc0d450985c389b0e1fa027c, user_id=125543e5c90249e4af9d83d295de53ce, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:01.293811 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14514aeb-411f-4bfd-a7d7-266e53ebe65c admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:01.324121 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 965/1952] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:01 2022] PUT /identity/v3/projects/3f28c09b97d54720a3399954bee424a1/users/75716f35213f42b7889455784eb16100/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:01.326884 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344059f4-f5a6-465d-80f7-fde84cf5fb56 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:01.382449 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:01.384441 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 988/1953] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:01 2022] PUT /identity/v3/projects/6b71a5c1bc0d450985c389b0e1fa027c/users/125543e5c90249e4af9d83d295de53ce/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:01.395106 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14514aeb-411f-4bfd-a7d7-266e53ebe65c admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:01.462270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344059f4-f5a6-465d-80f7-fde84cf5fb56 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:01.535677 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14514aeb-411f-4bfd-a7d7-266e53ebe65c admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:01.540957 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92135105-c258-4ea1-a1b1-7b5984cd1204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:01.542710 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92135105-c258-4ea1-a1b1-7b5984cd1204 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:01.542710 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92135105-c258-4ea1-a1b1-7b5984cd1204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:01.542710 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92135105-c258-4ea1-a1b1-7b5984cd1204 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:01.543391 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92135105-c258-4ea1-a1b1-7b5984cd1204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:01.545220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92135105-c258-4ea1-a1b1-7b5984cd1204 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:01.556872 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 989/1954] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:01.557635 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fc64f-79de-4616-acad-f763998ffb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:01.558261 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fc64f-79de-4616-acad-f763998ffb14 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:01.558543 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fc64f-79de-4616-acad-f763998ffb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:01.558833 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31ba1b-e041-4786-b7a3-8ce6f469e239 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:01.558948 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fc64f-79de-4616-acad-f763998ffb14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:01.559344 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31ba1b-e041-4786-b7a3-8ce6f469e239 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:01.559798 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31ba1b-e041-4786-b7a3-8ce6f469e239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:01.560020 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879fc64f-79de-4616-acad-f763998ffb14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:01.562030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879fc64f-79de-4616-acad-f763998ffb14 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:01.593562 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-ec31ba1b-e041-4786-b7a3-8ce6f469e239 None None] MFA Rules not processed for user `125543e5c90249e4af9d83d295de53ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:01.595023 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-ec31ba1b-e041-4786-b7a3-8ce6f469e239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:01.664645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 966/1955] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:04:01 2022] POST /identity/v3/projects => generated 393 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:01.665489 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fc64f-79de-4616-acad-f763998ffb14 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:01.699056 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 990/1956] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:01 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:01.700395 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31ba1b-e041-4786-b7a3-8ce6f469e239 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:01.701767 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-ec31ba1b-e041-4786-b7a3-8ce6f469e239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:01.716036 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31ba1b-e041-4786-b7a3-8ce6f469e239 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:01.743555 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fc64f-79de-4616-acad-f763998ffb14 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:01.748651 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a90715-193f-40c5-bf3c-6ac48af4dcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:01.749342 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a90715-193f-40c5-bf3c-6ac48af4dcba admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:01.749631 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a90715-193f-40c5-bf3c-6ac48af4dcba admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:01.749981 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a90715-193f-40c5-bf3c-6ac48af4dcba admin admin] PATH_INFO: `/v3/projects/3f28c09b97d54720a3399954bee424a1/users/75716f35213f42b7889455784eb16100/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:01.752398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a90715-193f-40c5-bf3c-6ac48af4dcba admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f28c09b97d54720a3399954bee424a1, user_id=75716f35213f42b7889455784eb16100, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:01.755150 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a90715-193f-40c5-bf3c-6ac48af4dcba admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:01.766376 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 967/1957] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:01 2022] PUT /identity/v3/projects/3f28c09b97d54720a3399954bee424a1/users/75716f35213f42b7889455784eb16100/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:01.775389 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a90715-193f-40c5-bf3c-6ac48af4dcba admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:01.799838 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8732648-c18b-460e-a226-987d10d294b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:01.800539 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8732648-c18b-460e-a226-987d10d294b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:01.800846 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8732648-c18b-460e-a226-987d10d294b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:01.805645 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8732648-c18b-460e-a226-987d10d294b0 admin admin] PATH_INFO: `/v3/projects/e02efd44c5f646fc9f09991c76bed18d` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:01.807671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8732648-c18b-460e-a226-987d10d294b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e02efd44c5f646fc9f09991c76bed18d)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:01.811269 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8732648-c18b-460e-a226-987d10d294b0 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:01.849490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a90715-193f-40c5-bf3c-6ac48af4dcba admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:01.855406 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c141d72-b38c-4a26-bff0-2acafc77cd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:01.856077 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c141d72-b38c-4a26-bff0-2acafc77cd29 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:01.856364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c141d72-b38c-4a26-bff0-2acafc77cd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:01.856663 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c141d72-b38c-4a26-bff0-2acafc77cd29 admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:01.857298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c141d72-b38c-4a26-bff0-2acafc77cd29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:01.860224 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c141d72-b38c-4a26-bff0-2acafc77cd29 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:01.928177 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-a8732648-c18b-460e-a226-987d10d294b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e02efd44c5f646fc9f09991c76bed18d', 'request_id': 'req-a8732648-c18b-460e-a226-987d10d294b0'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:01.948226 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 968/1958] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:04:01 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:01.948226 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c141d72-b38c-4a26-bff0-2acafc77cd29 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:01.960133 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c141d72-b38c-4a26-bff0-2acafc77cd29 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:02.018880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8baa71-d8f9-439e-a8b6-a7f4c08be49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:02.019399 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8baa71-d8f9-439e-a8b6-a7f4c08be49d admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:02.019819 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8baa71-d8f9-439e-a8b6-a7f4c08be49d admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:02.020104 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8baa71-d8f9-439e-a8b6-a7f4c08be49d admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:02.020773 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8baa71-d8f9-439e-a8b6-a7f4c08be49d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:02.022751 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8baa71-d8f9-439e-a8b6-a7f4c08be49d admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:02.035388 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-a8732648-c18b-460e-a226-987d10d294b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e02efd44c5f646fc9f09991c76bed18d', 'request_id': 'req-a8732648-c18b-460e-a226-987d10d294b0'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:02.043890 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-a8732648-c18b-460e-a226-987d10d294b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e02efd44c5f646fc9f09991c76bed18d', 'request_id': 'req-a8732648-c18b-460e-a226-987d10d294b0'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:02.055785 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-a8732648-c18b-460e-a226-987d10d294b0 admin admin] The token cache is being invalidate because project e02efd44c5f646fc9f09991c76bed18d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:04:02.056071 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-a8732648-c18b-460e-a226-987d10d294b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:02.056837 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-a8732648-c18b-460e-a226-987d10d294b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:02.058373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 991/1959] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:04:01 2022] DELETE /identity/v3/projects/e02efd44c5f646fc9f09991c76bed18d => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:02.059617 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05011ba2-5b55-4083-9b72-268bf14e9ea1 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:02.059828 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05011ba2-5b55-4083-9b72-268bf14e9ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:02.060091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05011ba2-5b55-4083-9b72-268bf14e9ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:02.089328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-05011ba2-5b55-4083-9b72-268bf14e9ea1 None None] MFA Rules not processed for user `75716f35213f42b7889455784eb16100`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:02.090522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-05011ba2-5b55-4083-9b72-268bf14e9ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:02.144905 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 969/1960] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:04:01 2022] POST /identity/v3/projects => generated 407 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:02.144905 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8baa71-d8f9-439e-a8b6-a7f4c08be49d admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:02.146225 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-0d8baa71-d8f9-439e-a8b6-a7f4c08be49d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:02.159262 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 992/1961] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:02.160780 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05011ba2-5b55-4083-9b72-268bf14e9ea1 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:02.162829 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-05011ba2-5b55-4083-9b72-268bf14e9ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:02.177842 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05011ba2-5b55-4083-9b72-268bf14e9ea1 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:02.212799 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8baa71-d8f9-439e-a8b6-a7f4c08be49d admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:02.218117 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01585e-c653-4bfc-8301-abb552653c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:02.218934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01585e-c653-4bfc-8301-abb552653c71 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:02.219484 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01585e-c653-4bfc-8301-abb552653c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:02.221134 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:02.221608 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01585e-c653-4bfc-8301-abb552653c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:02.222312 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01585e-c653-4bfc-8301-abb552653c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:02.223938 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01585e-c653-4bfc-8301-abb552653c71 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:02.237881 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 970/1962] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:02.238038 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e1c07-afa6-401c-96ca-284a9b1ff151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:02.238166 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01585e-c653-4bfc-8301-abb552653c71 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:02.238272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e1c07-afa6-401c-96ca-284a9b1ff151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:02.238272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e1c07-afa6-401c-96ca-284a9b1ff151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:02.238272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e1c07-afa6-401c-96ca-284a9b1ff151 admin admin] PATH_INFO: `/v3/users/95d62e7086cd49f8b9317fba1f7d4bc3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:02.239362 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e1c07-afa6-401c-96ca-284a9b1ff151 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95d62e7086cd49f8b9317fba1f7d4bc3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:02.240014 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-1a01585e-c653-4bfc-8301-abb552653c71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:02.241337 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e1c07-afa6-401c-96ca-284a9b1ff151 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:02.254356 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01585e-c653-4bfc-8301-abb552653c71 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:02.260192 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b577ddd-f5cd-4b4d-8ba8-89a65a989d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:02.263754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b577ddd-f5cd-4b4d-8ba8-89a65a989d77 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:02.263754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b577ddd-f5cd-4b4d-8ba8-89a65a989d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:02.263754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b577ddd-f5cd-4b4d-8ba8-89a65a989d77 admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:02.263754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b577ddd-f5cd-4b4d-8ba8-89a65a989d77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:02.264112 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b577ddd-f5cd-4b4d-8ba8-89a65a989d77 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:02.372150 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 971/1963] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:04:02 2022] POST /identity/v3/users => generated 310 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:02.372150 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b577ddd-f5cd-4b4d-8ba8-89a65a989d77 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:02.373084 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-9b577ddd-f5cd-4b4d-8ba8-89a65a989d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:02.433848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b577ddd-f5cd-4b4d-8ba8-89a65a989d77 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:02.436712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-520e1c07-afa6-401c-96ca-284a9b1ff151 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95d62e7086cd49f8b9317fba1f7d4bc3'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:02.437536 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-520e1c07-afa6-401c-96ca-284a9b1ff151 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95d62e7086cd49f8b9317fba1f7d4bc3'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:02.441186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6499729-163b-4cf5-a3b9-477a6f3ec239 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:02.441320 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-520e1c07-afa6-401c-96ca-284a9b1ff151 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95d62e7086cd49f8b9317fba1f7d4bc3'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:02.441415 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6499729-163b-4cf5-a3b9-477a6f3ec239 service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:02.441415 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6499729-163b-4cf5-a3b9-477a6f3ec239 service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:02.441415 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6499729-163b-4cf5-a3b9-477a6f3ec239 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:02.441415 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-d6499729-163b-4cf5-a3b9-477a6f3ec239 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:02.451223 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-520e1c07-afa6-401c-96ca-284a9b1ff151 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95d62e7086cd49f8b9317fba1f7d4bc3'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:02.503688 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6499729-163b-4cf5-a3b9-477a6f3ec239 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:02.505344 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6499729-163b-4cf5-a3b9-477a6f3ec239 service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:02.514774 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 972/1964] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:04:02.515669 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6499729-163b-4cf5-a3b9-477a6f3ec239 service cinder] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:02.521553 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-d6499729-163b-4cf5-a3b9-477a6f3ec239 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:02.521868 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-520e1c07-afa6-401c-96ca-284a9b1ff151 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95d62e7086cd49f8b9317fba1f7d4bc3'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:02.535445 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 993/1965] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:04:02 2022] DELETE /identity/v3/users/95d62e7086cd49f8b9317fba1f7d4bc3 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:02.535602 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6499729-163b-4cf5-a3b9-477a6f3ec239 service cinder] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:02.535708 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e1c07-afa6-401c-96ca-284a9b1ff151 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:02.535708 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-520e1c07-afa6-401c-96ca-284a9b1ff151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:02.614959 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e1c07-afa6-401c-96ca-284a9b1ff151 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:02.615964 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209d8ea-7221-48d1-ad97-58358ebd10d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:02.616802 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209d8ea-7221-48d1-ad97-58358ebd10d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:02.617087 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209d8ea-7221-48d1-ad97-58358ebd10d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:02.617362 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209d8ea-7221-48d1-ad97-58358ebd10d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:02.618011 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209d8ea-7221-48d1-ad97-58358ebd10d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:02.620946 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad27e89-7614-4d6f-85c5-1eeac2c10665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:02.621756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad27e89-7614-4d6f-85c5-1eeac2c10665 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:02.622194 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad27e89-7614-4d6f-85c5-1eeac2c10665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:02.622618 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad27e89-7614-4d6f-85c5-1eeac2c10665 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:02.623301 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209d8ea-7221-48d1-ad97-58358ebd10d1 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:02.623630 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad27e89-7614-4d6f-85c5-1eeac2c10665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:02.625486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad27e89-7614-4d6f-85c5-1eeac2c10665 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:02.636757 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 994/1966] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:02.641841 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad27e89-7614-4d6f-85c5-1eeac2c10665 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:02.647420 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 973/1967] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:02.649170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209d8ea-7221-48d1-ad97-58358ebd10d1 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:02.660420 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad27e89-7614-4d6f-85c5-1eeac2c10665 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:02.669928 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2c52b-23b3-4b0b-bb41-b2b898beeb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:02.670994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2c52b-23b3-4b0b-bb41-b2b898beeb63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:02.671432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2c52b-23b3-4b0b-bb41-b2b898beeb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:02.674981 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209d8ea-7221-48d1-ad97-58358ebd10d1 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:02.675130 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2c52b-23b3-4b0b-bb41-b2b898beeb63 admin admin] PATH_INFO: `/v3/projects/3d56a09bb3394963a8f8da2c5e23e6f3/users/24d6a9c065cd4ab0b131eaefff82de45/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:02.678278 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897973cd-02be-474a-9911-bae6309d11e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:02.679779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897973cd-02be-474a-9911-bae6309d11e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:02.679779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897973cd-02be-474a-9911-bae6309d11e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:02.679779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897973cd-02be-474a-9911-bae6309d11e9 admin admin] PATH_INFO: `/v3/projects/b6edbdf8022b40e6b0c0254c7344920e/users/0282b30fcacc4e619bfc92041193cd14/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:02.692225 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2c52b-23b3-4b0b-bb41-b2b898beeb63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d56a09bb3394963a8f8da2c5e23e6f3, user_id=24d6a9c065cd4ab0b131eaefff82de45, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:02.695621 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2c52b-23b3-4b0b-bb41-b2b898beeb63 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:02.697454 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897973cd-02be-474a-9911-bae6309d11e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6edbdf8022b40e6b0c0254c7344920e, user_id=0282b30fcacc4e619bfc92041193cd14, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:02.700454 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897973cd-02be-474a-9911-bae6309d11e9 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:02.782119 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:02.792941 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 995/1968] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:02 2022] PUT /identity/v3/projects/3d56a09bb3394963a8f8da2c5e23e6f3/users/24d6a9c065cd4ab0b131eaefff82de45/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:02.796781 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2c52b-23b3-4b0b-bb41-b2b898beeb63 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:02.805552 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 974/1969] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:02 2022] PUT /identity/v3/projects/b6edbdf8022b40e6b0c0254c7344920e/users/0282b30fcacc4e619bfc92041193cd14/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:02.822543 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c197e-a79f-488d-b19b-794b09ab4d29 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:02.822834 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c197e-a79f-488d-b19b-794b09ab4d29 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:02.823114 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c197e-a79f-488d-b19b-794b09ab4d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:02.875414 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-456c197e-a79f-488d-b19b-794b09ab4d29 None None] MFA Rules not processed for user `0282b30fcacc4e619bfc92041193cd14`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:02.876436 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-456c197e-a79f-488d-b19b-794b09ab4d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:02.886222 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2c52b-23b3-4b0b-bb41-b2b898beeb63 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:02.951270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355496ff-88c0-4851-92f8-007d5c221875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:02.952540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355496ff-88c0-4851-92f8-007d5c221875 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:02.952984 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355496ff-88c0-4851-92f8-007d5c221875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:02.953831 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355496ff-88c0-4851-92f8-007d5c221875 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:02.954211 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355496ff-88c0-4851-92f8-007d5c221875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:02.956549 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355496ff-88c0-4851-92f8-007d5c221875 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:02.971545 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 975/1970] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:02.975544 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c197e-a79f-488d-b19b-794b09ab4d29 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:02.978884 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 996/1971] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:02.979927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355496ff-88c0-4851-92f8-007d5c221875 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:02.990999 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355496ff-88c0-4851-92f8-007d5c221875 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:02.992586 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c197e-a79f-488d-b19b-794b09ab4d29 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:02.996845 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c031d39-974d-49e3-80ae-497ef696cbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:02.997595 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c031d39-974d-49e3-80ae-497ef696cbfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:02.999748 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96cb665-787c-404c-9dd2-c8be4b9e768f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:02.999884 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c031d39-974d-49e3-80ae-497ef696cbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:03.000113 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cb665-787c-404c-9dd2-c8be4b9e768f admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:03.000210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c031d39-974d-49e3-80ae-497ef696cbfc admin admin] PATH_INFO: `/v3/projects/3d56a09bb3394963a8f8da2c5e23e6f3/users/24d6a9c065cd4ab0b131eaefff82de45/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:03.000380 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cb665-787c-404c-9dd2-c8be4b9e768f admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:03.000380 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cb665-787c-404c-9dd2-c8be4b9e768f admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:03.000380 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96cb665-787c-404c-9dd2-c8be4b9e768f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:03.002039 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c031d39-974d-49e3-80ae-497ef696cbfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d56a09bb3394963a8f8da2c5e23e6f3, user_id=24d6a9c065cd4ab0b131eaefff82de45, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:03.002613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96cb665-787c-404c-9dd2-c8be4b9e768f admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:03.005488 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c031d39-974d-49e3-80ae-497ef696cbfc admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:03.017628 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 997/1972] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:02 2022] PUT /identity/v3/projects/3d56a09bb3394963a8f8da2c5e23e6f3/users/24d6a9c065cd4ab0b131eaefff82de45/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:03.027858 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed013ae7-4889-4d62-89f6-23bcf27e9b45 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:03.028328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed013ae7-4889-4d62-89f6-23bcf27e9b45 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:03.028730 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed013ae7-4889-4d62-89f6-23bcf27e9b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:03.065119 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-ed013ae7-4889-4d62-89f6-23bcf27e9b45 None None] MFA Rules not processed for user `24d6a9c065cd4ab0b131eaefff82de45`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:03.065119 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-ed013ae7-4889-4d62-89f6-23bcf27e9b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:03.132395 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 998/1973] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:03 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:04:03.143678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed013ae7-4889-4d62-89f6-23bcf27e9b45 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:03.145080 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-ed013ae7-4889-4d62-89f6-23bcf27e9b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:03.165577 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 976/1974] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:04:02 2022] POST /identity/v3/projects => generated 393 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:04:03.168937 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96cb665-787c-404c-9dd2-c8be4b9e768f admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:03.218383 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed013ae7-4889-4d62-89f6-23bcf27e9b45 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:03.239857 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96cb665-787c-404c-9dd2-c8be4b9e768f admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:03.245300 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc48ba-9a55-4b42-8400-41b4682127b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:03.245914 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc48ba-9a55-4b42-8400-41b4682127b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:03.246195 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc48ba-9a55-4b42-8400-41b4682127b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:03.246467 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc48ba-9a55-4b42-8400-41b4682127b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:03.247181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc48ba-9a55-4b42-8400-41b4682127b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:03.249996 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc48ba-9a55-4b42-8400-41b4682127b8 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:03.301220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04eb123-7cf8-4f7e-b31a-b8195e4ada3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:03.301953 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04eb123-7cf8-4f7e-b31a-b8195e4ada3d service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:03.302326 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04eb123-7cf8-4f7e-b31a-b8195e4ada3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:03.302704 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04eb123-7cf8-4f7e-b31a-b8195e4ada3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:03.370221 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04eb123-7cf8-4f7e-b31a-b8195e4ada3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:03.371570 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04eb123-7cf8-4f7e-b31a-b8195e4ada3d service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:03.381838 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 999/1975] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:03 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:04:03.382628 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04eb123-7cf8-4f7e-b31a-b8195e4ada3d service cinder] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:03.383996 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-f04eb123-7cf8-4f7e-b31a-b8195e4ada3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:03.392236 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 977/1976] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:04:03 2022] POST /identity/v3/users => generated 303 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:03.394787 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc48ba-9a55-4b42-8400-41b4682127b8 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:03.398424 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04eb123-7cf8-4f7e-b31a-b8195e4ada3d service cinder] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:03.403548 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d6adc-0963-4071-80c2-06a8bfb2788c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:03.404242 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d6adc-0963-4071-80c2-06a8bfb2788c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:03.404500 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d6adc-0963-4071-80c2-06a8bfb2788c admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:03.404849 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d6adc-0963-4071-80c2-06a8bfb2788c admin admin] PATH_INFO: `/v3/projects/3243c5f4ad3942318cba4b6948802994` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:03.406001 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d6adc-0963-4071-80c2-06a8bfb2788c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3243c5f4ad3942318cba4b6948802994)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:03.406341 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc48ba-9a55-4b42-8400-41b4682127b8 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:03.407994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d6adc-0963-4071-80c2-06a8bfb2788c admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:03.411345 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac86e2-0191-4ce0-be3e-b8021e54cc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:03.411949 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac86e2-0191-4ce0-be3e-b8021e54cc1b admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:03.412229 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac86e2-0191-4ce0-be3e-b8021e54cc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:03.412500 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac86e2-0191-4ce0-be3e-b8021e54cc1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:03.413979 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac86e2-0191-4ce0-be3e-b8021e54cc1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:03.416381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac86e2-0191-4ce0-be3e-b8021e54cc1b admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:03.441696 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 978/1977] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:03.444800 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac86e2-0191-4ce0-be3e-b8021e54cc1b admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:03.466066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac86e2-0191-4ce0-be3e-b8021e54cc1b admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:03.471490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de52fb-be2d-4a42-8059-0a6e5c37992d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:03.472579 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de52fb-be2d-4a42-8059-0a6e5c37992d admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:03.472967 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de52fb-be2d-4a42-8059-0a6e5c37992d admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:03.473311 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de52fb-be2d-4a42-8059-0a6e5c37992d admin admin] PATH_INFO: `/v3/projects/c8a804f1130f441d95a1800b05d1bce4/users/a3eaa775eea84f989d2c28f45d83cb05/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:03.490087 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de52fb-be2d-4a42-8059-0a6e5c37992d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8a804f1130f441d95a1800b05d1bce4, user_id=a3eaa775eea84f989d2c28f45d83cb05, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:03.492805 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de52fb-be2d-4a42-8059-0a6e5c37992d admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:03.608739 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 979/1978] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:03 2022] PUT /identity/v3/projects/c8a804f1130f441d95a1800b05d1bce4/users/a3eaa775eea84f989d2c28f45d83cb05/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:03.613722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de52fb-be2d-4a42-8059-0a6e5c37992d admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:03.621596 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-dc8d6adc-0963-4071-80c2-06a8bfb2788c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3243c5f4ad3942318cba4b6948802994', 'request_id': 'req-dc8d6adc-0963-4071-80c2-06a8bfb2788c'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:03.681515 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-dc8d6adc-0963-4071-80c2-06a8bfb2788c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3243c5f4ad3942318cba4b6948802994', 'request_id': 'req-dc8d6adc-0963-4071-80c2-06a8bfb2788c'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:03.682960 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de52fb-be2d-4a42-8059-0a6e5c37992d admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:03.689282 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-dc8d6adc-0963-4071-80c2-06a8bfb2788c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3243c5f4ad3942318cba4b6948802994', 'request_id': 'req-dc8d6adc-0963-4071-80c2-06a8bfb2788c'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:03.700252 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-dc8d6adc-0963-4071-80c2-06a8bfb2788c admin admin] The token cache is being invalidate because project 3243c5f4ad3942318cba4b6948802994 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:04:03.700644 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-dc8d6adc-0963-4071-80c2-06a8bfb2788c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:03.701383 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-dc8d6adc-0963-4071-80c2-06a8bfb2788c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:03.704207 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1000/1979] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:04:03 2022] DELETE /identity/v3/projects/3243c5f4ad3942318cba4b6948802994 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:03.709039 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d187ba-f889-4cab-aaae-51785da70971 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:03.712461 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d187ba-f889-4cab-aaae-51785da70971 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:03.712461 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d187ba-f889-4cab-aaae-51785da70971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:03.730168 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-73d187ba-f889-4cab-aaae-51785da70971 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:03.731448 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-73d187ba-f889-4cab-aaae-51785da70971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:03.742899 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ba768-a132-4526-a594-64086bbdb4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:03.747391 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ba768-a132-4526-a594-64086bbdb4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:03.747391 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ba768-a132-4526-a594-64086bbdb4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:03.747391 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ba768-a132-4526-a594-64086bbdb4f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:03.747391 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ba768-a132-4526-a594-64086bbdb4f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:03.747391 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ba768-a132-4526-a594-64086bbdb4f4 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:03.757092 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 980/1980] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:03.761536 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ba768-a132-4526-a594-64086bbdb4f4 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:03.763188 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-8a4ba768-a132-4526-a594-64086bbdb4f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:03.776002 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ba768-a132-4526-a594-64086bbdb4f4 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:03.780845 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acaab2a-21d5-4c80-87f6-4033495dd689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:03.781505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acaab2a-21d5-4c80-87f6-4033495dd689 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:03.781795 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acaab2a-21d5-4c80-87f6-4033495dd689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:03.782104 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acaab2a-21d5-4c80-87f6-4033495dd689 admin admin] PATH_INFO: `/v3/projects/c8a804f1130f441d95a1800b05d1bce4/users/a3eaa775eea84f989d2c28f45d83cb05/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:03.783989 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acaab2a-21d5-4c80-87f6-4033495dd689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8a804f1130f441d95a1800b05d1bce4, user_id=a3eaa775eea84f989d2c28f45d83cb05, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:03.786649 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acaab2a-21d5-4c80-87f6-4033495dd689 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:03.792292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1001/1981] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:04:03.801073 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172743e0-93fa-45f8-b3cf-6133580ffeae None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:03.801349 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172743e0-93fa-45f8-b3cf-6133580ffeae None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:03.801627 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172743e0-93fa-45f8-b3cf-6133580ffeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:03.816738 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 981/1982] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:03 2022] PUT /identity/v3/projects/c8a804f1130f441d95a1800b05d1bce4/users/a3eaa775eea84f989d2c28f45d83cb05/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:03.823149 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff13d1a-cf1b-4982-aa61-840a68c992ce None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:03.823517 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff13d1a-cf1b-4982-aa61-840a68c992ce None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:03.823861 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff13d1a-cf1b-4982-aa61-840a68c992ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:03.824330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-172743e0-93fa-45f8-b3cf-6133580ffeae None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:03.826385 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-172743e0-93fa-45f8-b3cf-6133580ffeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:03.862442 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-1ff13d1a-cf1b-4982-aa61-840a68c992ce None None] MFA Rules not processed for user `a3eaa775eea84f989d2c28f45d83cb05`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:03.863653 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-1ff13d1a-cf1b-4982-aa61-840a68c992ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:03.898718 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1002/1983] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:04:03.902995 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172743e0-93fa-45f8-b3cf-6133580ffeae None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:03.906502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-172743e0-93fa-45f8-b3cf-6133580ffeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:03.967001 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 982/1984] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:03 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:04:03.970159 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff13d1a-cf1b-4982-aa61-840a68c992ce None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:03.976556 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172743e0-93fa-45f8-b3cf-6133580ffeae None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:03.987140 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d829f-511f-4fd7-9c17-66ecec63d7e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:03.988125 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d829f-511f-4fd7-9c17-66ecec63d7e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:03.992880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d829f-511f-4fd7-9c17-66ecec63d7e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:03.992880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d829f-511f-4fd7-9c17-66ecec63d7e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:03.993131 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff13d1a-cf1b-4982-aa61-840a68c992ce None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:03.993898 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-8d6d829f-511f-4fd7-9c17-66ecec63d7e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:04.003730 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c0a39-9cc6-421c-9654-1538fa5de82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:04.005751 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c0a39-9cc6-421c-9654-1538fa5de82e admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:04.006805 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c0a39-9cc6-421c-9654-1538fa5de82e admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:04.007744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c0a39-9cc6-421c-9654-1538fa5de82e admin admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:04.009232 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c0a39-9cc6-421c-9654-1538fa5de82e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:04:04.010008 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c0a39-9cc6-421c-9654-1538fa5de82e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:04.012290 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c0a39-9cc6-421c-9654-1538fa5de82e admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:04.030801 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 983/1985] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:04:04.030801 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c0a39-9cc6-421c-9654-1538fa5de82e admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:04.031220 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-d81c0a39-9cc6-421c-9654-1538fa5de82e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:04.046612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c0a39-9cc6-421c-9654-1538fa5de82e admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:04.054382 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6fb60-9b67-4761-9170-a5877d714d25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:04.054996 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6fb60-9b67-4761-9170-a5877d714d25 service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:04.055278 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6fb60-9b67-4761-9170-a5877d714d25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:04.055579 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6fb60-9b67-4761-9170-a5877d714d25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:04.067930 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6fb60-9b67-4761-9170-a5877d714d25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:04.069442 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6fb60-9b67-4761-9170-a5877d714d25 service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:04.073335 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d829f-511f-4fd7-9c17-66ecec63d7e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:04.075059 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d829f-511f-4fd7-9c17-66ecec63d7e8 service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:04.089491 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 984/1986] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:04 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:04:04.090455 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6fb60-9b67-4761-9170-a5877d714d25 service cinder] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:04.102445 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1003/1987] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:03 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:04:04.102985 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6fb60-9b67-4761-9170-a5877d714d25 service cinder] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:04.111155 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299c1b2-f899-4066-9e58-e6312670e2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:04.112314 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299c1b2-f899-4066-9e58-e6312670e2de admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:04.113066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299c1b2-f899-4066-9e58-e6312670e2de admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:04.113470 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299c1b2-f899-4066-9e58-e6312670e2de admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:04.114265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299c1b2-f899-4066-9e58-e6312670e2de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:04.117723 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299c1b2-f899-4066-9e58-e6312670e2de admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:04.154273 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d829f-511f-4fd7-9c17-66ecec63d7e8 service cinder] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:04.163111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d829f-511f-4fd7-9c17-66ecec63d7e8 service cinder] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:04.168785 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d7322-2bcf-4504-a084-7e0d5fbca12c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:04.169795 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d7322-2bcf-4504-a084-7e0d5fbca12c service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:04.170148 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d7322-2bcf-4504-a084-7e0d5fbca12c service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:04.171028 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d7322-2bcf-4504-a084-7e0d5fbca12c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:04.173874 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-163d7322-2bcf-4504-a084-7e0d5fbca12c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:04.247799 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d7322-2bcf-4504-a084-7e0d5fbca12c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:04.249489 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d7322-2bcf-4504-a084-7e0d5fbca12c service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:04.260326 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1004/1988] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:04 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:04:04.267777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 985/1989] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:04:04 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:04.284488 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d7322-2bcf-4504-a084-7e0d5fbca12c service cinder] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:04.297235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d7322-2bcf-4504-a084-7e0d5fbca12c service cinder] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:04.367509 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ada1a0-1476-4d07-9368-1d80d44bd119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:04.368155 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ada1a0-1476-4d07-9368-1d80d44bd119 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:04.368397 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ada1a0-1476-4d07-9368-1d80d44bd119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:04.368708 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ada1a0-1476-4d07-9368-1d80d44bd119 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:04.369457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ada1a0-1476-4d07-9368-1d80d44bd119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:04.371367 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ada1a0-1476-4d07-9368-1d80d44bd119 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:04.484023 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:04.494377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1005/1990] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:04:04 2022] POST /identity/v3/users => generated 287 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:04.500177 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299c1b2-f899-4066-9e58-e6312670e2de admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:04.530577 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299c1b2-f899-4066-9e58-e6312670e2de admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:04.535457 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00817e-ac3d-4bb3-9409-580c05dbe8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:04.536061 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00817e-ac3d-4bb3-9409-580c05dbe8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:04.536335 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00817e-ac3d-4bb3-9409-580c05dbe8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:04.536605 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00817e-ac3d-4bb3-9409-580c05dbe8b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:04.537365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00817e-ac3d-4bb3-9409-580c05dbe8b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:04.538942 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00817e-ac3d-4bb3-9409-580c05dbe8b9 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:04.553685 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 986/1991] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:04.555046 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ada1a0-1476-4d07-9368-1d80d44bd119 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:04.569109 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:04.572607 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ada1a0-1476-4d07-9368-1d80d44bd119 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:04.578247 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1d280-b815-45f4-9613-e04fac4688c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:04.578841 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1d280-b815-45f4-9613-e04fac4688c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:04.579120 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1d280-b815-45f4-9613-e04fac4688c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:04.579388 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1d280-b815-45f4-9613-e04fac4688c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:04.580033 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1d280-b815-45f4-9613-e04fac4688c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:04.581654 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1d280-b815-45f4-9613-e04fac4688c9 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:04.593560 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1006/1992] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:04.598132 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00817e-ac3d-4bb3-9409-580c05dbe8b9 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:04.608912 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00817e-ac3d-4bb3-9409-580c05dbe8b9 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:04.613860 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0dac3-71db-4e85-97ea-e264c090f5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:04.614507 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0dac3-71db-4e85-97ea-e264c090f5b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:04.614791 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0dac3-71db-4e85-97ea-e264c090f5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:04.615062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0dac3-71db-4e85-97ea-e264c090f5b1 admin admin] PATH_INFO: `/v3/projects/400e41f2a63b47759d3e99b9f3959d6a/users/7366d6c9155849eca36805245401f8ae/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:04.630739 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0dac3-71db-4e85-97ea-e264c090f5b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=400e41f2a63b47759d3e99b9f3959d6a, user_id=7366d6c9155849eca36805245401f8ae, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:04.633624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0dac3-71db-4e85-97ea-e264c090f5b1 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:04.715146 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 987/1993] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:04 2022] PUT /identity/v3/projects/400e41f2a63b47759d3e99b9f3959d6a/users/7366d6c9155849eca36805245401f8ae/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:04.725673 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdde58a-fe88-4e5e-9de0-67c1518f5b80 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:04.726686 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdde58a-fe88-4e5e-9de0-67c1518f5b80 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:04.726686 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdde58a-fe88-4e5e-9de0-67c1518f5b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:04.757115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-ccdde58a-fe88-4e5e-9de0-67c1518f5b80 None None] MFA Rules not processed for user `7366d6c9155849eca36805245401f8ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:04.758318 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-ccdde58a-fe88-4e5e-9de0-67c1518f5b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:04.832659 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1007/1994] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:04.937893 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0dac3-71db-4e85-97ea-e264c090f5b1 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:04.994320 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0dac3-71db-4e85-97ea-e264c090f5b1 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:04.998024 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22bb73-dfc7-4446-88ce-94a6063d5918 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:04.999311 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22bb73-dfc7-4446-88ce-94a6063d5918 service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:04.999618 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22bb73-dfc7-4446-88ce-94a6063d5918 service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:04.999934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22bb73-dfc7-4446-88ce-94a6063d5918 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:05.010777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22bb73-dfc7-4446-88ce-94a6063d5918 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:05.012543 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22bb73-dfc7-4446-88ce-94a6063d5918 service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:05.029007 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 988/1995] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:04:05.062931 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdde58a-fe88-4e5e-9de0-67c1518f5b80 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:05.214628 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:05.261568 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdde58a-fe88-4e5e-9de0-67c1518f5b80 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:05.276977 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046af27-dbb6-431e-8a1b-655ddd9fce9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:05.277644 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046af27-dbb6-431e-8a1b-655ddd9fce9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:05.277940 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046af27-dbb6-431e-8a1b-655ddd9fce9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:05.278224 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046af27-dbb6-431e-8a1b-655ddd9fce9e admin admin] PATH_INFO: `/v3/users/7366d6c9155849eca36805245401f8ae` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:05.280672 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046af27-dbb6-431e-8a1b-655ddd9fce9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7366d6c9155849eca36805245401f8ae)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:05.282757 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046af27-dbb6-431e-8a1b-655ddd9fce9e admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:05.552195 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-0046af27-dbb6-431e-8a1b-655ddd9fce9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7366d6c9155849eca36805245401f8ae'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:05.553695 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-0046af27-dbb6-431e-8a1b-655ddd9fce9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7366d6c9155849eca36805245401f8ae'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:05.555285 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-0046af27-dbb6-431e-8a1b-655ddd9fce9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7366d6c9155849eca36805245401f8ae'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:05.588467 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-0046af27-dbb6-431e-8a1b-655ddd9fce9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7366d6c9155849eca36805245401f8ae'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:05.633397 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22bb73-dfc7-4446-88ce-94a6063d5918 service cinder] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:05.644355 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22bb73-dfc7-4446-88ce-94a6063d5918 service cinder] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:05.650848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717c861-ea12-486d-91c4-5b4ee160c8ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:05.650848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717c861-ea12-486d-91c4-5b4ee160c8ad service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:05.650848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717c861-ea12-486d-91c4-5b4ee160c8ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:05.650848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717c861-ea12-486d-91c4-5b4ee160c8ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:05.652153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e717c861-ea12-486d-91c4-5b4ee160c8ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:05.670268 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-0046af27-dbb6-431e-8a1b-655ddd9fce9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7366d6c9155849eca36805245401f8ae'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:05.689306 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1008/1996] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:04:05 2022] DELETE /identity/v3/users/7366d6c9155849eca36805245401f8ae => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:05.694459 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc0b57-6ea0-473a-a241-f3e9cb51324b None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:05.694718 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc0b57-6ea0-473a-a241-f3e9cb51324b None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:05.695002 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc0b57-6ea0-473a-a241-f3e9cb51324b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:05.719705 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-13dc0b57-6ea0-473a-a241-f3e9cb51324b None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:05.721056 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-13dc0b57-6ea0-473a-a241-f3e9cb51324b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:05.738719 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717c861-ea12-486d-91c4-5b4ee160c8ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:05.742164 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717c861-ea12-486d-91c4-5b4ee160c8ad service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:05.756484 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 989/1997] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:04:05.831827 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1009/1998] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:05.843251 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717c861-ea12-486d-91c4-5b4ee160c8ad service cinder] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:05.845077 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e717c861-ea12-486d-91c4-5b4ee160c8ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:05.914194 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717c861-ea12-486d-91c4-5b4ee160c8ad service cinder] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:05.975144 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f02566-6623-4507-abaf-05e9dea7ade0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:05.975860 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f02566-6623-4507-abaf-05e9dea7ade0 service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:05.976381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f02566-6623-4507-abaf-05e9dea7ade0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:05.976698 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f02566-6623-4507-abaf-05e9dea7ade0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:05.988970 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f02566-6623-4507-abaf-05e9dea7ade0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:05.990599 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f02566-6623-4507-abaf-05e9dea7ade0 service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:06.004475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 990/1999] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:04:06.637694 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc0b57-6ea0-473a-a241-f3e9cb51324b None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:06.640293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-13dc0b57-6ea0-473a-a241-f3e9cb51324b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:06.653680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc0b57-6ea0-473a-a241-f3e9cb51324b None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:06.659107 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3aea8a-ab15-4db0-8719-63226fdaa901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:06.661649 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3aea8a-ab15-4db0-8719-63226fdaa901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:06.661649 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3aea8a-ab15-4db0-8719-63226fdaa901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:06.661649 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3aea8a-ab15-4db0-8719-63226fdaa901 admin admin] PATH_INFO: `/v3/projects/400e41f2a63b47759d3e99b9f3959d6a` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:06.661649 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3aea8a-ab15-4db0-8719-63226fdaa901 admin admin] RBAC: Authorizing `identity:delete_project(project_id=400e41f2a63b47759d3e99b9f3959d6a)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:06.663374 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3aea8a-ab15-4db0-8719-63226fdaa901 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:06.779018 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-6e3aea8a-ab15-4db0-8719-63226fdaa901 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '400e41f2a63b47759d3e99b9f3959d6a', 'request_id': 'req-6e3aea8a-ab15-4db0-8719-63226fdaa901'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:06.818586 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:06.849595 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-6e3aea8a-ab15-4db0-8719-63226fdaa901 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '400e41f2a63b47759d3e99b9f3959d6a', 'request_id': 'req-6e3aea8a-ab15-4db0-8719-63226fdaa901'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:06.858800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-6e3aea8a-ab15-4db0-8719-63226fdaa901 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '400e41f2a63b47759d3e99b9f3959d6a', 'request_id': 'req-6e3aea8a-ab15-4db0-8719-63226fdaa901'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:06.871262 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-6e3aea8a-ab15-4db0-8719-63226fdaa901 admin admin] The token cache is being invalidate because project 400e41f2a63b47759d3e99b9f3959d6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:04:06.871894 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-6e3aea8a-ab15-4db0-8719-63226fdaa901 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:06.873014 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-6e3aea8a-ab15-4db0-8719-63226fdaa901 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:06.875376 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1010/2000] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:04:06 2022] DELETE /identity/v3/projects/400e41f2a63b47759d3e99b9f3959d6a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:06.883552 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c34008-4efe-4481-ba17-01c31723001a None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:06.892341 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c34008-4efe-4481-ba17-01c31723001a None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:06.892341 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c34008-4efe-4481-ba17-01c31723001a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:06.911385 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-70c34008-4efe-4481-ba17-01c31723001a None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:06.912485 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-70c34008-4efe-4481-ba17-01c31723001a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:07.024763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 991/2001] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:07.030079 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa9da0-1e9a-48d2-ae8e-d2477c3c9799 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:07.031682 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa9da0-1e9a-48d2-ae8e-d2477c3c9799 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:07.031682 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa9da0-1e9a-48d2-ae8e-d2477c3c9799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:07.069195 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-29aa9da0-1e9a-48d2-ae8e-d2477c3c9799 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:07.069195 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-29aa9da0-1e9a-48d2-ae8e-d2477c3c9799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:07.072157 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1011/2002] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:07.089231 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c34008-4efe-4481-ba17-01c31723001a None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:07.100657 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c34008-4efe-4481-ba17-01c31723001a None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:07.105845 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6c30b-5810-494c-996a-fb6db2a8e588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:07.106582 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6c30b-5810-494c-996a-fb6db2a8e588 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:07.106959 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6c30b-5810-494c-996a-fb6db2a8e588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:07.107363 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6c30b-5810-494c-996a-fb6db2a8e588 admin admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:07.109015 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6c30b-5810-494c-996a-fb6db2a8e588 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:04:07.109144 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6c30b-5810-494c-996a-fb6db2a8e588 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:07.111178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6c30b-5810-494c-996a-fb6db2a8e588 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:07.126195 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 992/2003] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:04:07.130442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa9da0-1e9a-48d2-ae8e-d2477c3c9799 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:07.140251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa9da0-1e9a-48d2-ae8e-d2477c3c9799 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:07.145398 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9aa366-259a-43b7-8644-67e67630a671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:07.146057 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9aa366-259a-43b7-8644-67e67630a671 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:07.146341 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9aa366-259a-43b7-8644-67e67630a671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:07.146608 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9aa366-259a-43b7-8644-67e67630a671 admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:07.147241 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9aa366-259a-43b7-8644-67e67630a671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:07.149275 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9aa366-259a-43b7-8644-67e67630a671 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:07.322585 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1012/2004] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:04:07 2022] POST /identity/v3/projects => generated 389 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:07.326500 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6c30b-5810-494c-996a-fb6db2a8e588 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:07.338890 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6c30b-5810-494c-996a-fb6db2a8e588 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:07.401433 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae8651-e464-4745-a14f-b2241d4d2a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:07.403740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae8651-e464-4745-a14f-b2241d4d2a75 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:07.403740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae8651-e464-4745-a14f-b2241d4d2a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:07.403740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae8651-e464-4745-a14f-b2241d4d2a75 admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:07.403740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ae8651-e464-4745-a14f-b2241d4d2a75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:07.405372 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ae8651-e464-4745-a14f-b2241d4d2a75 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:07.420505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:07.521572 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 993/2005] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:04:07 2022] POST /identity/v3/users => generated 295 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:07.525615 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9aa366-259a-43b7-8644-67e67630a671 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:07.540378 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9aa366-259a-43b7-8644-67e67630a671 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:07.559826 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d923b-dd74-4c97-b07a-e833e3225ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:07.560455 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d923b-dd74-4c97-b07a-e833e3225ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:07.560762 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d923b-dd74-4c97-b07a-e833e3225ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:07.561144 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d923b-dd74-4c97-b07a-e833e3225ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:07.562934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d923b-dd74-4c97-b07a-e833e3225ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:07.565182 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d923b-dd74-4c97-b07a-e833e3225ee3 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:07.588894 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1013/2006] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:07.592746 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae8651-e464-4745-a14f-b2241d4d2a75 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:07.603725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae8651-e464-4745-a14f-b2241d4d2a75 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:07.623156 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67609e24-095b-42f4-b43d-e0827a1d183d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:07.623156 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67609e24-095b-42f4-b43d-e0827a1d183d admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:07.623156 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67609e24-095b-42f4-b43d-e0827a1d183d admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:07.623156 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67609e24-095b-42f4-b43d-e0827a1d183d admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:07.623491 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67609e24-095b-42f4-b43d-e0827a1d183d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:07.623491 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67609e24-095b-42f4-b43d-e0827a1d183d admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:07.630418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 994/2007] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:07.631842 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d923b-dd74-4c97-b07a-e833e3225ee3 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:07.647298 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d923b-dd74-4c97-b07a-e833e3225ee3 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:07.648876 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3fd706-e9f7-4400-a959-fdaa28776ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:07.650495 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fd706-e9f7-4400-a959-fdaa28776ca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:07.655226 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fd706-e9f7-4400-a959-fdaa28776ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:07.655444 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fd706-e9f7-4400-a959-fdaa28776ca9 admin admin] PATH_INFO: `/v3/projects/bdf7834bb0cf484c911133f10733ae1d/users/8696e92665314e3d9fdb23e68aa4ec45/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:07.674248 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3fd706-e9f7-4400-a959-fdaa28776ca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf7834bb0cf484c911133f10733ae1d, user_id=8696e92665314e3d9fdb23e68aa4ec45, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:07.683147 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3fd706-e9f7-4400-a959-fdaa28776ca9 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:07.750324 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67609e24-095b-42f4-b43d-e0827a1d183d admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:07.752097 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-67609e24-095b-42f4-b43d-e0827a1d183d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:07.770072 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1014/2008] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:07 2022] PUT /identity/v3/projects/bdf7834bb0cf484c911133f10733ae1d/users/8696e92665314e3d9fdb23e68aa4ec45/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:07.782473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63b9a3-c0f8-4855-8088-17587a68f643 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:07.782997 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63b9a3-c0f8-4855-8088-17587a68f643 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:07.783487 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63b9a3-c0f8-4855-8088-17587a68f643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:07.816317 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-2f63b9a3-c0f8-4855-8088-17587a68f643 None None] MFA Rules not processed for user `8696e92665314e3d9fdb23e68aa4ec45`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:07.817643 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-2f63b9a3-c0f8-4855-8088-17587a68f643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:07.818454 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67609e24-095b-42f4-b43d-e0827a1d183d admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:07.876252 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475cdeb-b232-4ed9-92a0-c15f5bc3cf25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:07.877252 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475cdeb-b232-4ed9-92a0-c15f5bc3cf25 service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:07.877469 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475cdeb-b232-4ed9-92a0-c15f5bc3cf25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:07.877737 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475cdeb-b232-4ed9-92a0-c15f5bc3cf25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:07.879578 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-a475cdeb-b232-4ed9-92a0-c15f5bc3cf25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:07.913926 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1015/2009] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:07.951572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63b9a3-c0f8-4855-8088-17587a68f643 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:07.953641 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-2f63b9a3-c0f8-4855-8088-17587a68f643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:07.965551 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63b9a3-c0f8-4855-8088-17587a68f643 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:07.970452 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026bba9c-bcb3-4a73-aea7-6b979693fd32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:07.971067 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bba9c-bcb3-4a73-aea7-6b979693fd32 service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:07.971349 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bba9c-bcb3-4a73-aea7-6b979693fd32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:07.971620 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bba9c-bcb3-4a73-aea7-6b979693fd32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:07.971804 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475cdeb-b232-4ed9-92a0-c15f5bc3cf25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:07.973317 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475cdeb-b232-4ed9-92a0-c15f5bc3cf25 service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:07.980216 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026bba9c-bcb3-4a73-aea7-6b979693fd32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:07.981733 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026bba9c-bcb3-4a73-aea7-6b979693fd32 service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:07.984045 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 995/2010] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:07 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:04:07.992908 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1016/2011] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:07 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:04:09.305926 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:09.597519 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:11.804109 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:11.822742 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475cdeb-b232-4ed9-92a0-c15f5bc3cf25 service cinder] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:11.824347 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-a475cdeb-b232-4ed9-92a0-c15f5bc3cf25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:11.956944 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475cdeb-b232-4ed9-92a0-c15f5bc3cf25 service cinder] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:11.961456 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced0af1-2898-4acc-84a3-ae570de7008e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:11.962083 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced0af1-2898-4acc-84a3-ae570de7008e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:11.962359 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced0af1-2898-4acc-84a3-ae570de7008e admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:11.962630 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced0af1-2898-4acc-84a3-ae570de7008e admin admin] PATH_INFO: `/v3/users/0282b30fcacc4e619bfc92041193cd14` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:11.963733 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced0af1-2898-4acc-84a3-ae570de7008e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0282b30fcacc4e619bfc92041193cd14)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:11.965677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced0af1-2898-4acc-84a3-ae570de7008e admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:12.006409 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:12.171046 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0ced0af1-2898-4acc-84a3-ae570de7008e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0282b30fcacc4e619bfc92041193cd14'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:12.173499 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0ced0af1-2898-4acc-84a3-ae570de7008e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0282b30fcacc4e619bfc92041193cd14'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:12.174196 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0ced0af1-2898-4acc-84a3-ae570de7008e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0282b30fcacc4e619bfc92041193cd14'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:12.257704 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0ced0af1-2898-4acc-84a3-ae570de7008e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0282b30fcacc4e619bfc92041193cd14'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:12.267131 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0ced0af1-2898-4acc-84a3-ae570de7008e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0282b30fcacc4e619bfc92041193cd14'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:12.297490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 996/2012] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:04:11 2022] DELETE /identity/v3/users/0282b30fcacc4e619bfc92041193cd14 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:12.303603 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dca2b5-5fe9-462f-a557-bc702c57bbcd None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:12.304006 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dca2b5-5fe9-462f-a557-bc702c57bbcd None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:12.304289 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dca2b5-5fe9-462f-a557-bc702c57bbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:12.324526 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-25dca2b5-5fe9-462f-a557-bc702c57bbcd None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:12.326148 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-25dca2b5-5fe9-462f-a557-bc702c57bbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:12.413850 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1017/2013] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:12.436747 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced0af1-2898-4acc-84a3-ae570de7008e admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:12.436747 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-0ced0af1-2898-4acc-84a3-ae570de7008e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:12.547549 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced0af1-2898-4acc-84a3-ae570de7008e admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:12.552011 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa972b0c-d175-4d68-a47d-e79470428c6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:12.553519 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa972b0c-d175-4d68-a47d-e79470428c6b service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:12.553519 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa972b0c-d175-4d68-a47d-e79470428c6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:12.553519 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa972b0c-d175-4d68-a47d-e79470428c6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:12.565021 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa972b0c-d175-4d68-a47d-e79470428c6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:12.567401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa972b0c-d175-4d68-a47d-e79470428c6b service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:12.586871 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 997/2014] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:04:13.141703 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dca2b5-5fe9-462f-a557-bc702c57bbcd None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:13.143982 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-25dca2b5-5fe9-462f-a557-bc702c57bbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:13.159615 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dca2b5-5fe9-462f-a557-bc702c57bbcd None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:13.165202 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9fcc0-bd14-46be-baac-d941c1d17334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:13.166127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9fcc0-bd14-46be-baac-d941c1d17334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:13.166511 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9fcc0-bd14-46be-baac-d941c1d17334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:13.166848 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9fcc0-bd14-46be-baac-d941c1d17334 admin admin] PATH_INFO: `/v3/users/125543e5c90249e4af9d83d295de53ce` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:13.168386 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9fcc0-bd14-46be-baac-d941c1d17334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=125543e5c90249e4af9d83d295de53ce)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:13.171488 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9fcc0-bd14-46be-baac-d941c1d17334 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:13.293251 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa972b0c-d175-4d68-a47d-e79470428c6b service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:13.296167 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-aa972b0c-d175-4d68-a47d-e79470428c6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:13.316115 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa972b0c-d175-4d68-a47d-e79470428c6b service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:13.321008 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6aff35-580a-48df-83ef-a762e81a62db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:13.321645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6aff35-580a-48df-83ef-a762e81a62db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:13.321928 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6aff35-580a-48df-83ef-a762e81a62db admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:13.322201 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6aff35-580a-48df-83ef-a762e81a62db admin admin] PATH_INFO: `/v3/users/ec24ca00072646c2b3821d795cd235a4` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:13.323362 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6aff35-580a-48df-83ef-a762e81a62db admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec24ca00072646c2b3821d795cd235a4)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:13.325331 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6aff35-580a-48df-83ef-a762e81a62db admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:13.435076 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-2af9fcc0-bd14-46be-baac-d941c1d17334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '125543e5c90249e4af9d83d295de53ce'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:13.438722 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-2af9fcc0-bd14-46be-baac-d941c1d17334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '125543e5c90249e4af9d83d295de53ce'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:13.441917 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-2af9fcc0-bd14-46be-baac-d941c1d17334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '125543e5c90249e4af9d83d295de53ce'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:13.459246 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-2af9fcc0-bd14-46be-baac-d941c1d17334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '125543e5c90249e4af9d83d295de53ce'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:13.543728 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-2af9fcc0-bd14-46be-baac-d941c1d17334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '125543e5c90249e4af9d83d295de53ce'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:13.560283 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-df6aff35-580a-48df-83ef-a762e81a62db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec24ca00072646c2b3821d795cd235a4'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:13.561168 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-df6aff35-580a-48df-83ef-a762e81a62db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec24ca00072646c2b3821d795cd235a4'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:13.561821 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-df6aff35-580a-48df-83ef-a762e81a62db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec24ca00072646c2b3821d795cd235a4'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:13.575821 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1018/2015] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:04:13 2022] DELETE /identity/v3/users/125543e5c90249e4af9d83d295de53ce => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:04:13.576875 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9fcc0-bd14-46be-baac-d941c1d17334 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:13.578670 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-2af9fcc0-bd14-46be-baac-d941c1d17334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:13.645606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9fcc0-bd14-46be-baac-d941c1d17334 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:13.650563 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa904e5-29f4-46f8-883f-596e7d8c2702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:13.651223 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa904e5-29f4-46f8-883f-596e7d8c2702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:13.651553 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa904e5-29f4-46f8-883f-596e7d8c2702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:13.651831 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa904e5-29f4-46f8-883f-596e7d8c2702 admin admin] PATH_INFO: `/v3/projects/b6edbdf8022b40e6b0c0254c7344920e` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:13.653027 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa904e5-29f4-46f8-883f-596e7d8c2702 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6edbdf8022b40e6b0c0254c7344920e)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:13.657590 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa904e5-29f4-46f8-883f-596e7d8c2702 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:13.676969 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-df6aff35-580a-48df-83ef-a762e81a62db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec24ca00072646c2b3821d795cd235a4'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:13.688284 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-df6aff35-580a-48df-83ef-a762e81a62db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec24ca00072646c2b3821d795cd235a4'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:13.710132 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 998/2016] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:04:13 2022] DELETE /identity/v3/users/ec24ca00072646c2b3821d795cd235a4 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:04:13.713428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62367d-6e40-4716-937f-20a9d53a31c6 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:13.713428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62367d-6e40-4716-937f-20a9d53a31c6 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:13.713428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62367d-6e40-4716-937f-20a9d53a31c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:13.732579 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-3b62367d-6e40-4716-937f-20a9d53a31c6 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:13.733871 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-3b62367d-6e40-4716-937f-20a9d53a31c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:13.776554 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-aaa904e5-29f4-46f8-883f-596e7d8c2702 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6edbdf8022b40e6b0c0254c7344920e', 'request_id': 'req-aaa904e5-29f4-46f8-883f-596e7d8c2702'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:13.802567 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 999/2017] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:13.804107 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e36990-82dc-4159-8a0f-5c1520fb0e95 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:13.804406 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e36990-82dc-4159-8a0f-5c1520fb0e95 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:13.804718 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e36990-82dc-4159-8a0f-5c1520fb0e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:13.823621 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-a4e36990-82dc-4159-8a0f-5c1520fb0e95 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:13.824915 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-a4e36990-82dc-4159-8a0f-5c1520fb0e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:13.843032 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-aaa904e5-29f4-46f8-883f-596e7d8c2702 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6edbdf8022b40e6b0c0254c7344920e', 'request_id': 'req-aaa904e5-29f4-46f8-883f-596e7d8c2702'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:13.851288 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-aaa904e5-29f4-46f8-883f-596e7d8c2702 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6edbdf8022b40e6b0c0254c7344920e', 'request_id': 'req-aaa904e5-29f4-46f8-883f-596e7d8c2702'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:13.862321 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-aaa904e5-29f4-46f8-883f-596e7d8c2702 admin admin] The token cache is being invalidate because project b6edbdf8022b40e6b0c0254c7344920e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:04:13.862615 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-aaa904e5-29f4-46f8-883f-596e7d8c2702 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:13.863292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-aaa904e5-29f4-46f8-883f-596e7d8c2702 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:13.864903 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1019/2018] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:04:13 2022] DELETE /identity/v3/projects/b6edbdf8022b40e6b0c0254c7344920e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:13.865685 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa904e5-29f4-46f8-883f-596e7d8c2702 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:13.866963 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-aaa904e5-29f4-46f8-883f-596e7d8c2702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:13.893340 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1000/2019] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:13.894314 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e36990-82dc-4159-8a0f-5c1520fb0e95 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:13.896258 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-a4e36990-82dc-4159-8a0f-5c1520fb0e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:13.910462 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e36990-82dc-4159-8a0f-5c1520fb0e95 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:13.915047 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7b0b5-5b44-48a9-9e02-44ab0b14febf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:13.915695 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7b0b5-5b44-48a9-9e02-44ab0b14febf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:13.916070 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7b0b5-5b44-48a9-9e02-44ab0b14febf admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:13.916352 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7b0b5-5b44-48a9-9e02-44ab0b14febf admin admin] PATH_INFO: `/v3/users/a3eaa775eea84f989d2c28f45d83cb05` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:13.917512 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7b0b5-5b44-48a9-9e02-44ab0b14febf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3eaa775eea84f989d2c28f45d83cb05)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:13.919430 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7b0b5-5b44-48a9-9e02-44ab0b14febf admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:13.929202 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa904e5-29f4-46f8-883f-596e7d8c2702 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:13.933031 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609609c-953c-4dd4-80bd-b3ea7b8ada2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:13.933640 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609609c-953c-4dd4-80bd-b3ea7b8ada2d service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:13.933926 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609609c-953c-4dd4-80bd-b3ea7b8ada2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:13.934200 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609609c-953c-4dd4-80bd-b3ea7b8ada2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:13.936124 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-e609609c-953c-4dd4-80bd-b3ea7b8ada2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:13.948692 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609609c-953c-4dd4-80bd-b3ea7b8ada2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:13.950153 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609609c-953c-4dd4-80bd-b3ea7b8ada2d service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:13.960754 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1020/2020] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:04:13.961540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609609c-953c-4dd4-80bd-b3ea7b8ada2d service neutron] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:13.962853 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-e609609c-953c-4dd4-80bd-b3ea7b8ada2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:13.974403 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609609c-953c-4dd4-80bd-b3ea7b8ada2d service neutron] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:13.978320 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc747b-42d1-4fe7-9864-73a7606872b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:13.979036 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc747b-42d1-4fe7-9864-73a7606872b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:13.979319 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc747b-42d1-4fe7-9864-73a7606872b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:13.979593 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc747b-42d1-4fe7-9864-73a7606872b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:13.990318 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:13.991291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc747b-42d1-4fe7-9864-73a7606872b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:13.992856 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc747b-42d1-4fe7-9864-73a7606872b8 service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:14.003795 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1021/2021] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:04:14.265580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-5cb7b0b5-5b44-48a9-9e02-44ab0b14febf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3eaa775eea84f989d2c28f45d83cb05'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:14.266213 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-5cb7b0b5-5b44-48a9-9e02-44ab0b14febf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3eaa775eea84f989d2c28f45d83cb05'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:14.266966 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-5cb7b0b5-5b44-48a9-9e02-44ab0b14febf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3eaa775eea84f989d2c28f45d83cb05'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:14.374389 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-5cb7b0b5-5b44-48a9-9e02-44ab0b14febf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3eaa775eea84f989d2c28f45d83cb05'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:14.383014 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-5cb7b0b5-5b44-48a9-9e02-44ab0b14febf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3eaa775eea84f989d2c28f45d83cb05'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:14.402068 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1001/2022] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:04:13 2022] DELETE /identity/v3/users/a3eaa775eea84f989d2c28f45d83cb05 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:14.406642 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:14.530255 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc747b-42d1-4fe7-9864-73a7606872b8 service neutron] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:14.532133 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-27cc747b-42d1-4fe7-9864-73a7606872b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:14.553525 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc747b-42d1-4fe7-9864-73a7606872b8 service neutron] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:14.594874 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7b0b5-5b44-48a9-9e02-44ab0b14febf admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:14.597786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-5cb7b0b5-5b44-48a9-9e02-44ab0b14febf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:14.641201 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e5798-1244-473f-9d92-9aad7e222dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:14.642159 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e5798-1244-473f-9d92-9aad7e222dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:14.643005 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e5798-1244-473f-9d92-9aad7e222dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:14.645163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e5798-1244-473f-9d92-9aad7e222dcd admin admin] PATH_INFO: `/v3/projects/6b71a5c1bc0d450985c389b0e1fa027c` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:14.647235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e5798-1244-473f-9d92-9aad7e222dcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b71a5c1bc0d450985c389b0e1fa027c)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:14.650072 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e5798-1244-473f-9d92-9aad7e222dcd admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:14.712749 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7b0b5-5b44-48a9-9e02-44ab0b14febf admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:14.718029 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e40af-5805-444e-b74a-6077b0abc615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:14.724798 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e40af-5805-444e-b74a-6077b0abc615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:14.724798 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e40af-5805-444e-b74a-6077b0abc615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:14.724798 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e40af-5805-444e-b74a-6077b0abc615 admin admin] PATH_INFO: `/v3/projects/17c8d3185ba646f5abaeac13f3fb8012` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:14.724798 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e40af-5805-444e-b74a-6077b0abc615 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17c8d3185ba646f5abaeac13f3fb8012)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:14.724798 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e40af-5805-444e-b74a-6077b0abc615 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:14.774907 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-578e5798-1244-473f-9d92-9aad7e222dcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b71a5c1bc0d450985c389b0e1fa027c', 'request_id': 'req-578e5798-1244-473f-9d92-9aad7e222dcd'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:14.850098 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-470e40af-5805-444e-b74a-6077b0abc615 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17c8d3185ba646f5abaeac13f3fb8012', 'request_id': 'req-470e40af-5805-444e-b74a-6077b0abc615'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:14.861654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-470e40af-5805-444e-b74a-6077b0abc615 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17c8d3185ba646f5abaeac13f3fb8012', 'request_id': 'req-470e40af-5805-444e-b74a-6077b0abc615'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:14.863399 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-578e5798-1244-473f-9d92-9aad7e222dcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b71a5c1bc0d450985c389b0e1fa027c', 'request_id': 'req-578e5798-1244-473f-9d92-9aad7e222dcd'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:14.874603 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-470e40af-5805-444e-b74a-6077b0abc615 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17c8d3185ba646f5abaeac13f3fb8012', 'request_id': 'req-470e40af-5805-444e-b74a-6077b0abc615'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:14.874796 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-578e5798-1244-473f-9d92-9aad7e222dcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b71a5c1bc0d450985c389b0e1fa027c', 'request_id': 'req-578e5798-1244-473f-9d92-9aad7e222dcd'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:14.886678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-578e5798-1244-473f-9d92-9aad7e222dcd admin admin] The token cache is being invalidate because project 6b71a5c1bc0d450985c389b0e1fa027c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:04:14.887208 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-578e5798-1244-473f-9d92-9aad7e222dcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:14.888099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-578e5798-1244-473f-9d92-9aad7e222dcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:14.890505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1022/2023] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:04:14 2022] DELETE /identity/v3/projects/6b71a5c1bc0d450985c389b0e1fa027c => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:14.894457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e5798-1244-473f-9d92-9aad7e222dcd admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:14.896756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-578e5798-1244-473f-9d92-9aad7e222dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:14.965273 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e5798-1244-473f-9d92-9aad7e222dcd admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:15.008489 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-470e40af-5805-444e-b74a-6077b0abc615 admin admin] The token cache is being invalidate because project 17c8d3185ba646f5abaeac13f3fb8012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:04:15.008819 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-470e40af-5805-444e-b74a-6077b0abc615 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:15.009470 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-470e40af-5805-444e-b74a-6077b0abc615 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:15.014590 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1002/2024] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:04:14 2022] DELETE /identity/v3/projects/17c8d3185ba646f5abaeac13f3fb8012 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:15.027978 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e40af-5805-444e-b74a-6077b0abc615 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:15.028087 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736f76d-c4a0-4a8d-a91b-79909bb84e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:15.028596 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736f76d-c4a0-4a8d-a91b-79909bb84e21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:15.028909 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736f76d-c4a0-4a8d-a91b-79909bb84e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:15.029182 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736f76d-c4a0-4a8d-a91b-79909bb84e21 admin admin] PATH_INFO: `/v3/users/24d6a9c065cd4ab0b131eaefff82de45` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:15.029272 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-470e40af-5805-444e-b74a-6077b0abc615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:15.032121 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3736f76d-c4a0-4a8d-a91b-79909bb84e21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24d6a9c065cd4ab0b131eaefff82de45)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:15.034449 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3736f76d-c4a0-4a8d-a91b-79909bb84e21 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:15.046725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e40af-5805-444e-b74a-6077b0abc615 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:15.051517 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4673c2-62a9-411d-8970-2632b630dc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:15.052163 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4673c2-62a9-411d-8970-2632b630dc23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:15.052457 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4673c2-62a9-411d-8970-2632b630dc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:15.052761 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4673c2-62a9-411d-8970-2632b630dc23 admin admin] PATH_INFO: `/v3/users/5ef537d9034e439790c70a3ca4c6f8a4` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:15.053942 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4673c2-62a9-411d-8970-2632b630dc23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ef537d9034e439790c70a3ca4c6f8a4)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:15.055987 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4673c2-62a9-411d-8970-2632b630dc23 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:15.248965 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-3736f76d-c4a0-4a8d-a91b-79909bb84e21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24d6a9c065cd4ab0b131eaefff82de45'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:15.249747 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-3736f76d-c4a0-4a8d-a91b-79909bb84e21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24d6a9c065cd4ab0b131eaefff82de45'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:15.250127 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-4c4673c2-62a9-411d-8970-2632b630dc23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ef537d9034e439790c70a3ca4c6f8a4'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:15.250421 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-3736f76d-c4a0-4a8d-a91b-79909bb84e21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24d6a9c065cd4ab0b131eaefff82de45'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:15.250790 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-4c4673c2-62a9-411d-8970-2632b630dc23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ef537d9034e439790c70a3ca4c6f8a4'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:15.251436 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-4c4673c2-62a9-411d-8970-2632b630dc23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ef537d9034e439790c70a3ca4c6f8a4'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:15.262156 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-3736f76d-c4a0-4a8d-a91b-79909bb84e21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24d6a9c065cd4ab0b131eaefff82de45'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:15.328275 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-4c4673c2-62a9-411d-8970-2632b630dc23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ef537d9034e439790c70a3ca4c6f8a4'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:15.335817 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-4c4673c2-62a9-411d-8970-2632b630dc23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ef537d9034e439790c70a3ca4c6f8a4'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:15.353644 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1003/2025] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:04:15 2022] DELETE /identity/v3/users/5ef537d9034e439790c70a3ca4c6f8a4 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:15.356864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4673c2-62a9-411d-8970-2632b630dc23 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:15.356864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-4c4673c2-62a9-411d-8970-2632b630dc23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:15.407734 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-3736f76d-c4a0-4a8d-a91b-79909bb84e21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24d6a9c065cd4ab0b131eaefff82de45'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:15.424861 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4673c2-62a9-411d-8970-2632b630dc23 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:15.428839 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1023/2026] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:04:14 2022] DELETE /identity/v3/users/24d6a9c065cd4ab0b131eaefff82de45 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:04:15.486662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045812e8-dfe5-4cf9-b953-34c3c585a900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:15.487305 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045812e8-dfe5-4cf9-b953-34c3c585a900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:15.487585 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045812e8-dfe5-4cf9-b953-34c3c585a900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:15.487863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045812e8-dfe5-4cf9-b953-34c3c585a900 admin admin] PATH_INFO: `/v3/projects/c8a804f1130f441d95a1800b05d1bce4` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:15.489032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045812e8-dfe5-4cf9-b953-34c3c585a900 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8a804f1130f441d95a1800b05d1bce4)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:15.490937 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045812e8-dfe5-4cf9-b953-34c3c585a900 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:15.615098 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-045812e8-dfe5-4cf9-b953-34c3c585a900 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8a804f1130f441d95a1800b05d1bce4', 'request_id': 'req-045812e8-dfe5-4cf9-b953-34c3c585a900'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:15.620577 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-045812e8-dfe5-4cf9-b953-34c3c585a900 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8a804f1130f441d95a1800b05d1bce4', 'request_id': 'req-045812e8-dfe5-4cf9-b953-34c3c585a900'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:15.628419 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-045812e8-dfe5-4cf9-b953-34c3c585a900 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8a804f1130f441d95a1800b05d1bce4', 'request_id': 'req-045812e8-dfe5-4cf9-b953-34c3c585a900'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:15.699668 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-045812e8-dfe5-4cf9-b953-34c3c585a900 admin admin] The token cache is being invalidate because project c8a804f1130f441d95a1800b05d1bce4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:04:15.700029 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-045812e8-dfe5-4cf9-b953-34c3c585a900 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:15.700720 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-045812e8-dfe5-4cf9-b953-34c3c585a900 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:15.703028 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1004/2027] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:04:15 2022] DELETE /identity/v3/projects/c8a804f1130f441d95a1800b05d1bce4 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:15.708451 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38963846-94fa-480c-90fe-706bcfbb26e7 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:15.708976 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38963846-94fa-480c-90fe-706bcfbb26e7 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:15.709078 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38963846-94fa-480c-90fe-706bcfbb26e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:15.730488 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-38963846-94fa-480c-90fe-706bcfbb26e7 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:15.731729 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-38963846-94fa-480c-90fe-706bcfbb26e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:15.793901 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1024/2028] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:15.802889 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae8ca1-b723-4dcf-8546-73bfdd2f47ae None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:15.803305 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae8ca1-b723-4dcf-8546-73bfdd2f47ae None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:15.803652 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae8ca1-b723-4dcf-8546-73bfdd2f47ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:15.825418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-7cae8ca1-b723-4dcf-8546-73bfdd2f47ae None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:15.827619 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-7cae8ca1-b723-4dcf-8546-73bfdd2f47ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:15.841264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1005/2029] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:15.841399 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38963846-94fa-480c-90fe-706bcfbb26e7 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:15.846403 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-38963846-94fa-480c-90fe-706bcfbb26e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:15.847494 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae8ca1-b723-4dcf-8546-73bfdd2f47ae None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:15.857170 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38963846-94fa-480c-90fe-706bcfbb26e7 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:15.863541 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c717a9b-5104-40dc-b91c-1d696d594184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:15.864307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c717a9b-5104-40dc-b91c-1d696d594184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:15.864720 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c717a9b-5104-40dc-b91c-1d696d594184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:15.865092 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c717a9b-5104-40dc-b91c-1d696d594184 admin admin] PATH_INFO: `/v3/projects/57d2b5c361de4ea39e309bf636f7ca2c` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:15.866331 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c717a9b-5104-40dc-b91c-1d696d594184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57d2b5c361de4ea39e309bf636f7ca2c)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:15.868445 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c717a9b-5104-40dc-b91c-1d696d594184 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:15.871949 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae8ca1-b723-4dcf-8546-73bfdd2f47ae None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:15.878930 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd421b-3204-4250-b465-8e6ec23725bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:15.879612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd421b-3204-4250-b465-8e6ec23725bf admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:15.879931 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd421b-3204-4250-b465-8e6ec23725bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:15.880245 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd421b-3204-4250-b465-8e6ec23725bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:15.881053 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd421b-3204-4250-b465-8e6ec23725bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:04:15.881928 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd421b-3204-4250-b465-8e6ec23725bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:15.883867 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd421b-3204-4250-b465-8e6ec23725bf admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:15.900695 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1006/2030] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:04:15.903936 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd421b-3204-4250-b465-8e6ec23725bf admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:15.914882 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd421b-3204-4250-b465-8e6ec23725bf admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:15.919894 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c0556-30d7-491a-887f-e7f91538527f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:15.921441 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c0556-30d7-491a-887f-e7f91538527f admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:15.921664 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c0556-30d7-491a-887f-e7f91538527f admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:15.921975 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c0556-30d7-491a-887f-e7f91538527f admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:15.922630 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c0556-30d7-491a-887f-e7f91538527f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:15.924582 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c0556-30d7-491a-887f-e7f91538527f admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:15.997940 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-1c717a9b-5104-40dc-b91c-1d696d594184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57d2b5c361de4ea39e309bf636f7ca2c', 'request_id': 'req-1c717a9b-5104-40dc-b91c-1d696d594184'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:16.015097 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:16.034196 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1007/2031] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:04:15 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:04:16.035427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c0556-30d7-491a-887f-e7f91538527f admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:16.037385 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-2a7c0556-30d7-491a-887f-e7f91538527f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:16.099681 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-1c717a9b-5104-40dc-b91c-1d696d594184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57d2b5c361de4ea39e309bf636f7ca2c', 'request_id': 'req-1c717a9b-5104-40dc-b91c-1d696d594184'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:16.106791 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-1c717a9b-5104-40dc-b91c-1d696d594184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57d2b5c361de4ea39e309bf636f7ca2c', 'request_id': 'req-1c717a9b-5104-40dc-b91c-1d696d594184'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:16.118425 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-1c717a9b-5104-40dc-b91c-1d696d594184 admin admin] The token cache is being invalidate because project 57d2b5c361de4ea39e309bf636f7ca2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:04:16.119015 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-1c717a9b-5104-40dc-b91c-1d696d594184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:16.119712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-1c717a9b-5104-40dc-b91c-1d696d594184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:16.121537 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1025/2032] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:04:15 2022] DELETE /identity/v3/projects/57d2b5c361de4ea39e309bf636f7ca2c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:04:16.122152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c717a9b-5104-40dc-b91c-1d696d594184 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:16.123758 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-1c717a9b-5104-40dc-b91c-1d696d594184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:16.195927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c717a9b-5104-40dc-b91c-1d696d594184 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:16.198989 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c0556-30d7-491a-887f-e7f91538527f admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:16.200910 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd42f80-8b0f-465f-8786-3265153e7133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:16.202164 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd42f80-8b0f-465f-8786-3265153e7133 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:16.202410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd42f80-8b0f-465f-8786-3265153e7133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:16.205320 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd42f80-8b0f-465f-8786-3265153e7133 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:16.205320 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd42f80-8b0f-465f-8786-3265153e7133 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:16.205320 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd42f80-8b0f-465f-8786-3265153e7133 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:16.213739 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d74f3-6f9c-4181-bd48-c68c4215092b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:16.214475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d74f3-6f9c-4181-bd48-c68c4215092b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:16.214759 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d74f3-6f9c-4181-bd48-c68c4215092b admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:16.215033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d74f3-6f9c-4181-bd48-c68c4215092b admin admin] PATH_INFO: `/v3/projects/3d56a09bb3394963a8f8da2c5e23e6f3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:16.216272 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110d74f3-6f9c-4181-bd48-c68c4215092b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d56a09bb3394963a8f8da2c5e23e6f3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:16.219134 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110d74f3-6f9c-4181-bd48-c68c4215092b admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:16.277984 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1026/2033] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:04:16 2022] POST /identity/v3/users => generated 291 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:16.278829 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd42f80-8b0f-465f-8786-3265153e7133 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:16.280524 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-2bd42f80-8b0f-465f-8786-3265153e7133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:16.295127 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:16.297446 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd42f80-8b0f-465f-8786-3265153e7133 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:16.305591 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fe4db-8e5b-4cce-9aac-730e0c7bf9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:16.306341 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fe4db-8e5b-4cce-9aac-730e0c7bf9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:16.309105 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fe4db-8e5b-4cce-9aac-730e0c7bf9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:16.309386 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fe4db-8e5b-4cce-9aac-730e0c7bf9ce admin admin] PATH_INFO: `/v3/users/75716f35213f42b7889455784eb16100` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:16.311097 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470fe4db-8e5b-4cce-9aac-730e0c7bf9ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=75716f35213f42b7889455784eb16100)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:16.314467 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470fe4db-8e5b-4cce-9aac-730e0c7bf9ce admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:16.319005 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-110d74f3-6f9c-4181-bd48-c68c4215092b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d56a09bb3394963a8f8da2c5e23e6f3', 'request_id': 'req-110d74f3-6f9c-4181-bd48-c68c4215092b'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:16.328657 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-110d74f3-6f9c-4181-bd48-c68c4215092b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d56a09bb3394963a8f8da2c5e23e6f3', 'request_id': 'req-110d74f3-6f9c-4181-bd48-c68c4215092b'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:16.333087 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-110d74f3-6f9c-4181-bd48-c68c4215092b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d56a09bb3394963a8f8da2c5e23e6f3', 'request_id': 'req-110d74f3-6f9c-4181-bd48-c68c4215092b'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:16.401879 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-110d74f3-6f9c-4181-bd48-c68c4215092b admin admin] The token cache is being invalidate because project 3d56a09bb3394963a8f8da2c5e23e6f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:04:16.402257 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-110d74f3-6f9c-4181-bd48-c68c4215092b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:16.402915 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-110d74f3-6f9c-4181-bd48-c68c4215092b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:16.404917 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1008/2034] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:04:16 2022] DELETE /identity/v3/projects/3d56a09bb3394963a8f8da2c5e23e6f3 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:16.405474 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d74f3-6f9c-4181-bd48-c68c4215092b admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:16.407151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-110d74f3-6f9c-4181-bd48-c68c4215092b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:16.477874 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d74f3-6f9c-4181-bd48-c68c4215092b admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:16.482892 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ce553-65ff-463a-aa4e-edd31f3bc703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:16.483525 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ce553-65ff-463a-aa4e-edd31f3bc703 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:16.484080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ce553-65ff-463a-aa4e-edd31f3bc703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:16.484416 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ce553-65ff-463a-aa4e-edd31f3bc703 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:16.485515 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ce553-65ff-463a-aa4e-edd31f3bc703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:16.486900 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ce553-65ff-463a-aa4e-edd31f3bc703 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:16.500235 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1009/2035] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:16.500235 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56aa97-2e03-4fae-989f-df3c9b136685 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:16.500235 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56aa97-2e03-4fae-989f-df3c9b136685 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:16.500235 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56aa97-2e03-4fae-989f-df3c9b136685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:16.523314 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-8f56aa97-2e03-4fae-989f-df3c9b136685 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:16.524543 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-8f56aa97-2e03-4fae-989f-df3c9b136685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:16.533537 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1010/2036] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:16.534341 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56aa97-2e03-4fae-989f-df3c9b136685 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:16.545732 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56aa97-2e03-4fae-989f-df3c9b136685 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:16.552357 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94695d1b-17bd-46ef-8d7f-8774dba4d219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:16.552357 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94695d1b-17bd-46ef-8d7f-8774dba4d219 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:16.552357 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94695d1b-17bd-46ef-8d7f-8774dba4d219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:16.552357 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94695d1b-17bd-46ef-8d7f-8774dba4d219 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:16.552718 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94695d1b-17bd-46ef-8d7f-8774dba4d219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:16.554204 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94695d1b-17bd-46ef-8d7f-8774dba4d219 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:16.554337 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-470fe4db-8e5b-4cce-9aac-730e0c7bf9ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75716f35213f42b7889455784eb16100'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:16.554942 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-470fe4db-8e5b-4cce-9aac-730e0c7bf9ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75716f35213f42b7889455784eb16100'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:16.555558 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-470fe4db-8e5b-4cce-9aac-730e0c7bf9ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75716f35213f42b7889455784eb16100'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:16.568383 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1011/2037] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:16.568383 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89340485-a69b-4a7d-9d7c-292380741896 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:16.568383 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89340485-a69b-4a7d-9d7c-292380741896 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:16.568383 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89340485-a69b-4a7d-9d7c-292380741896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:16.570048 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-470fe4db-8e5b-4cce-9aac-730e0c7bf9ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75716f35213f42b7889455784eb16100'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:16.587831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-89340485-a69b-4a7d-9d7c-292380741896 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:16.589075 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-89340485-a69b-4a7d-9d7c-292380741896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:16.598589 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1012/2038] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:16.599266 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89340485-a69b-4a7d-9d7c-292380741896 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:16.600502 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-89340485-a69b-4a7d-9d7c-292380741896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:16.613571 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89340485-a69b-4a7d-9d7c-292380741896 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:16.622995 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c9a97-3937-41d0-b144-0e26e1a96110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:16.622995 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c9a97-3937-41d0-b144-0e26e1a96110 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:16.622995 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c9a97-3937-41d0-b144-0e26e1a96110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:16.622995 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c9a97-3937-41d0-b144-0e26e1a96110 admin admin] PATH_INFO: `/v3/projects/34f2b9df561a4207a8947176202b430e/users/a31c34e2d85c42098b538316a3dd8129/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:16.636601 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c9a97-3937-41d0-b144-0e26e1a96110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34f2b9df561a4207a8947176202b430e, user_id=a31c34e2d85c42098b538316a3dd8129, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:16.640931 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c9a97-3937-41d0-b144-0e26e1a96110 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:16.642334 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-470fe4db-8e5b-4cce-9aac-730e0c7bf9ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75716f35213f42b7889455784eb16100'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:16.656436 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1027/2039] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:04:16 2022] DELETE /identity/v3/users/75716f35213f42b7889455784eb16100 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:16.657342 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fe4db-8e5b-4cce-9aac-730e0c7bf9ce admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:16.739926 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fe4db-8e5b-4cce-9aac-730e0c7bf9ce admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:16.746838 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1013/2040] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:16 2022] PUT /identity/v3/projects/34f2b9df561a4207a8947176202b430e/users/a31c34e2d85c42098b538316a3dd8129/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:16.761321 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9368b-8929-4a35-a36a-f5c7448cec01 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:16.761753 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9368b-8929-4a35-a36a-f5c7448cec01 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:16.762184 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9368b-8929-4a35-a36a-f5c7448cec01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:16.809600 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-d0b9368b-8929-4a35-a36a-f5c7448cec01 None None] MFA Rules not processed for user `a31c34e2d85c42098b538316a3dd8129`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:16.811603 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-d0b9368b-8929-4a35-a36a-f5c7448cec01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:16.816124 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b733d25-5bd0-4ce2-9650-cd0f25d8c599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:16.816791 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b733d25-5bd0-4ce2-9650-cd0f25d8c599 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:16.817134 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b733d25-5bd0-4ce2-9650-cd0f25d8c599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:16.817421 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b733d25-5bd0-4ce2-9650-cd0f25d8c599 admin admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:16.818089 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b733d25-5bd0-4ce2-9650-cd0f25d8c599 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:04:16.818401 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b733d25-5bd0-4ce2-9650-cd0f25d8c599 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:16.827937 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b733d25-5bd0-4ce2-9650-cd0f25d8c599 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:16.837296 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1028/2041] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:04:16.841730 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b733d25-5bd0-4ce2-9650-cd0f25d8c599 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:16.854506 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b733d25-5bd0-4ce2-9650-cd0f25d8c599 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:16.861830 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f66d22-6c54-420f-816a-0dada7e7b59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:16.862462 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f66d22-6c54-420f-816a-0dada7e7b59e admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:16.862748 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f66d22-6c54-420f-816a-0dada7e7b59e admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:16.863031 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f66d22-6c54-420f-816a-0dada7e7b59e admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:16.863676 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f66d22-6c54-420f-816a-0dada7e7b59e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:16.872710 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f66d22-6c54-420f-816a-0dada7e7b59e admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:16.933055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1014/2042] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:04:16.936233 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9368b-8929-4a35-a36a-f5c7448cec01 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:16.960271 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9368b-8929-4a35-a36a-f5c7448cec01 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:16.971322 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89ed5c-c3a0-45b6-9f9b-eba7f5e763b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:16.972726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89ed5c-c3a0-45b6-9f9b-eba7f5e763b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:16.973269 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89ed5c-c3a0-45b6-9f9b-eba7f5e763b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:16.973753 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89ed5c-c3a0-45b6-9f9b-eba7f5e763b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:16.975507 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89ed5c-c3a0-45b6-9f9b-eba7f5e763b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:16.979146 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89ed5c-c3a0-45b6-9f9b-eba7f5e763b7 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:17.073796 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1029/2043] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:04:16 2022] POST /identity/v3/projects => generated 379 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:04:17.081037 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f66d22-6c54-420f-816a-0dada7e7b59e admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:17.108246 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1015/2044] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:04:16 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:17.118051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89ed5c-c3a0-45b6-9f9b-eba7f5e763b7 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:17.199277 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f66d22-6c54-420f-816a-0dada7e7b59e admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:17.253875 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89ed5c-c3a0-45b6-9f9b-eba7f5e763b7 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:17.265037 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf1f02-ea1e-4598-8505-b3d9ede1e98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:17.265745 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf1f02-ea1e-4598-8505-b3d9ede1e98c admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:17.266035 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf1f02-ea1e-4598-8505-b3d9ede1e98c admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:17.266369 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf1f02-ea1e-4598-8505-b3d9ede1e98c admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:17.267005 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf1f02-ea1e-4598-8505-b3d9ede1e98c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:17.269420 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf1f02-ea1e-4598-8505-b3d9ede1e98c admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:17.327125 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020739d-3709-485c-af37-42d3896c18d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:17.328012 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020739d-3709-485c-af37-42d3896c18d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:17.328290 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020739d-3709-485c-af37-42d3896c18d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:17.328556 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020739d-3709-485c-af37-42d3896c18d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:17.329291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020739d-3709-485c-af37-42d3896c18d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:17.331652 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020739d-3709-485c-af37-42d3896c18d0 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:17.400673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1016/2045] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:04:17 2022] POST /identity/v3/users => generated 298 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:17.400673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf1f02-ea1e-4598-8505-b3d9ede1e98c admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:17.402432 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-f5bf1f02-ea1e-4598-8505-b3d9ede1e98c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:17.416881 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf1f02-ea1e-4598-8505-b3d9ede1e98c admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:17.423594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c19f27-d6fe-4e45-afd0-e6d0b9e7fedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:17.427693 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c19f27-d6fe-4e45-afd0-e6d0b9e7fedc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:17.427693 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c19f27-d6fe-4e45-afd0-e6d0b9e7fedc admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:17.427693 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c19f27-d6fe-4e45-afd0-e6d0b9e7fedc admin admin] PATH_INFO: `/v3/projects/3f28c09b97d54720a3399954bee424a1` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:17.428134 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1030/2046] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:04:17 2022] POST /identity/v3/users => generated 290 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:17.428134 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020739d-3709-485c-af37-42d3896c18d0 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:17.429776 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c19f27-d6fe-4e45-afd0-e6d0b9e7fedc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f28c09b97d54720a3399954bee424a1)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:17.431904 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c19f27-d6fe-4e45-afd0-e6d0b9e7fedc admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:17.440705 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020739d-3709-485c-af37-42d3896c18d0 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:17.448067 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f4e2d-104c-40ae-894c-8d81978aaa7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:17.449154 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f4e2d-104c-40ae-894c-8d81978aaa7e admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:17.449900 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f4e2d-104c-40ae-894c-8d81978aaa7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:17.450186 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f4e2d-104c-40ae-894c-8d81978aaa7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:17.450913 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f4e2d-104c-40ae-894c-8d81978aaa7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:17.452667 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f4e2d-104c-40ae-894c-8d81978aaa7e admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:17.469816 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1031/2047] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:17.470728 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f4e2d-104c-40ae-894c-8d81978aaa7e admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:17.481682 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f4e2d-104c-40ae-894c-8d81978aaa7e admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:17.487586 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a55b6-b4fa-4c0d-b071-ada764abfab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:17.488215 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a55b6-b4fa-4c0d-b071-ada764abfab0 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:17.488499 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a55b6-b4fa-4c0d-b071-ada764abfab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:17.488885 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a55b6-b4fa-4c0d-b071-ada764abfab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:17.489539 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a55b6-b4fa-4c0d-b071-ada764abfab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:17.491153 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a55b6-b4fa-4c0d-b071-ada764abfab0 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:17.506413 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1032/2048] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:17.506413 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a55b6-b4fa-4c0d-b071-ada764abfab0 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:17.516852 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a55b6-b4fa-4c0d-b071-ada764abfab0 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:17.521639 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83f1c8-7802-433c-8dd8-a3b7e0dc6a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:17.522304 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83f1c8-7802-433c-8dd8-a3b7e0dc6a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:17.522619 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83f1c8-7802-433c-8dd8-a3b7e0dc6a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:17.522933 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83f1c8-7802-433c-8dd8-a3b7e0dc6a41 admin admin] PATH_INFO: `/v3/projects/008de03abfcc4578be730bfa7fedf1c4/users/2682e89f30fa4e92b9ed4ce40e3a6000/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:17.537883 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83f1c8-7802-433c-8dd8-a3b7e0dc6a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=008de03abfcc4578be730bfa7fedf1c4, user_id=2682e89f30fa4e92b9ed4ce40e3a6000, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:17.543570 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83f1c8-7802-433c-8dd8-a3b7e0dc6a41 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:17.590945 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:17.653918 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1033/2049] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:17 2022] PUT /identity/v3/projects/008de03abfcc4578be730bfa7fedf1c4/users/2682e89f30fa4e92b9ed4ce40e3a6000/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:17.654974 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83f1c8-7802-433c-8dd8-a3b7e0dc6a41 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:17.669199 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-d6c19f27-d6fe-4e45-afd0-e6d0b9e7fedc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f28c09b97d54720a3399954bee424a1', 'request_id': 'req-d6c19f27-d6fe-4e45-afd0-e6d0b9e7fedc'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:17.677584 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-d6c19f27-d6fe-4e45-afd0-e6d0b9e7fedc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f28c09b97d54720a3399954bee424a1', 'request_id': 'req-d6c19f27-d6fe-4e45-afd0-e6d0b9e7fedc'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:17.686563 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-d6c19f27-d6fe-4e45-afd0-e6d0b9e7fedc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f28c09b97d54720a3399954bee424a1', 'request_id': 'req-d6c19f27-d6fe-4e45-afd0-e6d0b9e7fedc'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:17.728498 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83f1c8-7802-433c-8dd8-a3b7e0dc6a41 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:17.774169 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-d6c19f27-d6fe-4e45-afd0-e6d0b9e7fedc admin admin] The token cache is being invalidate because project 3f28c09b97d54720a3399954bee424a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:04:17.774493 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-d6c19f27-d6fe-4e45-afd0-e6d0b9e7fedc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:17.775131 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-d6c19f27-d6fe-4e45-afd0-e6d0b9e7fedc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:17.781099 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1017/2050] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:04:17 2022] DELETE /identity/v3/projects/3f28c09b97d54720a3399954bee424a1 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:17.781099 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c19f27-d6fe-4e45-afd0-e6d0b9e7fedc admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:17.781099 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-d6c19f27-d6fe-4e45-afd0-e6d0b9e7fedc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:17.803759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605594a2-7c95-47ae-9890-49931721443d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:17.805809 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605594a2-7c95-47ae-9890-49931721443d admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:17.805809 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605594a2-7c95-47ae-9890-49931721443d admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:17.805809 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605594a2-7c95-47ae-9890-49931721443d admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:17.806461 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605594a2-7c95-47ae-9890-49931721443d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:17.808746 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605594a2-7c95-47ae-9890-49931721443d admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:17.821234 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1034/2051] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:17.822567 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd829f-6665-47df-bcfa-03820062b6d3 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:17.822995 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd829f-6665-47df-bcfa-03820062b6d3 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:17.823275 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd829f-6665-47df-bcfa-03820062b6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:17.849008 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-e1dd829f-6665-47df-bcfa-03820062b6d3 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:17.850362 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-e1dd829f-6665-47df-bcfa-03820062b6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:17.862414 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1035/2052] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:17.863245 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd829f-6665-47df-bcfa-03820062b6d3 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:17.870577 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-e1dd829f-6665-47df-bcfa-03820062b6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:17.871189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c19f27-d6fe-4e45-afd0-e6d0b9e7fedc admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:17.876034 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6662f-7474-4e52-9e95-65d3676bde90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:17.876663 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6662f-7474-4e52-9e95-65d3676bde90 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:17.876944 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6662f-7474-4e52-9e95-65d3676bde90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:17.877212 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6662f-7474-4e52-9e95-65d3676bde90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:17.877899 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6662f-7474-4e52-9e95-65d3676bde90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:17.879450 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6662f-7474-4e52-9e95-65d3676bde90 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:17.883415 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd829f-6665-47df-bcfa-03820062b6d3 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:17.888775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbb955-eed5-4fab-ba4d-e958cdcd996e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:17.889437 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbb955-eed5-4fab-ba4d-e958cdcd996e admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:17.889719 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbb955-eed5-4fab-ba4d-e958cdcd996e admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:17.893268 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbb955-eed5-4fab-ba4d-e958cdcd996e admin admin] PATH_INFO: `/v3/projects/a43c7abdc7af4a0fab0ad654ff98c9dd/users/d704dda3a75e4b0ca7107d72bc466381/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:17.893402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1018/2053] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:17.893402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848d0d0-b6e3-469c-a184-71d540fc2916 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:17.893402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848d0d0-b6e3-469c-a184-71d540fc2916 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:17.893402 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848d0d0-b6e3-469c-a184-71d540fc2916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:17.910293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbb955-eed5-4fab-ba4d-e958cdcd996e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a43c7abdc7af4a0fab0ad654ff98c9dd, user_id=d704dda3a75e4b0ca7107d72bc466381, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:17.911122 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-f848d0d0-b6e3-469c-a184-71d540fc2916 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:17.912322 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-f848d0d0-b6e3-469c-a184-71d540fc2916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:17.913328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbb955-eed5-4fab-ba4d-e958cdcd996e admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:17.921841 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1019/2054] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:17.922602 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848d0d0-b6e3-469c-a184-71d540fc2916 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:17.931768 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848d0d0-b6e3-469c-a184-71d540fc2916 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:17.936446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb753b-18bb-44a7-9c7c-5fa79b0b0f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:17.937119 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb753b-18bb-44a7-9c7c-5fa79b0b0f69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:17.937393 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb753b-18bb-44a7-9c7c-5fa79b0b0f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:17.945467 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb753b-18bb-44a7-9c7c-5fa79b0b0f69 admin admin] PATH_INFO: `/v3/projects/008de03abfcc4578be730bfa7fedf1c4/users/2682e89f30fa4e92b9ed4ce40e3a6000/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:17.945467 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb753b-18bb-44a7-9c7c-5fa79b0b0f69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=008de03abfcc4578be730bfa7fedf1c4, user_id=2682e89f30fa4e92b9ed4ce40e3a6000, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:17.945467 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb753b-18bb-44a7-9c7c-5fa79b0b0f69 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:17.952645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1020/2055] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:17 2022] PUT /identity/v3/projects/008de03abfcc4578be730bfa7fedf1c4/users/2682e89f30fa4e92b9ed4ce40e3a6000/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:17.953427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb753b-18bb-44a7-9c7c-5fa79b0b0f69 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:18.015060 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb753b-18bb-44a7-9c7c-5fa79b0b0f69 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:18.019739 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17696b-c7b5-47f3-ba98-f0d78e42b0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:18.020336 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17696b-c7b5-47f3-ba98-f0d78e42b0ce admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:18.020614 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17696b-c7b5-47f3-ba98-f0d78e42b0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:18.020912 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17696b-c7b5-47f3-ba98-f0d78e42b0ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:18.021547 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17696b-c7b5-47f3-ba98-f0d78e42b0ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:04:18.021852 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17696b-c7b5-47f3-ba98-f0d78e42b0ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:18.023439 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17696b-c7b5-47f3-ba98-f0d78e42b0ce admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:18.035398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1021/2056] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:04:18.036610 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861883db-f673-4998-b40c-40d2de34efe6 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:18.036922 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861883db-f673-4998-b40c-40d2de34efe6 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:18.037205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861883db-f673-4998-b40c-40d2de34efe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:18.048074 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:18.056116 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1036/2057] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:17 2022] PUT /identity/v3/projects/a43c7abdc7af4a0fab0ad654ff98c9dd/users/d704dda3a75e4b0ca7107d72bc466381/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:18.057004 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbb955-eed5-4fab-ba4d-e958cdcd996e admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:18.065262 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-861883db-f673-4998-b40c-40d2de34efe6 None None] MFA Rules not processed for user `2682e89f30fa4e92b9ed4ce40e3a6000`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:18.066462 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-861883db-f673-4998-b40c-40d2de34efe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:18.129062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbb955-eed5-4fab-ba4d-e958cdcd996e admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:18.134035 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd760622-788d-4184-b6e5-ee1f287db38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:18.134669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd760622-788d-4184-b6e5-ee1f287db38a admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:18.134948 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd760622-788d-4184-b6e5-ee1f287db38a admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:18.135329 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd760622-788d-4184-b6e5-ee1f287db38a admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:18.135958 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd760622-788d-4184-b6e5-ee1f287db38a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:18.137951 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd760622-788d-4184-b6e5-ee1f287db38a admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:18.145279 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1022/2058] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:18.146637 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a974e-0e64-4cf1-861e-36210bfd058d None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:18.146929 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a974e-0e64-4cf1-861e-36210bfd058d None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:18.147202 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a974e-0e64-4cf1-861e-36210bfd058d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:18.176984 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-c45a974e-0e64-4cf1-861e-36210bfd058d None None] MFA Rules not processed for user `d704dda3a75e4b0ca7107d72bc466381`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:18.178196 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-c45a974e-0e64-4cf1-861e-36210bfd058d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:18.243867 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1023/2059] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:18.244696 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a974e-0e64-4cf1-861e-36210bfd058d None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:18.245985 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-c45a974e-0e64-4cf1-861e-36210bfd058d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:18.278483 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1037/2060] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:04:18 2022] POST /identity/v3/projects => generated 373 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:18.278483 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd760622-788d-4184-b6e5-ee1f287db38a admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:18.319020 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a974e-0e64-4cf1-861e-36210bfd058d None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:18.372172 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd760622-788d-4184-b6e5-ee1f287db38a admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:18.378097 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a06f6e-f75c-45e3-b4e6-55dab59ae52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:18.378545 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36472c7b-27e3-485c-aa9e-eeefad533175 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:18.378719 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a06f6e-f75c-45e3-b4e6-55dab59ae52d admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:18.379169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a06f6e-f75c-45e3-b4e6-55dab59ae52d admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:18.379392 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a06f6e-f75c-45e3-b4e6-55dab59ae52d admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:18.379513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36472c7b-27e3-485c-aa9e-eeefad533175 service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:18.379812 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36472c7b-27e3-485c-aa9e-eeefad533175 service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:18.380143 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a06f6e-f75c-45e3-b4e6-55dab59ae52d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:18.380245 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36472c7b-27e3-485c-aa9e-eeefad533175 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:18.382898 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a06f6e-f75c-45e3-b4e6-55dab59ae52d admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:18.456537 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36472c7b-27e3-485c-aa9e-eeefad533175 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:18.458072 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36472c7b-27e3-485c-aa9e-eeefad533175 service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:18.469838 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1024/2061] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:04:18.470731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36472c7b-27e3-485c-aa9e-eeefad533175 service cinder] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:18.497400 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1038/2062] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:04:18 2022] POST /identity/v3/projects => generated 379 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:18.498637 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a06f6e-f75c-45e3-b4e6-55dab59ae52d admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:18.503263 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36472c7b-27e3-485c-aa9e-eeefad533175 service cinder] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:18.572190 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a06f6e-f75c-45e3-b4e6-55dab59ae52d admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:18.572828 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf8c1c-13f0-4df9-b655-e2bbd3ae0a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:18.573443 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf8c1c-13f0-4df9-b655-e2bbd3ae0a9b admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:18.573727 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf8c1c-13f0-4df9-b655-e2bbd3ae0a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:18.574000 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf8c1c-13f0-4df9-b655-e2bbd3ae0a9b admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:18.574616 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf8c1c-13f0-4df9-b655-e2bbd3ae0a9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:18.576894 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf8c1c-13f0-4df9-b655-e2bbd3ae0a9b admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:18.577650 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f0332-fd43-4c82-b1b0-97205599a38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:18.578257 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f0332-fd43-4c82-b1b0-97205599a38f admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:18.578542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f0332-fd43-4c82-b1b0-97205599a38f admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:18.578819 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f0332-fd43-4c82-b1b0-97205599a38f admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:18.579447 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f0332-fd43-4c82-b1b0-97205599a38f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:18.581415 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f0332-fd43-4c82-b1b0-97205599a38f admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:18.677404 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1025/2063] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:04:18 2022] POST /identity/v3/users => generated 287 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:18.678425 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf8c1c-13f0-4df9-b655-e2bbd3ae0a9b admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:18.705520 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1039/2064] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:04:18 2022] POST /identity/v3/users => generated 290 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:18.706569 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f0332-fd43-4c82-b1b0-97205599a38f admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:18.716492 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f0332-fd43-4c82-b1b0-97205599a38f admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:18.722066 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f217dc-6344-45a2-95cf-928fef7bf35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:18.722670 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f217dc-6344-45a2-95cf-928fef7bf35e admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:18.722947 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f217dc-6344-45a2-95cf-928fef7bf35e admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:18.723217 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f217dc-6344-45a2-95cf-928fef7bf35e admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:18.723861 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f217dc-6344-45a2-95cf-928fef7bf35e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:18.725518 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f217dc-6344-45a2-95cf-928fef7bf35e admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:18.736163 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf8c1c-13f0-4df9-b655-e2bbd3ae0a9b admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:18.737414 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1040/2065] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:18.737718 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f217dc-6344-45a2-95cf-928fef7bf35e admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:18.742813 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2850f-d298-4bec-98c1-3e4ae4895cd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:18.743570 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2850f-d298-4bec-98c1-3e4ae4895cd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:18.743851 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2850f-d298-4bec-98c1-3e4ae4895cd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:18.744118 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2850f-d298-4bec-98c1-3e4ae4895cd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:18.745874 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-3eb2850f-d298-4bec-98c1-3e4ae4895cd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:18.747567 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f217dc-6344-45a2-95cf-928fef7bf35e admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:18.752448 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c8699-d793-4da0-8431-3798a9539a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:18.753076 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c8699-d793-4da0-8431-3798a9539a34 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:18.753360 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c8699-d793-4da0-8431-3798a9539a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:18.753636 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c8699-d793-4da0-8431-3798a9539a34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:18.754279 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c8699-d793-4da0-8431-3798a9539a34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:18.755916 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c8699-d793-4da0-8431-3798a9539a34 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:18.768246 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1041/2066] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:18.769386 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c8699-d793-4da0-8431-3798a9539a34 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:18.781229 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c8699-d793-4da0-8431-3798a9539a34 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:18.785932 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530e996-7129-4e50-9648-758ccd7b4913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:18.786530 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530e996-7129-4e50-9648-758ccd7b4913 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:18.786809 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530e996-7129-4e50-9648-758ccd7b4913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:18.787085 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530e996-7129-4e50-9648-758ccd7b4913 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:18.787721 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530e996-7129-4e50-9648-758ccd7b4913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:18.789400 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530e996-7129-4e50-9648-758ccd7b4913 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:18.801482 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1042/2067] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:18.805395 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530e996-7129-4e50-9648-758ccd7b4913 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:18.810703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb2850f-d298-4bec-98c1-3e4ae4895cd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:18.812351 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb2850f-d298-4bec-98c1-3e4ae4895cd2 service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:18.815912 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530e996-7129-4e50-9648-758ccd7b4913 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:18.820915 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf679f7-1245-45e8-8543-5870fbaa56bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:18.821514 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf679f7-1245-45e8-8543-5870fbaa56bf admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:18.821799 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf679f7-1245-45e8-8543-5870fbaa56bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:18.822301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf679f7-1245-45e8-8543-5870fbaa56bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:18.822450 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1026/2068] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:04:18.822793 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf679f7-1245-45e8-8543-5870fbaa56bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:18.822966 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2850f-d298-4bec-98c1-3e4ae4895cd2 service cinder] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:18.824466 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf679f7-1245-45e8-8543-5870fbaa56bf admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:18.838511 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1043/2069] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:18.838690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2850f-d298-4bec-98c1-3e4ae4895cd2 service cinder] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:18.839740 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf679f7-1245-45e8-8543-5870fbaa56bf admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:18.841448 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc204f7-3045-4575-93e6-03b06c115d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:18.842849 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc204f7-3045-4575-93e6-03b06c115d66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:18.843241 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc204f7-3045-4575-93e6-03b06c115d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:18.843520 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc204f7-3045-4575-93e6-03b06c115d66 admin admin] PATH_INFO: `/v3/projects/e82f3859d6f748c7a1433cee9dbe5f8c/users/a555b35e0657498fa68fe32e3b0f21cf/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:18.851504 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf679f7-1245-45e8-8543-5870fbaa56bf admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:18.856812 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d916c8-2460-4ceb-b7d4-0b8c8fa7d654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:18.858020 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d916c8-2460-4ceb-b7d4-0b8c8fa7d654 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:18.858546 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d916c8-2460-4ceb-b7d4-0b8c8fa7d654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:18.858967 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d916c8-2460-4ceb-b7d4-0b8c8fa7d654 admin admin] PATH_INFO: `/v3/projects/1cb9a0019d2140b4ac2dcc16e4f828f1/users/d90fd6bf7acf45c1909f3a613debb616/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:18.864043 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc204f7-3045-4575-93e6-03b06c115d66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e82f3859d6f748c7a1433cee9dbe5f8c, user_id=a555b35e0657498fa68fe32e3b0f21cf, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:18.867299 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc204f7-3045-4575-93e6-03b06c115d66 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:18.879398 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d916c8-2460-4ceb-b7d4-0b8c8fa7d654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb9a0019d2140b4ac2dcc16e4f828f1, user_id=d90fd6bf7acf45c1909f3a613debb616, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:18.882297 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d916c8-2460-4ceb-b7d4-0b8c8fa7d654 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:18.939542 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1027/2070] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:18 2022] PUT /identity/v3/projects/e82f3859d6f748c7a1433cee9dbe5f8c/users/a555b35e0657498fa68fe32e3b0f21cf/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:18.945873 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5b20e-4e13-4ab3-8c96-ec6a66e07558 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:18.946157 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5b20e-4e13-4ab3-8c96-ec6a66e07558 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:18.946434 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5b20e-4e13-4ab3-8c96-ec6a66e07558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:18.965361 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-07e5b20e-4e13-4ab3-8c96-ec6a66e07558 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:18.972410 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-07e5b20e-4e13-4ab3-8c96-ec6a66e07558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:19.001445 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1044/2071] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:18 2022] PUT /identity/v3/projects/1cb9a0019d2140b4ac2dcc16e4f828f1/users/d90fd6bf7acf45c1909f3a613debb616/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:04:19.007940 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110bb02-b354-4d1a-998f-b9c8fe82f29e None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:19.008235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110bb02-b354-4d1a-998f-b9c8fe82f29e None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:19.008514 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110bb02-b354-4d1a-998f-b9c8fe82f29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:19.033830 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1028/2072] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:04:19.042623 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5b20e-4e13-4ab3-8c96-ec6a66e07558 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:19.044242 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-07e5b20e-4e13-4ab3-8c96-ec6a66e07558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:19.055324 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-e110bb02-b354-4d1a-998f-b9c8fe82f29e None None] MFA Rules not processed for user `d90fd6bf7acf45c1909f3a613debb616`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:19.056891 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-e110bb02-b354-4d1a-998f-b9c8fe82f29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:19.078712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:19.121177 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5b20e-4e13-4ab3-8c96-ec6a66e07558 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:19.149982 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1045/2073] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:19.151460 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110bb02-b354-4d1a-998f-b9c8fe82f29e None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:19.189941 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f9fed-f0c6-4747-bfe8-89655cafcc5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:19.190837 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f9fed-f0c6-4747-bfe8-89655cafcc5a service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:19.191994 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f9fed-f0c6-4747-bfe8-89655cafcc5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:19.192278 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f9fed-f0c6-4747-bfe8-89655cafcc5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:19.226505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110bb02-b354-4d1a-998f-b9c8fe82f29e None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:19.231172 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f86c2-224e-4b82-928a-c86c1ba032d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:19.231777 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f86c2-224e-4b82-928a-c86c1ba032d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:19.232055 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f86c2-224e-4b82-928a-c86c1ba032d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:19.234838 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f86c2-224e-4b82-928a-c86c1ba032d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:19.234838 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f86c2-224e-4b82-928a-c86c1ba032d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:19.235987 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f86c2-224e-4b82-928a-c86c1ba032d5 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:19.255987 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f9fed-f0c6-4747-bfe8-89655cafcc5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:19.257561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f9fed-f0c6-4747-bfe8-89655cafcc5a service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:19.269986 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1029/2074] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:04:19.329664 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1046/2075] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:04:19 2022] POST /identity/v3/projects => generated 379 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:19.333651 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f9fed-f0c6-4747-bfe8-89655cafcc5a service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:19.344925 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f9fed-f0c6-4747-bfe8-89655cafcc5a service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:19.401631 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1ac5c-1b75-458f-bc37-5d95816b2b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:19.402228 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1ac5c-1b75-458f-bc37-5d95816b2b74 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:19.402506 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1ac5c-1b75-458f-bc37-5d95816b2b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:19.402810 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1ac5c-1b75-458f-bc37-5d95816b2b74 admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:19.403435 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1ac5c-1b75-458f-bc37-5d95816b2b74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:19.408859 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1ac5c-1b75-458f-bc37-5d95816b2b74 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:19.428972 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:19.430001 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f86c2-224e-4b82-928a-c86c1ba032d5 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:19.441176 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f86c2-224e-4b82-928a-c86c1ba032d5 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:19.450332 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1a15c-c8e1-41bc-bac3-4ec1918575dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:19.450332 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1a15c-c8e1-41bc-bac3-4ec1918575dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:19.450332 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1a15c-c8e1-41bc-bac3-4ec1918575dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:19.450332 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1a15c-c8e1-41bc-bac3-4ec1918575dd admin admin] PATH_INFO: `/v3/users/a31c34e2d85c42098b538316a3dd8129` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:19.450613 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1a15c-c8e1-41bc-bac3-4ec1918575dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a31c34e2d85c42098b538316a3dd8129)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:19.452543 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1a15c-c8e1-41bc-bac3-4ec1918575dd admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:19.505370 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1030/2076] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:04:19 2022] POST /identity/v3/users => generated 296 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:19.507650 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1ac5c-1b75-458f-bc37-5d95816b2b74 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:19.518920 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1ac5c-1b75-458f-bc37-5d95816b2b74 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:19.523917 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb2b1b-9b83-457c-abc7-5e1d8d64c643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:19.524524 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb2b1b-9b83-457c-abc7-5e1d8d64c643 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:19.524837 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb2b1b-9b83-457c-abc7-5e1d8d64c643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:19.525113 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb2b1b-9b83-457c-abc7-5e1d8d64c643 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:19.525757 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb2b1b-9b83-457c-abc7-5e1d8d64c643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:19.527364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb2b1b-9b83-457c-abc7-5e1d8d64c643 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:19.539362 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1031/2077] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:04:19.543244 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb2b1b-9b83-457c-abc7-5e1d8d64c643 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:19.553844 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb2b1b-9b83-457c-abc7-5e1d8d64c643 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:19.558773 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215544df-c91e-4872-8912-0ad36827c8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:19.559427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215544df-c91e-4872-8912-0ad36827c8d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:19.559707 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215544df-c91e-4872-8912-0ad36827c8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:19.559979 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215544df-c91e-4872-8912-0ad36827c8d6 admin admin] PATH_INFO: `/v3/projects/5c05902dd9214eeb93e0fe650ae37950/users/19c930658723410ba63790ea9b84f08e/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:19.576855 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215544df-c91e-4872-8912-0ad36827c8d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c05902dd9214eeb93e0fe650ae37950, user_id=19c930658723410ba63790ea9b84f08e, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:19.579411 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215544df-c91e-4872-8912-0ad36827c8d6 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:19.665748 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1032/2078] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:19 2022] PUT /identity/v3/projects/5c05902dd9214eeb93e0fe650ae37950/users/19c930658723410ba63790ea9b84f08e/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:04:19.670298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215544df-c91e-4872-8912-0ad36827c8d6 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:19.693596 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-e2a1a15c-c8e1-41bc-bac3-4ec1918575dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a31c34e2d85c42098b538316a3dd8129'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:19.694272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-e2a1a15c-c8e1-41bc-bac3-4ec1918575dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a31c34e2d85c42098b538316a3dd8129'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:19.695085 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-e2a1a15c-c8e1-41bc-bac3-4ec1918575dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a31c34e2d85c42098b538316a3dd8129'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:19.725322 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-e2a1a15c-c8e1-41bc-bac3-4ec1918575dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a31c34e2d85c42098b538316a3dd8129'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:19.767798 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215544df-c91e-4872-8912-0ad36827c8d6 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:19.775725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bbc0e-e454-42d8-a453-9ebd29e6766c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:19.776348 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bbc0e-e454-42d8-a453-9ebd29e6766c admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:19.776650 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bbc0e-e454-42d8-a453-9ebd29e6766c admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:19.777052 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bbc0e-e454-42d8-a453-9ebd29e6766c admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:19.777736 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6bbc0e-e454-42d8-a453-9ebd29e6766c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:19.779657 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6bbc0e-e454-42d8-a453-9ebd29e6766c admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:19.791598 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1033/2079] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:04:19.796690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bbc0e-e454-42d8-a453-9ebd29e6766c admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:19.798454 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-3c6bbc0e-e454-42d8-a453-9ebd29e6766c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:19.812761 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bbc0e-e454-42d8-a453-9ebd29e6766c admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:19.817531 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28846ef-7a6a-4408-ab8d-c224088846b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:19.818284 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28846ef-7a6a-4408-ab8d-c224088846b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:19.818567 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28846ef-7a6a-4408-ab8d-c224088846b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:19.818843 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28846ef-7a6a-4408-ab8d-c224088846b3 admin admin] PATH_INFO: `/v3/projects/5c05902dd9214eeb93e0fe650ae37950/users/19c930658723410ba63790ea9b84f08e/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:19.820919 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28846ef-7a6a-4408-ab8d-c224088846b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c05902dd9214eeb93e0fe650ae37950, user_id=19c930658723410ba63790ea9b84f08e, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:19.823546 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28846ef-7a6a-4408-ab8d-c224088846b3 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:19.828481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-e2a1a15c-c8e1-41bc-bac3-4ec1918575dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a31c34e2d85c42098b538316a3dd8129'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:19.844981 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1034/2080] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:19 2022] PUT /identity/v3/projects/5c05902dd9214eeb93e0fe650ae37950/users/19c930658723410ba63790ea9b84f08e/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:19.845335 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1047/2081] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:04:19 2022] DELETE /identity/v3/users/a31c34e2d85c42098b538316a3dd8129 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:04:19.850151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848586c-d733-455a-842a-6cf60e6b8442 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:19.850437 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848586c-d733-455a-842a-6cf60e6b8442 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:19.850711 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848586c-d733-455a-842a-6cf60e6b8442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:19.859739 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c211c8-7b35-41bc-a3a9-87144c21ba75 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:19.860038 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c211c8-7b35-41bc-a3a9-87144c21ba75 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:19.860315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c211c8-7b35-41bc-a3a9-87144c21ba75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:19.871591 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-3848586c-d733-455a-842a-6cf60e6b8442 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:19.873822 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-3848586c-d733-455a-842a-6cf60e6b8442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:19.895807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-34c211c8-7b35-41bc-a3a9-87144c21ba75 None None] MFA Rules not processed for user `19c930658723410ba63790ea9b84f08e`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:19.897351 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-34c211c8-7b35-41bc-a3a9-87144c21ba75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:19.953125 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1035/2082] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:19.954142 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848586c-d733-455a-842a-6cf60e6b8442 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:19.955582 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-3848586c-d733-455a-842a-6cf60e6b8442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:19.985340 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1048/2083] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:20.007179 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c211c8-7b35-41bc-a3a9-87144c21ba75 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:20.009751 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-34c211c8-7b35-41bc-a3a9-87144c21ba75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:20.033112 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848586c-d733-455a-842a-6cf60e6b8442 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:20.037013 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd9fb6-57df-43bb-bc65-d4c69cfd3da3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:20.037698 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd9fb6-57df-43bb-bc65-d4c69cfd3da3 service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:20.037920 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd9fb6-57df-43bb-bc65-d4c69cfd3da3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:20.038191 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd9fb6-57df-43bb-bc65-d4c69cfd3da3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:20.049000 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd9fb6-57df-43bb-bc65-d4c69cfd3da3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:20.050426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd9fb6-57df-43bb-bc65-d4c69cfd3da3 service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:20.060114 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1036/2084] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:04:20.071487 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c211c8-7b35-41bc-a3a9-87144c21ba75 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:20.075947 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb85b8-5336-466e-ae8f-6115771d07f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:20.076741 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb85b8-5336-466e-ae8f-6115771d07f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:20.077918 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb85b8-5336-466e-ae8f-6115771d07f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:20.077918 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb85b8-5336-466e-ae8f-6115771d07f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:20.087581 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb85b8-5336-466e-ae8f-6115771d07f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:20.089285 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb85b8-5336-466e-ae8f-6115771d07f2 service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:20.101453 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1049/2085] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:20 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:04:20.274858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd9fb6-57df-43bb-bc65-d4c69cfd3da3 service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:20.276444 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-d3fd9fb6-57df-43bb-bc65-d4c69cfd3da3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:20.293797 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd9fb6-57df-43bb-bc65-d4c69cfd3da3 service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:20.307922 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10080475-b960-4125-9bf4-489a8e8f8f4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:20.308637 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10080475-b960-4125-9bf4-489a8e8f8f4a service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:20.309125 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10080475-b960-4125-9bf4-489a8e8f8f4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:20.309513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10080475-b960-4125-9bf4-489a8e8f8f4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:20.311485 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-10080475-b960-4125-9bf4-489a8e8f8f4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:20.373496 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10080475-b960-4125-9bf4-489a8e8f8f4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:20.374915 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10080475-b960-4125-9bf4-489a8e8f8f4a service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:20.384169 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1037/2086] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:04:20.568134 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb85b8-5336-466e-ae8f-6115771d07f2 service cinder] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:20.569646 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-bddb85b8-5336-466e-ae8f-6115771d07f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:20.586184 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb85b8-5336-466e-ae8f-6115771d07f2 service cinder] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:20.596654 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5893369-cb0f-4c47-adff-d1344222e086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:20.597360 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5893369-cb0f-4c47-adff-d1344222e086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:20.597748 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5893369-cb0f-4c47-adff-d1344222e086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:20.598083 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5893369-cb0f-4c47-adff-d1344222e086 admin admin] PATH_INFO: `/v3/projects/34f2b9df561a4207a8947176202b430e` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:20.599853 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5893369-cb0f-4c47-adff-d1344222e086 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34f2b9df561a4207a8947176202b430e)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:20.601843 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5893369-cb0f-4c47-adff-d1344222e086 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:20.739626 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-e5893369-cb0f-4c47-adff-d1344222e086 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34f2b9df561a4207a8947176202b430e', 'request_id': 'req-e5893369-cb0f-4c47-adff-d1344222e086'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:20.813791 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b230786-f0ee-4121-9c0d-965c23df07f8 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:20.814831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b230786-f0ee-4121-9c0d-965c23df07f8 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:20.815290 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b230786-f0ee-4121-9c0d-965c23df07f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:20.836497 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-e5893369-cb0f-4c47-adff-d1344222e086 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34f2b9df561a4207a8947176202b430e', 'request_id': 'req-e5893369-cb0f-4c47-adff-d1344222e086'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:20.847490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-e5893369-cb0f-4c47-adff-d1344222e086 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34f2b9df561a4207a8947176202b430e', 'request_id': 'req-e5893369-cb0f-4c47-adff-d1344222e086'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:20.863968 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-e5893369-cb0f-4c47-adff-d1344222e086 admin admin] The token cache is being invalidate because project 34f2b9df561a4207a8947176202b430e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:04:20.864233 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-6b230786-f0ee-4121-9c0d-965c23df07f8 None None] MFA Rules not processed for user `a555b35e0657498fa68fe32e3b0f21cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:20.864825 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-e5893369-cb0f-4c47-adff-d1344222e086 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:20.865688 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-e5893369-cb0f-4c47-adff-d1344222e086 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:20.868065 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1050/2087] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:04:20 2022] DELETE /identity/v3/projects/34f2b9df561a4207a8947176202b430e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:20.873314 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5893369-cb0f-4c47-adff-d1344222e086 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:20.873460 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-6b230786-f0ee-4121-9c0d-965c23df07f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:20.874864 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-e5893369-cb0f-4c47-adff-d1344222e086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:20.965121 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5893369-cb0f-4c47-adff-d1344222e086 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:20.967731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1038/2088] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:04:20.970213 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c15ba-b865-4b8a-b503-90b711f91400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:20.970845 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c15ba-b865-4b8a-b503-90b711f91400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:20.971640 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c15ba-b865-4b8a-b503-90b711f91400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:20.971988 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c15ba-b865-4b8a-b503-90b711f91400 admin admin] PATH_INFO: `/v3/users/2682e89f30fa4e92b9ed4ce40e3a6000` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:20.973259 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c15ba-b865-4b8a-b503-90b711f91400 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2682e89f30fa4e92b9ed4ce40e3a6000)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:20.975278 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c15ba-b865-4b8a-b503-90b711f91400 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:20.987540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b230786-f0ee-4121-9c0d-965c23df07f8 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:20.989953 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-6b230786-f0ee-4121-9c0d-965c23df07f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:21.049032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b230786-f0ee-4121-9c0d-965c23df07f8 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:21.052634 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1dc778-56c6-4c7d-8347-50049ac59c6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:21.053248 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1dc778-56c6-4c7d-8347-50049ac59c6b service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:21.053528 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1dc778-56c6-4c7d-8347-50049ac59c6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:21.053800 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1dc778-56c6-4c7d-8347-50049ac59c6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:21.062455 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1dc778-56c6-4c7d-8347-50049ac59c6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:21.063871 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1dc778-56c6-4c7d-8347-50049ac59c6b service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:21.074422 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1039/2089] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:04:21.325551 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-184c15ba-b865-4b8a-b503-90b711f91400 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2682e89f30fa4e92b9ed4ce40e3a6000'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:21.326936 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-184c15ba-b865-4b8a-b503-90b711f91400 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2682e89f30fa4e92b9ed4ce40e3a6000'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:21.327655 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-184c15ba-b865-4b8a-b503-90b711f91400 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2682e89f30fa4e92b9ed4ce40e3a6000'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:21.339324 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-184c15ba-b865-4b8a-b503-90b711f91400 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2682e89f30fa4e92b9ed4ce40e3a6000'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:21.389481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:21.447704 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-184c15ba-b865-4b8a-b503-90b711f91400 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2682e89f30fa4e92b9ed4ce40e3a6000'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:21.465012 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1051/2090] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:04:20 2022] DELETE /identity/v3/users/2682e89f30fa4e92b9ed4ce40e3a6000 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:04:21.665557 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:22.046482 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1dc778-56c6-4c7d-8347-50049ac59c6b service cinder] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:22.058162 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1dc778-56c6-4c7d-8347-50049ac59c6b service cinder] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:22.137897 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d319aa-76f1-486c-81dd-a597818c5dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:22.138697 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d319aa-76f1-486c-81dd-a597818c5dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:22.139144 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d319aa-76f1-486c-81dd-a597818c5dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:22.139545 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d319aa-76f1-486c-81dd-a597818c5dc2 admin admin] PATH_INFO: `/v3/projects/008de03abfcc4578be730bfa7fedf1c4` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:22.140791 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d319aa-76f1-486c-81dd-a597818c5dc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=008de03abfcc4578be730bfa7fedf1c4)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:22.142981 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d319aa-76f1-486c-81dd-a597818c5dc2 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:22.289005 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-05d319aa-76f1-486c-81dd-a597818c5dc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '008de03abfcc4578be730bfa7fedf1c4', 'request_id': 'req-05d319aa-76f1-486c-81dd-a597818c5dc2'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:22.295269 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-05d319aa-76f1-486c-81dd-a597818c5dc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '008de03abfcc4578be730bfa7fedf1c4', 'request_id': 'req-05d319aa-76f1-486c-81dd-a597818c5dc2'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:22.307017 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-05d319aa-76f1-486c-81dd-a597818c5dc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '008de03abfcc4578be730bfa7fedf1c4', 'request_id': 'req-05d319aa-76f1-486c-81dd-a597818c5dc2'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:22.378756 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-05d319aa-76f1-486c-81dd-a597818c5dc2 admin admin] The token cache is being invalidate because project 008de03abfcc4578be730bfa7fedf1c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:04:22.379052 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-05d319aa-76f1-486c-81dd-a597818c5dc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:22.380081 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-05d319aa-76f1-486c-81dd-a597818c5dc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:22.381656 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1040/2091] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:04:22 2022] DELETE /identity/v3/projects/008de03abfcc4578be730bfa7fedf1c4 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:22.386531 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbaf40d-5e59-4b02-b58c-a50bba71f374 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:22.387033 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbaf40d-5e59-4b02-b58c-a50bba71f374 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:22.387128 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbaf40d-5e59-4b02-b58c-a50bba71f374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:22.407577 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-0cbaf40d-5e59-4b02-b58c-a50bba71f374 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:22.408866 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-0cbaf40d-5e59-4b02-b58c-a50bba71f374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:22.476958 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1052/2092] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:22.479452 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1001ef-10d3-4b7e-a115-e2db40d9bcc8 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:22.480216 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1001ef-10d3-4b7e-a115-e2db40d9bcc8 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:22.480666 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1001ef-10d3-4b7e-a115-e2db40d9bcc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:22.484421 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbaf40d-5e59-4b02-b58c-a50bba71f374 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:22.485990 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-0cbaf40d-5e59-4b02-b58c-a50bba71f374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:22.498565 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbaf40d-5e59-4b02-b58c-a50bba71f374 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:22.504780 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-fc1001ef-10d3-4b7e-a115-e2db40d9bcc8 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:22.505525 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bf038-437e-4b22-a222-610c809e0bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:22.505996 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-fc1001ef-10d3-4b7e-a115-e2db40d9bcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:22.506164 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bf038-437e-4b22-a222-610c809e0bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:22.506476 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bf038-437e-4b22-a222-610c809e0bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:22.506752 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bf038-437e-4b22-a222-610c809e0bf1 admin admin] PATH_INFO: `/v3/users/8696e92665314e3d9fdb23e68aa4ec45` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:22.507892 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70bf038-437e-4b22-a222-610c809e0bf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8696e92665314e3d9fdb23e68aa4ec45)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:22.509863 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70bf038-437e-4b22-a222-610c809e0bf1 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:22.516120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1041/2093] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:22.519888 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1001ef-10d3-4b7e-a115-e2db40d9bcc8 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:22.531939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1001ef-10d3-4b7e-a115-e2db40d9bcc8 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:22.537803 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa7821-2be0-4897-845b-ce97db36841f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:22.538581 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa7821-2be0-4897-845b-ce97db36841f admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:22.538979 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa7821-2be0-4897-845b-ce97db36841f admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:22.539344 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa7821-2be0-4897-845b-ce97db36841f admin admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:22.540093 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa7821-2be0-4897-845b-ce97db36841f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:04:22.540496 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa7821-2be0-4897-845b-ce97db36841f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:22.542241 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa7821-2be0-4897-845b-ce97db36841f admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:22.556918 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1042/2094] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:04:22.563863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa7821-2be0-4897-845b-ce97db36841f admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:22.574239 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa7821-2be0-4897-845b-ce97db36841f admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:22.579306 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648dc19-816d-474c-9a7d-2b953206f155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:22.579935 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648dc19-816d-474c-9a7d-2b953206f155 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:22.580245 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648dc19-816d-474c-9a7d-2b953206f155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:22.580517 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648dc19-816d-474c-9a7d-2b953206f155 admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:22.581195 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648dc19-816d-474c-9a7d-2b953206f155 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:22.583160 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648dc19-816d-474c-9a7d-2b953206f155 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:22.631307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:22.690107 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1043/2095] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:04:22 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:04:22.694062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648dc19-816d-474c-9a7d-2b953206f155 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:22.720909 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f70bf038-437e-4b22-a222-610c809e0bf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8696e92665314e3d9fdb23e68aa4ec45'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:22.722502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f70bf038-437e-4b22-a222-610c809e0bf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8696e92665314e3d9fdb23e68aa4ec45'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:22.723814 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f70bf038-437e-4b22-a222-610c809e0bf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8696e92665314e3d9fdb23e68aa4ec45'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:22.742023 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f70bf038-437e-4b22-a222-610c809e0bf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8696e92665314e3d9fdb23e68aa4ec45'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:22.782557 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648dc19-816d-474c-9a7d-2b953206f155 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:22.787929 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822601f-56a5-4495-9ec4-b668aebc9a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:22.788908 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822601f-56a5-4495-9ec4-b668aebc9a95 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:22.789294 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822601f-56a5-4495-9ec4-b668aebc9a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:22.789671 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822601f-56a5-4495-9ec4-b668aebc9a95 admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:22.790418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822601f-56a5-4495-9ec4-b668aebc9a95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:22.792473 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822601f-56a5-4495-9ec4-b668aebc9a95 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:22.845565 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f70bf038-437e-4b22-a222-610c809e0bf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8696e92665314e3d9fdb23e68aa4ec45'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:22.861519 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1053/2096] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:04:22 2022] DELETE /identity/v3/users/8696e92665314e3d9fdb23e68aa4ec45 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:22.865818 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683e1ef-41f8-4ae0-959b-5b20e9912476 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:22.866618 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683e1ef-41f8-4ae0-959b-5b20e9912476 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:22.866618 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683e1ef-41f8-4ae0-959b-5b20e9912476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:22.888116 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1044/2097] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:04:22 2022] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:04:22.892818 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822601f-56a5-4495-9ec4-b668aebc9a95 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:22.894638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-4822601f-56a5-4495-9ec4-b668aebc9a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:22.909598 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822601f-56a5-4495-9ec4-b668aebc9a95 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:22.910607 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-6683e1ef-41f8-4ae0-959b-5b20e9912476 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:22.913268 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-6683e1ef-41f8-4ae0-959b-5b20e9912476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:22.983652 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2339a-05e3-409e-bec2-2dfa3a65d40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:22.984546 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2339a-05e3-409e-bec2-2dfa3a65d40f admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:22.984886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2339a-05e3-409e-bec2-2dfa3a65d40f admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:22.985130 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2339a-05e3-409e-bec2-2dfa3a65d40f admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:22.985778 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2339a-05e3-409e-bec2-2dfa3a65d40f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:22.987390 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2339a-05e3-409e-bec2-2dfa3a65d40f admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:22.999529 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1045/2098] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:04:23.000869 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb912cf-4dde-4e75-bf6d-e087783a3636 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:23.001144 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb912cf-4dde-4e75-bf6d-e087783a3636 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:23.001417 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb912cf-4dde-4e75-bf6d-e087783a3636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:23.009832 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1054/2099] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:04:23.021920 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683e1ef-41f8-4ae0-959b-5b20e9912476 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:23.022179 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-dbb912cf-4dde-4e75-bf6d-e087783a3636 None None] MFA Rules not processed for user `a555b35e0657498fa68fe32e3b0f21cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:23.023845 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-dbb912cf-4dde-4e75-bf6d-e087783a3636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:23.033383 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683e1ef-41f8-4ae0-959b-5b20e9912476 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:23.044376 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9332c5-4489-4d85-a653-ccc8636769eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:23.045297 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9332c5-4489-4d85-a653-ccc8636769eb admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:23.045752 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9332c5-4489-4d85-a653-ccc8636769eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:23.046188 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9332c5-4489-4d85-a653-ccc8636769eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:23.046925 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9332c5-4489-4d85-a653-ccc8636769eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:23.049048 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9332c5-4489-4d85-a653-ccc8636769eb admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:23.061756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1055/2100] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:23.062661 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9332c5-4489-4d85-a653-ccc8636769eb admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:23.068192 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-9f9332c5-4489-4d85-a653-ccc8636769eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:23.102446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1046/2101] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:23.103355 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb912cf-4dde-4e75-bf6d-e087783a3636 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:23.114881 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb912cf-4dde-4e75-bf6d-e087783a3636 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:23.120085 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168189f-ab99-415c-9bf0-99afedcc5052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:23.120837 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168189f-ab99-415c-9bf0-99afedcc5052 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:23.121048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168189f-ab99-415c-9bf0-99afedcc5052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:23.121333 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168189f-ab99-415c-9bf0-99afedcc5052 admin admin] PATH_INFO: `/v3/projects/12f1428ec960424d87d4b88337a5e8a4/users/b43b74b561ca41bfbdae7beb190b40d7/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:23.143779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168189f-ab99-415c-9bf0-99afedcc5052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12f1428ec960424d87d4b88337a5e8a4, user_id=b43b74b561ca41bfbdae7beb190b40d7, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:23.146721 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168189f-ab99-415c-9bf0-99afedcc5052 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:23.159352 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9332c5-4489-4d85-a653-ccc8636769eb admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:23.164871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c0cd8-73f2-4509-b3d5-c3759164a042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:23.165788 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c0cd8-73f2-4509-b3d5-c3759164a042 service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:23.166165 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c0cd8-73f2-4509-b3d5-c3759164a042 service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:23.167253 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c0cd8-73f2-4509-b3d5-c3759164a042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:23.189316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c0cd8-73f2-4509-b3d5-c3759164a042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:23.190951 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c0cd8-73f2-4509-b3d5-c3759164a042 service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:23.225848 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1056/2102] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:04:23.238594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1047/2103] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:23 2022] PUT /identity/v3/projects/12f1428ec960424d87d4b88337a5e8a4/users/b43b74b561ca41bfbdae7beb190b40d7/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:23.250276 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e2b8e-23eb-429f-9a8f-8123f4e86fdb None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:23.250565 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e2b8e-23eb-429f-9a8f-8123f4e86fdb None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:23.250840 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e2b8e-23eb-429f-9a8f-8123f4e86fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:23.287630 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-817e2b8e-23eb-429f-9a8f-8123f4e86fdb None None] MFA Rules not processed for user `b43b74b561ca41bfbdae7beb190b40d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:23.289072 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-817e2b8e-23eb-429f-9a8f-8123f4e86fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:23.365932 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1057/2104] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:23.370954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168189f-ab99-415c-9bf0-99afedcc5052 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:23.401945 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:23.472650 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168189f-ab99-415c-9bf0-99afedcc5052 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:23.486405 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f12a4c-3fb1-4ecd-a7d4-6a8a53a328b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:23.487176 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f12a4c-3fb1-4ecd-a7d4-6a8a53a328b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:23.487527 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f12a4c-3fb1-4ecd-a7d4-6a8a53a328b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:23.487878 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f12a4c-3fb1-4ecd-a7d4-6a8a53a328b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:23.488778 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f12a4c-3fb1-4ecd-a7d4-6a8a53a328b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:23.491068 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f12a4c-3fb1-4ecd-a7d4-6a8a53a328b3 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:23.623750 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1048/2105] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:04:23 2022] POST /identity/v3/projects => generated 375 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:23.627930 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e2b8e-23eb-429f-9a8f-8123f4e86fdb None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:23.642640 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e2b8e-23eb-429f-9a8f-8123f4e86fdb None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:23.718438 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9e4e4-be42-402f-a192-e4f5a8878e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:23.719067 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9e4e4-be42-402f-a192-e4f5a8878e10 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:23.723301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9e4e4-be42-402f-a192-e4f5a8878e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:23.723301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9e4e4-be42-402f-a192-e4f5a8878e10 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:23.723301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f9e4e4-be42-402f-a192-e4f5a8878e10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:23.723301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f9e4e4-be42-402f-a192-e4f5a8878e10 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:23.825327 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:23.837948 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1058/2106] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:04:23 2022] POST /identity/v3/users => generated 294 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:23.839472 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f12a4c-3fb1-4ecd-a7d4-6a8a53a328b3 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:23.854713 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f12a4c-3fb1-4ecd-a7d4-6a8a53a328b3 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:23.867721 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e57cfd-30bb-4818-b615-fdb3538c3f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:23.869073 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e57cfd-30bb-4818-b615-fdb3538c3f44 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:23.869366 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e57cfd-30bb-4818-b615-fdb3538c3f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:23.869650 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e57cfd-30bb-4818-b615-fdb3538c3f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:23.870308 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e57cfd-30bb-4818-b615-fdb3538c3f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:23.871919 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e57cfd-30bb-4818-b615-fdb3538c3f44 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:23.890400 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1049/2107] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:23.905922 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9e4e4-be42-402f-a192-e4f5a8878e10 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:23.916667 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9e4e4-be42-402f-a192-e4f5a8878e10 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:23.923876 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e53d05-5686-47ea-8cf7-d19bd83d00dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:23.925078 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e53d05-5686-47ea-8cf7-d19bd83d00dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:23.931599 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e53d05-5686-47ea-8cf7-d19bd83d00dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:23.931599 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e53d05-5686-47ea-8cf7-d19bd83d00dd admin admin] PATH_INFO: `/v3/projects/72885ea806a24545bb200733d8a5f9a7/users/1421525f866549279007e7b5419a7597/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:23.947677 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e53d05-5686-47ea-8cf7-d19bd83d00dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=72885ea806a24545bb200733d8a5f9a7, user_id=1421525f866549279007e7b5419a7597, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:23.952344 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e53d05-5686-47ea-8cf7-d19bd83d00dd admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:24.045350 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1059/2108] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:23 2022] PUT /identity/v3/projects/72885ea806a24545bb200733d8a5f9a7/users/1421525f866549279007e7b5419a7597/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:24.048431 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e57cfd-30bb-4818-b615-fdb3538c3f44 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:24.058592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e57cfd-30bb-4818-b615-fdb3538c3f44 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:24.124273 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60e71b-d4d9-48c6-b00c-d9f0be1c2300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:24.124950 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60e71b-d4d9-48c6-b00c-d9f0be1c2300 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:24.125161 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60e71b-d4d9-48c6-b00c-d9f0be1c2300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:24.125433 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60e71b-d4d9-48c6-b00c-d9f0be1c2300 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:24.126084 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60e71b-d4d9-48c6-b00c-d9f0be1c2300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:24.127827 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60e71b-d4d9-48c6-b00c-d9f0be1c2300 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:24.142888 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1050/2109] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:24.146648 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e53d05-5686-47ea-8cf7-d19bd83d00dd admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:24.155091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e53d05-5686-47ea-8cf7-d19bd83d00dd admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:24.168171 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e103f2-aac8-49b3-b25f-9fb8add8a911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:24.171122 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e103f2-aac8-49b3-b25f-9fb8add8a911 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:24.171401 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e103f2-aac8-49b3-b25f-9fb8add8a911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:24.171672 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e103f2-aac8-49b3-b25f-9fb8add8a911 admin admin] PATH_INFO: `/v3/projects/72885ea806a24545bb200733d8a5f9a7/users/1421525f866549279007e7b5419a7597/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:24.173814 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e103f2-aac8-49b3-b25f-9fb8add8a911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72885ea806a24545bb200733d8a5f9a7, user_id=1421525f866549279007e7b5419a7597, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:24.177094 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e103f2-aac8-49b3-b25f-9fb8add8a911 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:24.194184 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1060/2110] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:24 2022] PUT /identity/v3/projects/72885ea806a24545bb200733d8a5f9a7/users/1421525f866549279007e7b5419a7597/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:24.207033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6177f3e-e28e-489c-972f-7f81628bef06 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:24.207651 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6177f3e-e28e-489c-972f-7f81628bef06 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:24.208260 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6177f3e-e28e-489c-972f-7f81628bef06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:24.227845 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e103f2-aac8-49b3-b25f-9fb8add8a911 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:24.230698 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-72e103f2-aac8-49b3-b25f-9fb8add8a911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:24.295081 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-a6177f3e-e28e-489c-972f-7f81628bef06 None None] MFA Rules not processed for user `1421525f866549279007e7b5419a7597`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:24.303457 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-a6177f3e-e28e-489c-972f-7f81628bef06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:24.362091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e103f2-aac8-49b3-b25f-9fb8add8a911 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:24.367537 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2542e4-bbc9-4760-a1fc-f9a64bf53e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:24.368504 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2542e4-bbc9-4760-a1fc-f9a64bf53e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:24.368828 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2542e4-bbc9-4760-a1fc-f9a64bf53e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:24.369242 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2542e4-bbc9-4760-a1fc-f9a64bf53e42 admin admin] PATH_INFO: `/v3/projects/bdf7834bb0cf484c911133f10733ae1d` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:24.370412 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2542e4-bbc9-4760-a1fc-f9a64bf53e42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdf7834bb0cf484c911133f10733ae1d)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:24.372687 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2542e4-bbc9-4760-a1fc-f9a64bf53e42 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:24.427671 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1051/2111] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:24.443044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6177f3e-e28e-489c-972f-7f81628bef06 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:24.443044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-a6177f3e-e28e-489c-972f-7f81628bef06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:24.522303 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-8c2542e4-bbc9-4760-a1fc-f9a64bf53e42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf7834bb0cf484c911133f10733ae1d', 'request_id': 'req-8c2542e4-bbc9-4760-a1fc-f9a64bf53e42'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:24.526859 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6177f3e-e28e-489c-972f-7f81628bef06 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:24.596050 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23e0ed-a801-455b-b31c-ba8759e0f277 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:24.596050 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23e0ed-a801-455b-b31c-ba8759e0f277 service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:24.596050 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23e0ed-a801-455b-b31c-ba8759e0f277 service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:24.596050 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23e0ed-a801-455b-b31c-ba8759e0f277 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:24.620973 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-8c2542e4-bbc9-4760-a1fc-f9a64bf53e42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf7834bb0cf484c911133f10733ae1d', 'request_id': 'req-8c2542e4-bbc9-4760-a1fc-f9a64bf53e42'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:24.632256 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-8c2542e4-bbc9-4760-a1fc-f9a64bf53e42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf7834bb0cf484c911133f10733ae1d', 'request_id': 'req-8c2542e4-bbc9-4760-a1fc-f9a64bf53e42'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:24.649293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-8c2542e4-bbc9-4760-a1fc-f9a64bf53e42 admin admin] The token cache is being invalidate because project bdf7834bb0cf484c911133f10733ae1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:04:24.649293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-8c2542e4-bbc9-4760-a1fc-f9a64bf53e42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:24.649293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-8c2542e4-bbc9-4760-a1fc-f9a64bf53e42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:24.650324 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1061/2112] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:04:24 2022] DELETE /identity/v3/projects/bdf7834bb0cf484c911133f10733ae1d => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:24.688844 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23e0ed-a801-455b-b31c-ba8759e0f277 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:24.690540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23e0ed-a801-455b-b31c-ba8759e0f277 service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:24.702276 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1052/2113] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:04:24.754297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:25.180523 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2542e4-bbc9-4760-a1fc-f9a64bf53e42 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:25.183526 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-8c2542e4-bbc9-4760-a1fc-f9a64bf53e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:25.332000 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2542e4-bbc9-4760-a1fc-f9a64bf53e42 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:25.359964 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562b15b-f024-4140-8581-07d45f1461bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:25.361429 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562b15b-f024-4140-8581-07d45f1461bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:25.361719 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562b15b-f024-4140-8581-07d45f1461bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:25.362000 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562b15b-f024-4140-8581-07d45f1461bc admin admin] PATH_INFO: `/v3/users/d704dda3a75e4b0ca7107d72bc466381` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:25.363290 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562b15b-f024-4140-8581-07d45f1461bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d704dda3a75e4b0ca7107d72bc466381)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:25.365448 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562b15b-f024-4140-8581-07d45f1461bc admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:25.715108 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-3562b15b-f024-4140-8581-07d45f1461bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd704dda3a75e4b0ca7107d72bc466381'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:25.716280 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-3562b15b-f024-4140-8581-07d45f1461bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd704dda3a75e4b0ca7107d72bc466381'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:25.717507 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-3562b15b-f024-4140-8581-07d45f1461bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd704dda3a75e4b0ca7107d72bc466381'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:25.730050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-3562b15b-f024-4140-8581-07d45f1461bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd704dda3a75e4b0ca7107d72bc466381'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:25.802209 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:25.811239 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-3562b15b-f024-4140-8581-07d45f1461bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd704dda3a75e4b0ca7107d72bc466381'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:25.823857 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1062/2114] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:04:25 2022] DELETE /identity/v3/users/d704dda3a75e4b0ca7107d72bc466381 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:25.829277 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb760c48-f1c6-46cf-9a03-18027593e86c None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:25.829771 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb760c48-f1c6-46cf-9a03-18027593e86c None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:25.829860 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb760c48-f1c6-46cf-9a03-18027593e86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:25.850857 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-bb760c48-f1c6-46cf-9a03-18027593e86c None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:25.852046 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-bb760c48-f1c6-46cf-9a03-18027593e86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:25.918479 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1053/2115] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:25.928795 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562b15b-f024-4140-8581-07d45f1461bc admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:25.930384 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-3562b15b-f024-4140-8581-07d45f1461bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:25.988905 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:26.017419 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562b15b-f024-4140-8581-07d45f1461bc admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:26.021628 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5f0cd-1189-4202-aab0-c03b335081aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:26.022432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5f0cd-1189-4202-aab0-c03b335081aa service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:26.023002 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5f0cd-1189-4202-aab0-c03b335081aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:26.023436 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5f0cd-1189-4202-aab0-c03b335081aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:26.027136 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d580226-766e-48e9-b798-da452593fdd1 None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:26.027493 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d580226-766e-48e9-b798-da452593fdd1 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:26.027778 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d580226-766e-48e9-b798-da452593fdd1 None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:26.029510 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1054/2116] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 24 16:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:04:26.035457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5f0cd-1189-4202-aab0-c03b335081aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:26.037349 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5f0cd-1189-4202-aab0-c03b335081aa service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:26.044441 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db08a99-dcd0-4bcf-b532-03fb6484e16f None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:26.044996 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db08a99-dcd0-4bcf-b532-03fb6484e16f None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:26.045845 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db08a99-dcd0-4bcf-b532-03fb6484e16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:26.055716 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1063/2117] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:04:26.072210 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-1db08a99-dcd0-4bcf-b532-03fb6484e16f None None] MFA Rules not processed for user `4f6907dfd3254d3c97d07ca2fb648858`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:26.073895 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-1db08a99-dcd0-4bcf-b532-03fb6484e16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:26.166086 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1055/2118] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 24 16:04:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:04:26.186123 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5f0cd-1189-4202-aab0-c03b335081aa service neutron] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:26.187679 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-c7f5f0cd-1189-4202-aab0-c03b335081aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:26.212510 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5f0cd-1189-4202-aab0-c03b335081aa service neutron] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:26.218347 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a6c96-38cc-4d4a-9a1a-6317b61ed01a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6907dfd3254d3c97d07ca2fb648858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:26.221496 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a6c96-38cc-4d4a-9a1a-6317b61ed01a service placement] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:26.221496 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a6c96-38cc-4d4a-9a1a-6317b61ed01a service placement] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:26.221496 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a6c96-38cc-4d4a-9a1a-6317b61ed01a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:26.228481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a6c96-38cc-4d4a-9a1a-6317b61ed01a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:26.230140 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a6c96-38cc-4d4a-9a1a-6317b61ed01a service placement] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:26.240388 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1064/2119] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:04:26.262851 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db08a99-dcd0-4bcf-b532-03fb6484e16f None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:26.265064 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-1db08a99-dcd0-4bcf-b532-03fb6484e16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:26.300017 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db08a99-dcd0-4bcf-b532-03fb6484e16f None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:26.308975 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23bc025-d252-4b69-8df1-4d36ad7d842b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:26.309968 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bc025-d252-4b69-8df1-4d36ad7d842b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:26.313270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bc025-d252-4b69-8df1-4d36ad7d842b admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:26.313270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bc025-d252-4b69-8df1-4d36ad7d842b admin admin] PATH_INFO: `/v3/users/85a094c88a2144e9a73b320f45987b70` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:26.313270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23bc025-d252-4b69-8df1-4d36ad7d842b admin admin] RBAC: Authorizing `identity:delete_user(user_id=85a094c88a2144e9a73b320f45987b70)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:26.313860 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23bc025-d252-4b69-8df1-4d36ad7d842b admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:26.527794 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a6c96-38cc-4d4a-9a1a-6317b61ed01a service placement] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:26.529603 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-c92a6c96-38cc-4d4a-9a1a-6317b61ed01a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:26.558819 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a6c96-38cc-4d4a-9a1a-6317b61ed01a service placement] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:26.574383 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8456f4-85f0-430b-bcb9-ba6d8426bcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:26.582497 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8456f4-85f0-430b-bcb9-ba6d8426bcaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:26.582842 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c23bc025-d252-4b69-8df1-4d36ad7d842b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85a094c88a2144e9a73b320f45987b70'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:26.582951 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8456f4-85f0-430b-bcb9-ba6d8426bcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:26.582951 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8456f4-85f0-430b-bcb9-ba6d8426bcaa admin admin] PATH_INFO: `/v3/projects/a43c7abdc7af4a0fab0ad654ff98c9dd` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:26.583106 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c23bc025-d252-4b69-8df1-4d36ad7d842b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85a094c88a2144e9a73b320f45987b70'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:26.583198 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8456f4-85f0-430b-bcb9-ba6d8426bcaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a43c7abdc7af4a0fab0ad654ff98c9dd)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:26.583290 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c23bc025-d252-4b69-8df1-4d36ad7d842b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85a094c88a2144e9a73b320f45987b70'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:26.583382 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8456f4-85f0-430b-bcb9-ba6d8426bcaa admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:26.664895 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c23bc025-d252-4b69-8df1-4d36ad7d842b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85a094c88a2144e9a73b320f45987b70'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:26.673161 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c23bc025-d252-4b69-8df1-4d36ad7d842b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85a094c88a2144e9a73b320f45987b70'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:26.690940 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1056/2120] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:04:26 2022] DELETE /identity/v3/users/85a094c88a2144e9a73b320f45987b70 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:04:26.717185 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-ea8456f4-85f0-430b-bcb9-ba6d8426bcaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a43c7abdc7af4a0fab0ad654ff98c9dd', 'request_id': 'req-ea8456f4-85f0-430b-bcb9-ba6d8426bcaa'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:26.788080 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-ea8456f4-85f0-430b-bcb9-ba6d8426bcaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a43c7abdc7af4a0fab0ad654ff98c9dd', 'request_id': 'req-ea8456f4-85f0-430b-bcb9-ba6d8426bcaa'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:26.795399 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-ea8456f4-85f0-430b-bcb9-ba6d8426bcaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a43c7abdc7af4a0fab0ad654ff98c9dd', 'request_id': 'req-ea8456f4-85f0-430b-bcb9-ba6d8426bcaa'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:26.806154 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-ea8456f4-85f0-430b-bcb9-ba6d8426bcaa admin admin] The token cache is being invalidate because project a43c7abdc7af4a0fab0ad654ff98c9dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:04:26.806445 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-ea8456f4-85f0-430b-bcb9-ba6d8426bcaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:26.807098 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-ea8456f4-85f0-430b-bcb9-ba6d8426bcaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:26.808710 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1065/2121] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:04:26 2022] DELETE /identity/v3/projects/a43c7abdc7af4a0fab0ad654ff98c9dd => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:04:26.812897 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23bc025-d252-4b69-8df1-4d36ad7d842b admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:26.814296 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-c23bc025-d252-4b69-8df1-4d36ad7d842b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:26.897329 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23bc025-d252-4b69-8df1-4d36ad7d842b admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:26.945943 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8456f4-85f0-430b-bcb9-ba6d8426bcaa admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:26.947362 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-ea8456f4-85f0-430b-bcb9-ba6d8426bcaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:26.960063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d63330-5d36-45ac-9fd7-6f2db9a89c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:26.960704 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d63330-5d36-45ac-9fd7-6f2db9a89c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:26.961069 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d63330-5d36-45ac-9fd7-6f2db9a89c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:26.966682 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d63330-5d36-45ac-9fd7-6f2db9a89c92 admin admin] PATH_INFO: `/v3/users/d90fd6bf7acf45c1909f3a613debb616` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:26.966682 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d63330-5d36-45ac-9fd7-6f2db9a89c92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d90fd6bf7acf45c1909f3a613debb616)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:26.966682 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d63330-5d36-45ac-9fd7-6f2db9a89c92 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:27.028362 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8456f4-85f0-430b-bcb9-ba6d8426bcaa admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:27.033896 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d3b00-f824-407a-ab5f-ee8e8ba2b92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:27.034532 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d3b00-f824-407a-ab5f-ee8e8ba2b92a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:27.034841 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d3b00-f824-407a-ab5f-ee8e8ba2b92a admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:27.035121 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d3b00-f824-407a-ab5f-ee8e8ba2b92a admin admin] PATH_INFO: `/v3/projects/e3beafcd2bb147ba95f3ca3f158d155c` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:27.036263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d3b00-f824-407a-ab5f-ee8e8ba2b92a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3beafcd2bb147ba95f3ca3f158d155c)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:27.038349 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d3b00-f824-407a-ab5f-ee8e8ba2b92a admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:27.181146 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-f9d63330-5d36-45ac-9fd7-6f2db9a89c92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd90fd6bf7acf45c1909f3a613debb616'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:27.181791 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-f9d63330-5d36-45ac-9fd7-6f2db9a89c92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd90fd6bf7acf45c1909f3a613debb616'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:27.182387 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-f9d63330-5d36-45ac-9fd7-6f2db9a89c92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd90fd6bf7acf45c1909f3a613debb616'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:27.183012 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-8f4d3b00-f824-407a-ab5f-ee8e8ba2b92a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3beafcd2bb147ba95f3ca3f158d155c', 'request_id': 'req-8f4d3b00-f824-407a-ab5f-ee8e8ba2b92a'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:27.256371 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-f9d63330-5d36-45ac-9fd7-6f2db9a89c92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd90fd6bf7acf45c1909f3a613debb616'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:27.263980 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-f9d63330-5d36-45ac-9fd7-6f2db9a89c92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd90fd6bf7acf45c1909f3a613debb616'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:27.285157 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1057/2122] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:04:26 2022] DELETE /identity/v3/users/d90fd6bf7acf45c1909f3a613debb616 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:04:27.317331 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-8f4d3b00-f824-407a-ab5f-ee8e8ba2b92a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3beafcd2bb147ba95f3ca3f158d155c', 'request_id': 'req-8f4d3b00-f824-407a-ab5f-ee8e8ba2b92a'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:27.329625 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-8f4d3b00-f824-407a-ab5f-ee8e8ba2b92a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3beafcd2bb147ba95f3ca3f158d155c', 'request_id': 'req-8f4d3b00-f824-407a-ab5f-ee8e8ba2b92a'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:27.345526 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-8f4d3b00-f824-407a-ab5f-ee8e8ba2b92a admin admin] The token cache is being invalidate because project e3beafcd2bb147ba95f3ca3f158d155c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:04:27.345823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-8f4d3b00-f824-407a-ab5f-ee8e8ba2b92a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:27.346475 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-8f4d3b00-f824-407a-ab5f-ee8e8ba2b92a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:27.348182 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1066/2123] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:04:26 2022] DELETE /identity/v3/projects/e3beafcd2bb147ba95f3ca3f158d155c => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:04:27.353245 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cab37-1d0e-49c2-9dc0-524c3d51c8ff None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:27.353805 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cab37-1d0e-49c2-9dc0-524c3d51c8ff None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:27.354490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cab37-1d0e-49c2-9dc0-524c3d51c8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:27.377445 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-a63cab37-1d0e-49c2-9dc0-524c3d51c8ff None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:27.378712 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-a63cab37-1d0e-49c2-9dc0-524c3d51c8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:27.458309 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1058/2124] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:27.460179 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60faec5-db48-4a3c-b357-b54a953c299d None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:27.460602 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60faec5-db48-4a3c-b357-b54a953c299d None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:27.460909 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60faec5-db48-4a3c-b357-b54a953c299d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:27.483014 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-f60faec5-db48-4a3c-b357-b54a953c299d None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:27.485536 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-f60faec5-db48-4a3c-b357-b54a953c299d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:27.496748 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1067/2125] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:27.498435 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63cab37-1d0e-49c2-9dc0-524c3d51c8ff None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:27.508041 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63cab37-1d0e-49c2-9dc0-524c3d51c8ff None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:27.514397 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf5fa8-66c3-4cf8-9ace-5d576f834d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:27.515016 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf5fa8-66c3-4cf8-9ace-5d576f834d85 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:27.515299 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf5fa8-66c3-4cf8-9ace-5d576f834d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:27.515575 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf5fa8-66c3-4cf8-9ace-5d576f834d85 admin admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:27.516253 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf5fa8-66c3-4cf8-9ace-5d576f834d85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:04:27.516538 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf5fa8-66c3-4cf8-9ace-5d576f834d85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:27.518234 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf5fa8-66c3-4cf8-9ace-5d576f834d85 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:27.531003 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1059/2126] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:04:27.535362 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60faec5-db48-4a3c-b357-b54a953c299d None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:27.546544 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60faec5-db48-4a3c-b357-b54a953c299d None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:27.551347 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c61f3-7b46-48a9-8745-5af5461dafb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:27.551953 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c61f3-7b46-48a9-8745-5af5461dafb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:27.552236 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c61f3-7b46-48a9-8745-5af5461dafb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:27.552509 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c61f3-7b46-48a9-8745-5af5461dafb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:27.553171 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c61f3-7b46-48a9-8745-5af5461dafb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:27.555070 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c61f3-7b46-48a9-8745-5af5461dafb5 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:27.664672 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1068/2127] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:04:27 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:27.666124 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf5fa8-66c3-4cf8-9ace-5d576f834d85 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:27.676852 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf5fa8-66c3-4cf8-9ace-5d576f834d85 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:27.737286 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac4dee-842c-4bd1-ba02-511db056ccfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:27.737962 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac4dee-842c-4bd1-ba02-511db056ccfd admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:27.738239 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac4dee-842c-4bd1-ba02-511db056ccfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:27.738509 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac4dee-842c-4bd1-ba02-511db056ccfd admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:27.739139 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac4dee-842c-4bd1-ba02-511db056ccfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:27.741147 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac4dee-842c-4bd1-ba02-511db056ccfd admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:27.833005 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1060/2128] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:04:27 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:04:27.837060 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c61f3-7b46-48a9-8745-5af5461dafb5 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:27.848714 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c61f3-7b46-48a9-8745-5af5461dafb5 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:27.853454 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede65607-af6b-4e14-ae9a-291f7340e754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:27.854052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede65607-af6b-4e14-ae9a-291f7340e754 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:27.854330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede65607-af6b-4e14-ae9a-291f7340e754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:27.854982 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede65607-af6b-4e14-ae9a-291f7340e754 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:27.855645 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede65607-af6b-4e14-ae9a-291f7340e754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:27.857717 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede65607-af6b-4e14-ae9a-291f7340e754 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:27.868465 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1069/2129] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:27.873510 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac4dee-842c-4bd1-ba02-511db056ccfd admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:27.883603 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac4dee-842c-4bd1-ba02-511db056ccfd admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:27.889266 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7ae55-9dbc-4041-ba71-60e828411d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:27.889875 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7ae55-9dbc-4041-ba71-60e828411d05 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:27.898557 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7ae55-9dbc-4041-ba71-60e828411d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:27.898557 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7ae55-9dbc-4041-ba71-60e828411d05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:27.898557 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7ae55-9dbc-4041-ba71-60e828411d05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:27.898557 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7ae55-9dbc-4041-ba71-60e828411d05 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:27.902969 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1061/2130] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:27.907670 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede65607-af6b-4e14-ae9a-291f7340e754 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:27.918151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede65607-af6b-4e14-ae9a-291f7340e754 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:27.927142 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07125d-bbd0-43eb-81ef-e161cbcf6cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:27.928035 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07125d-bbd0-43eb-81ef-e161cbcf6cd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:27.928499 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07125d-bbd0-43eb-81ef-e161cbcf6cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:27.928854 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07125d-bbd0-43eb-81ef-e161cbcf6cd3 admin admin] PATH_INFO: `/v3/projects/8a64d7c32f44475ba4082b77dd928733/users/d262369e6b7d42d4a3273bccc7cd48ab/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:27.944747 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07125d-bbd0-43eb-81ef-e161cbcf6cd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a64d7c32f44475ba4082b77dd928733, user_id=d262369e6b7d42d4a3273bccc7cd48ab, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:27.947461 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07125d-bbd0-43eb-81ef-e161cbcf6cd3 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:27.947742 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7ae55-9dbc-4041-ba71-60e828411d05 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:27.949502 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-5bd7ae55-9dbc-4041-ba71-60e828411d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:27.955994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:27.963001 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7ae55-9dbc-4041-ba71-60e828411d05 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:27.967700 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d8050-f9df-433f-86ae-b184566a68b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:27.968321 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d8050-f9df-433f-86ae-b184566a68b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:27.968600 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d8050-f9df-433f-86ae-b184566a68b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:27.968904 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d8050-f9df-433f-86ae-b184566a68b3 admin admin] PATH_INFO: `/v3/users/b43b74b561ca41bfbdae7beb190b40d7` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:27.970023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d8050-f9df-433f-86ae-b184566a68b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b43b74b561ca41bfbdae7beb190b40d7)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:27.971962 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d8050-f9df-433f-86ae-b184566a68b3 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:28.024355 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1070/2131] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:27 2022] PUT /identity/v3/projects/8a64d7c32f44475ba4082b77dd928733/users/d262369e6b7d42d4a3273bccc7cd48ab/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:28.035400 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcd957-8bd8-45d2-806f-5ac5ac957a49 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:28.035725 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcd957-8bd8-45d2-806f-5ac5ac957a49 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:28.035979 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcd957-8bd8-45d2-806f-5ac5ac957a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:28.074239 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-7dbcd957-8bd8-45d2-806f-5ac5ac957a49 None None] MFA Rules not processed for user `d262369e6b7d42d4a3273bccc7cd48ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:28.075797 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-7dbcd957-8bd8-45d2-806f-5ac5ac957a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:28.157658 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1071/2132] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:04:28.157658 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcd957-8bd8-45d2-806f-5ac5ac957a49 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:28.157658 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-7dbcd957-8bd8-45d2-806f-5ac5ac957a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:28.220832 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcd957-8bd8-45d2-806f-5ac5ac957a49 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:28.225634 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214a92a-9556-4b20-a445-851fcee8ae6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:28.226444 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214a92a-9556-4b20-a445-851fcee8ae6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:28.226693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214a92a-9556-4b20-a445-851fcee8ae6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:28.226971 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214a92a-9556-4b20-a445-851fcee8ae6f admin admin] PATH_INFO: `/v3/projects/1cb9a0019d2140b4ac2dcc16e4f828f1` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:28.228329 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a214a92a-9556-4b20-a445-851fcee8ae6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cb9a0019d2140b4ac2dcc16e4f828f1)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:28.230293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a214a92a-9556-4b20-a445-851fcee8ae6f admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:28.230661 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:28.330935 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-d93d8050-f9df-433f-86ae-b184566a68b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b43b74b561ca41bfbdae7beb190b40d7'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:28.331628 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-d93d8050-f9df-433f-86ae-b184566a68b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b43b74b561ca41bfbdae7beb190b40d7'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:28.332282 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-d93d8050-f9df-433f-86ae-b184566a68b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b43b74b561ca41bfbdae7beb190b40d7'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:28.334891 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-a214a92a-9556-4b20-a445-851fcee8ae6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cb9a0019d2140b4ac2dcc16e4f828f1', 'request_id': 'req-a214a92a-9556-4b20-a445-851fcee8ae6f'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:28.390017 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-d93d8050-f9df-433f-86ae-b184566a68b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b43b74b561ca41bfbdae7beb190b40d7'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:28.397687 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-d93d8050-f9df-433f-86ae-b184566a68b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b43b74b561ca41bfbdae7beb190b40d7'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:28.417585 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1062/2133] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:04:27 2022] DELETE /identity/v3/users/b43b74b561ca41bfbdae7beb190b40d7 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:28.421539 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d8050-f9df-433f-86ae-b184566a68b3 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:28.421539 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-d93d8050-f9df-433f-86ae-b184566a68b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:28.439462 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-a214a92a-9556-4b20-a445-851fcee8ae6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cb9a0019d2140b4ac2dcc16e4f828f1', 'request_id': 'req-a214a92a-9556-4b20-a445-851fcee8ae6f'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:28.446536 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-a214a92a-9556-4b20-a445-851fcee8ae6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cb9a0019d2140b4ac2dcc16e4f828f1', 'request_id': 'req-a214a92a-9556-4b20-a445-851fcee8ae6f'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:28.458914 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-a214a92a-9556-4b20-a445-851fcee8ae6f admin admin] The token cache is being invalidate because project 1cb9a0019d2140b4ac2dcc16e4f828f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:04:28.459346 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-a214a92a-9556-4b20-a445-851fcee8ae6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:28.460658 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-a214a92a-9556-4b20-a445-851fcee8ae6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:28.465528 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1072/2134] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:04:28 2022] DELETE /identity/v3/projects/1cb9a0019d2140b4ac2dcc16e4f828f1 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:28.467746 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431f6b9-eddd-419e-b0df-4c433eb13571 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:28.468132 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431f6b9-eddd-419e-b0df-4c433eb13571 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:28.468508 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431f6b9-eddd-419e-b0df-4c433eb13571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:28.489616 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d8050-f9df-433f-86ae-b184566a68b3 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:28.490529 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-d431f6b9-eddd-419e-b0df-4c433eb13571 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:28.491849 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-d431f6b9-eddd-419e-b0df-4c433eb13571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:28.496309 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eefc77-e70c-4bbe-8615-3ca57a3e4f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:28.497186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eefc77-e70c-4bbe-8615-3ca57a3e4f12 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:28.497858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eefc77-e70c-4bbe-8615-3ca57a3e4f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:28.498314 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eefc77-e70c-4bbe-8615-3ca57a3e4f12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:28.499089 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eefc77-e70c-4bbe-8615-3ca57a3e4f12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:28.501230 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eefc77-e70c-4bbe-8615-3ca57a3e4f12 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:28.504694 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1073/2135] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:28.504694 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431f6b9-eddd-419e-b0df-4c433eb13571 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:28.504694 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-d431f6b9-eddd-419e-b0df-4c433eb13571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:28.526619 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431f6b9-eddd-419e-b0df-4c433eb13571 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:28.535933 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a217bb-69f5-4d4e-a486-5e5fe6dc6d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:28.536882 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a217bb-69f5-4d4e-a486-5e5fe6dc6d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:28.537499 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a217bb-69f5-4d4e-a486-5e5fe6dc6d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:28.537943 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a217bb-69f5-4d4e-a486-5e5fe6dc6d92 admin admin] PATH_INFO: `/v3/users/19c930658723410ba63790ea9b84f08e` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:28.539190 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a217bb-69f5-4d4e-a486-5e5fe6dc6d92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19c930658723410ba63790ea9b84f08e)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:28.542489 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a217bb-69f5-4d4e-a486-5e5fe6dc6d92 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:28.624850 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1063/2136] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:04:28 2022] POST /identity/v3/projects => generated 371 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:28.626674 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eefc77-e70c-4bbe-8615-3ca57a3e4f12 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:28.628266 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-78eefc77-e70c-4bbe-8615-3ca57a3e4f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:28.688470 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eefc77-e70c-4bbe-8615-3ca57a3e4f12 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:28.692266 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5923a-3677-4f97-805d-4621dd82034e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:28.692907 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5923a-3677-4f97-805d-4621dd82034e service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:28.693190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5923a-3677-4f97-805d-4621dd82034e service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:28.693459 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5923a-3677-4f97-805d-4621dd82034e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:28.746320 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-b1a217bb-69f5-4d4e-a486-5e5fe6dc6d92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19c930658723410ba63790ea9b84f08e'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:28.748509 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-b1a217bb-69f5-4d4e-a486-5e5fe6dc6d92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19c930658723410ba63790ea9b84f08e'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:28.748802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-b1a217bb-69f5-4d4e-a486-5e5fe6dc6d92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19c930658723410ba63790ea9b84f08e'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:28.765931 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-b1a217bb-69f5-4d4e-a486-5e5fe6dc6d92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19c930658723410ba63790ea9b84f08e'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:28.779826 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f5923a-3677-4f97-805d-4621dd82034e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:28.781485 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f5923a-3677-4f97-805d-4621dd82034e service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:28.793061 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1064/2137] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:04:28.793791 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5923a-3677-4f97-805d-4621dd82034e service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:28.795921 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e2f5923a-3677-4f97-805d-4621dd82034e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:28.812832 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5923a-3677-4f97-805d-4621dd82034e service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:28.817810 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995cc35-4631-4363-9112-75c085f27075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:28.818428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995cc35-4631-4363-9112-75c085f27075 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:28.818774 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995cc35-4631-4363-9112-75c085f27075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:28.819052 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995cc35-4631-4363-9112-75c085f27075 admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:28.819677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995cc35-4631-4363-9112-75c085f27075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:28.821765 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995cc35-4631-4363-9112-75c085f27075 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:28.859065 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-b1a217bb-69f5-4d4e-a486-5e5fe6dc6d92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19c930658723410ba63790ea9b84f08e'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:28.874514 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1074/2138] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:04:28 2022] DELETE /identity/v3/users/19c930658723410ba63790ea9b84f08e => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:28.943577 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1065/2139] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:04:28 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:28.947547 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a217bb-69f5-4d4e-a486-5e5fe6dc6d92 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:28.949032 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-b1a217bb-69f5-4d4e-a486-5e5fe6dc6d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:29.016074 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a217bb-69f5-4d4e-a486-5e5fe6dc6d92 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:29.020710 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cebd487-7550-4415-8ac4-8d42453322df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:29.021310 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebd487-7550-4415-8ac4-8d42453322df admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:29.021591 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebd487-7550-4415-8ac4-8d42453322df admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:29.021862 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebd487-7550-4415-8ac4-8d42453322df admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:29.022636 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cebd487-7550-4415-8ac4-8d42453322df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:29.024099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cebd487-7550-4415-8ac4-8d42453322df admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:29.034941 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1075/2140] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:29.039334 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995cc35-4631-4363-9112-75c085f27075 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:29.050311 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995cc35-4631-4363-9112-75c085f27075 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:29.055956 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a952f01-9fe8-4f7b-8ed0-28b5f40ad553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:29.056891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a952f01-9fe8-4f7b-8ed0-28b5f40ad553 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:29.057181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a952f01-9fe8-4f7b-8ed0-28b5f40ad553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:29.057482 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a952f01-9fe8-4f7b-8ed0-28b5f40ad553 admin admin] PATH_INFO: `/v3/projects/256ee4951e15450a8c32f4f1753bfc57/users/92611425adc843ac97ed5d5d4cc8e7b5/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:29.073930 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a952f01-9fe8-4f7b-8ed0-28b5f40ad553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=256ee4951e15450a8c32f4f1753bfc57, user_id=92611425adc843ac97ed5d5d4cc8e7b5, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:29.076939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a952f01-9fe8-4f7b-8ed0-28b5f40ad553 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:29.100593 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:29.241419 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1066/2141] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:29 2022] PUT /identity/v3/projects/256ee4951e15450a8c32f4f1753bfc57/users/92611425adc843ac97ed5d5d4cc8e7b5/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:04:29.243248 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cebd487-7550-4415-8ac4-8d42453322df admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:29.253696 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cebd487-7550-4415-8ac4-8d42453322df admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:29.315657 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec09f7-4afc-4e3c-8047-89e0f0db6885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:29.316274 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec09f7-4afc-4e3c-8047-89e0f0db6885 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:29.316738 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec09f7-4afc-4e3c-8047-89e0f0db6885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:29.317020 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec09f7-4afc-4e3c-8047-89e0f0db6885 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:29.317673 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec09f7-4afc-4e3c-8047-89e0f0db6885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:29.321587 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec09f7-4afc-4e3c-8047-89e0f0db6885 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:29.332212 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1076/2142] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:29.338533 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a952f01-9fe8-4f7b-8ed0-28b5f40ad553 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:29.351498 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a952f01-9fe8-4f7b-8ed0-28b5f40ad553 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:29.358332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d0f74-cfe5-4416-88a8-e32cbd198eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:29.361044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d0f74-cfe5-4416-88a8-e32cbd198eca admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:29.361044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d0f74-cfe5-4416-88a8-e32cbd198eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:29.361044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d0f74-cfe5-4416-88a8-e32cbd198eca admin admin] PATH_INFO: `/v3/projects/256ee4951e15450a8c32f4f1753bfc57/users/92611425adc843ac97ed5d5d4cc8e7b5/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:29.362096 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d0f74-cfe5-4416-88a8-e32cbd198eca admin admin] RBAC: Authorizing `identity:create_grant(project_id=256ee4951e15450a8c32f4f1753bfc57, user_id=92611425adc843ac97ed5d5d4cc8e7b5, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:29.364807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d0f74-cfe5-4416-88a8-e32cbd198eca admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:29.381034 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1067/2143] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:29 2022] PUT /identity/v3/projects/256ee4951e15450a8c32f4f1753bfc57/users/92611425adc843ac97ed5d5d4cc8e7b5/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:04:29.388422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99e59d-d746-4347-a9b2-19a8f240855a None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:29.388818 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99e59d-d746-4347-a9b2-19a8f240855a None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:29.389098 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99e59d-d746-4347-a9b2-19a8f240855a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:29.420255 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-db99e59d-d746-4347-a9b2-19a8f240855a None None] MFA Rules not processed for user `92611425adc843ac97ed5d5d4cc8e7b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:29.421532 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-db99e59d-d746-4347-a9b2-19a8f240855a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:29.502092 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1077/2144] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:29.514245 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d0f74-cfe5-4416-88a8-e32cbd198eca admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:29.516050 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-9b2d0f74-cfe5-4416-88a8-e32cbd198eca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:29.549451 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99e59d-d746-4347-a9b2-19a8f240855a None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:29.552409 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-db99e59d-d746-4347-a9b2-19a8f240855a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:29.598208 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d0f74-cfe5-4416-88a8-e32cbd198eca admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:29.601044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b5f2f-d01a-4a13-b6c5-712e866405fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:29.603234 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b5f2f-d01a-4a13-b6c5-712e866405fd service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:29.604094 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b5f2f-d01a-4a13-b6c5-712e866405fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:29.604094 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b5f2f-d01a-4a13-b6c5-712e866405fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:29.616508 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b5f2f-d01a-4a13-b6c5-712e866405fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:29.619264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b5f2f-d01a-4a13-b6c5-712e866405fd service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:29.631268 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1068/2145] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:04:29.631925 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b5f2f-d01a-4a13-b6c5-712e866405fd service cinder] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:29.633460 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-7e5b5f2f-d01a-4a13-b6c5-712e866405fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:29.668538 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99e59d-d746-4347-a9b2-19a8f240855a None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:29.677443 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86845a-7a4d-40d1-bdd2-f8dd0e939bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:29.678290 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86845a-7a4d-40d1-bdd2-f8dd0e939bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:29.678576 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86845a-7a4d-40d1-bdd2-f8dd0e939bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:29.678852 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86845a-7a4d-40d1-bdd2-f8dd0e939bb0 admin admin] PATH_INFO: `/v3/projects/12f1428ec960424d87d4b88337a5e8a4` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:29.680166 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86845a-7a4d-40d1-bdd2-f8dd0e939bb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12f1428ec960424d87d4b88337a5e8a4)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:29.682478 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86845a-7a4d-40d1-bdd2-f8dd0e939bb0 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:29.732553 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b5f2f-d01a-4a13-b6c5-712e866405fd service cinder] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:29.739529 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36be89-5472-4332-a9f0-7120955db6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:29.740197 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36be89-5472-4332-a9f0-7120955db6df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:29.740755 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36be89-5472-4332-a9f0-7120955db6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:29.740996 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36be89-5472-4332-a9f0-7120955db6df admin admin] PATH_INFO: `/v3/projects/5c05902dd9214eeb93e0fe650ae37950` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:29.743947 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36be89-5472-4332-a9f0-7120955db6df admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c05902dd9214eeb93e0fe650ae37950)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:29.752187 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36be89-5472-4332-a9f0-7120955db6df admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:29.805843 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:29.807219 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-ec86845a-7a4d-40d1-bdd2-f8dd0e939bb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12f1428ec960424d87d4b88337a5e8a4', 'request_id': 'req-ec86845a-7a4d-40d1-bdd2-f8dd0e939bb0'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:29.870103 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-bc36be89-5472-4332-a9f0-7120955db6df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c05902dd9214eeb93e0fe650ae37950', 'request_id': 'req-bc36be89-5472-4332-a9f0-7120955db6df'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:29.876878 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-bc36be89-5472-4332-a9f0-7120955db6df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c05902dd9214eeb93e0fe650ae37950', 'request_id': 'req-bc36be89-5472-4332-a9f0-7120955db6df'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:29.883065 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-bc36be89-5472-4332-a9f0-7120955db6df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c05902dd9214eeb93e0fe650ae37950', 'request_id': 'req-bc36be89-5472-4332-a9f0-7120955db6df'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:29.897002 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-ec86845a-7a4d-40d1-bdd2-f8dd0e939bb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12f1428ec960424d87d4b88337a5e8a4', 'request_id': 'req-ec86845a-7a4d-40d1-bdd2-f8dd0e939bb0'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:29.904398 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-ec86845a-7a4d-40d1-bdd2-f8dd0e939bb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12f1428ec960424d87d4b88337a5e8a4', 'request_id': 'req-ec86845a-7a4d-40d1-bdd2-f8dd0e939bb0'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:29.916247 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-ec86845a-7a4d-40d1-bdd2-f8dd0e939bb0 admin admin] The token cache is being invalidate because project 12f1428ec960424d87d4b88337a5e8a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:04:29.916546 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-ec86845a-7a4d-40d1-bdd2-f8dd0e939bb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:29.917283 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-ec86845a-7a4d-40d1-bdd2-f8dd0e939bb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:29.918835 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1078/2146] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:04:29 2022] DELETE /identity/v3/projects/12f1428ec960424d87d4b88337a5e8a4 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:29.924603 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86845a-7a4d-40d1-bdd2-f8dd0e939bb0 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:29.926178 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-ec86845a-7a4d-40d1-bdd2-f8dd0e939bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:29.993234 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86845a-7a4d-40d1-bdd2-f8dd0e939bb0 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:30.025589 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-bc36be89-5472-4332-a9f0-7120955db6df admin admin] The token cache is being invalidate because project 5c05902dd9214eeb93e0fe650ae37950 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:04:30.026168 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-bc36be89-5472-4332-a9f0-7120955db6df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:30.026773 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-bc36be89-5472-4332-a9f0-7120955db6df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:30.030556 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1069/2147] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:04:29 2022] DELETE /identity/v3/projects/5c05902dd9214eeb93e0fe650ae37950 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:30.031682 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36be89-5472-4332-a9f0-7120955db6df admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:30.034216 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-bc36be89-5472-4332-a9f0-7120955db6df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:30.051657 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7e2d4-295a-40ba-80c8-dc4512bd4eb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:30.053911 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7e2d4-295a-40ba-80c8-dc4512bd4eb6 service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:30.053911 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7e2d4-295a-40ba-80c8-dc4512bd4eb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:30.053911 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7e2d4-295a-40ba-80c8-dc4512bd4eb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:30.055049 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-e8e7e2d4-295a-40ba-80c8-dc4512bd4eb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:30.111005 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36be89-5472-4332-a9f0-7120955db6df admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:30.116159 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e1d34-8562-48a3-9288-1dff4151ddc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:30.116831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e1d34-8562-48a3-9288-1dff4151ddc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:30.117110 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e1d34-8562-48a3-9288-1dff4151ddc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:30.117382 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e1d34-8562-48a3-9288-1dff4151ddc8 admin admin] PATH_INFO: `/v3/users/1421525f866549279007e7b5419a7597` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:30.118981 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e1d34-8562-48a3-9288-1dff4151ddc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1421525f866549279007e7b5419a7597)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:30.121348 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e1d34-8562-48a3-9288-1dff4151ddc8 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:30.125127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7e2d4-295a-40ba-80c8-dc4512bd4eb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:30.126706 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7e2d4-295a-40ba-80c8-dc4512bd4eb6 service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:30.136232 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1079/2148] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:04:30.137556 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d98f9-d1db-4d50-b46c-6453c1f3e929 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:30.138391 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d98f9-d1db-4d50-b46c-6453c1f3e929 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:30.138706 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d98f9-d1db-4d50-b46c-6453c1f3e929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:30.159746 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-838d98f9-d1db-4d50-b46c-6453c1f3e929 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:30.161004 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-838d98f9-d1db-4d50-b46c-6453c1f3e929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:30.171156 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1080/2149] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:30.179401 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421daed-0830-4b62-876c-d9f4fd644493 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:30.179764 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421daed-0830-4b62-876c-d9f4fd644493 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:30.180051 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421daed-0830-4b62-876c-d9f4fd644493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:30.197271 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:30.203793 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-2421daed-0830-4b62-876c-d9f4fd644493 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:30.205047 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-2421daed-0830-4b62-876c-d9f4fd644493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:30.213236 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1081/2150] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:04:30.217938 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421daed-0830-4b62-876c-d9f4fd644493 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:30.227279 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421daed-0830-4b62-876c-d9f4fd644493 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:30.232774 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72ce39-faec-4277-bcc8-9511efbe3e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:30.233758 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72ce39-faec-4277-bcc8-9511efbe3e60 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:30.234040 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72ce39-faec-4277-bcc8-9511efbe3e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:30.234315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72ce39-faec-4277-bcc8-9511efbe3e60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:30.234963 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72ce39-faec-4277-bcc8-9511efbe3e60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:04:30.235267 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72ce39-faec-4277-bcc8-9511efbe3e60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:30.236948 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72ce39-faec-4277-bcc8-9511efbe3e60 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:30.249660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1082/2151] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:04:30.253897 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72ce39-faec-4277-bcc8-9511efbe3e60 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:30.263750 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72ce39-faec-4277-bcc8-9511efbe3e60 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:30.268521 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186762e3-6b09-4e6e-abc7-0c3210fdf002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:30.269159 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186762e3-6b09-4e6e-abc7-0c3210fdf002 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:30.269480 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186762e3-6b09-4e6e-abc7-0c3210fdf002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:30.270308 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186762e3-6b09-4e6e-abc7-0c3210fdf002 admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:30.271271 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186762e3-6b09-4e6e-abc7-0c3210fdf002 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:30.273254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186762e3-6b09-4e6e-abc7-0c3210fdf002 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:30.327386 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-776e1d34-8562-48a3-9288-1dff4151ddc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1421525f866549279007e7b5419a7597'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:30.328034 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-776e1d34-8562-48a3-9288-1dff4151ddc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1421525f866549279007e7b5419a7597'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:30.328656 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-776e1d34-8562-48a3-9288-1dff4151ddc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1421525f866549279007e7b5419a7597'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:30.400584 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1083/2152] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:04:30 2022] POST /identity/v3/projects => generated 379 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:04:30.405698 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186762e3-6b09-4e6e-abc7-0c3210fdf002 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:30.407270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-186762e3-6b09-4e6e-abc7-0c3210fdf002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:30.422799 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-776e1d34-8562-48a3-9288-1dff4151ddc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1421525f866549279007e7b5419a7597'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:30.431357 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-776e1d34-8562-48a3-9288-1dff4151ddc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1421525f866549279007e7b5419a7597'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:30.451288 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1070/2153] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:04:30 2022] DELETE /identity/v3/users/1421525f866549279007e7b5419a7597 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:30.472317 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186762e3-6b09-4e6e-abc7-0c3210fdf002 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:30.550884 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376a250-fb35-46d2-96b2-3b625bf9f9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:30.552436 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376a250-fb35-46d2-96b2-3b625bf9f9e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:30.552964 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376a250-fb35-46d2-96b2-3b625bf9f9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:30.553450 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376a250-fb35-46d2-96b2-3b625bf9f9e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:30.554709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376a250-fb35-46d2-96b2-3b625bf9f9e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:30.560682 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376a250-fb35-46d2-96b2-3b625bf9f9e0 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:30.642876 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1084/2154] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:04:30 2022] POST /identity/v3/users => generated 290 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:04:30.644129 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e1d34-8562-48a3-9288-1dff4151ddc8 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:30.655677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e1d34-8562-48a3-9288-1dff4151ddc8 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:30.660467 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67adf77-a79e-48ff-a228-d048b2a9846e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:30.661292 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67adf77-a79e-48ff-a228-d048b2a9846e admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:30.661573 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67adf77-a79e-48ff-a228-d048b2a9846e admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:30.661846 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67adf77-a79e-48ff-a228-d048b2a9846e admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:30.662571 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67adf77-a79e-48ff-a228-d048b2a9846e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:30.664222 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67adf77-a79e-48ff-a228-d048b2a9846e admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:30.676086 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1071/2155] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:30.679847 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376a250-fb35-46d2-96b2-3b625bf9f9e0 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:30.693011 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376a250-fb35-46d2-96b2-3b625bf9f9e0 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:30.697797 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ce47a-b4e1-4175-9648-b390cbe30a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:30.698403 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ce47a-b4e1-4175-9648-b390cbe30a76 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:30.698683 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ce47a-b4e1-4175-9648-b390cbe30a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:30.698954 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ce47a-b4e1-4175-9648-b390cbe30a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:30.699630 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ce47a-b4e1-4175-9648-b390cbe30a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:30.702397 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ce47a-b4e1-4175-9648-b390cbe30a76 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:30.713758 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1085/2156] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:30.718428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67adf77-a79e-48ff-a228-d048b2a9846e admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:30.728585 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67adf77-a79e-48ff-a228-d048b2a9846e admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:30.733837 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885df1a-ed46-46c2-8eb7-edcd42876623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:30.734495 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885df1a-ed46-46c2-8eb7-edcd42876623 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:30.734775 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885df1a-ed46-46c2-8eb7-edcd42876623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:30.735046 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885df1a-ed46-46c2-8eb7-edcd42876623 admin admin] PATH_INFO: `/v3/projects/6785a53b02ac4d5cb1ee8dc77b19f0e4/users/bf530387868f4c81816e7990ffccc148/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:30.751139 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885df1a-ed46-46c2-8eb7-edcd42876623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6785a53b02ac4d5cb1ee8dc77b19f0e4, user_id=bf530387868f4c81816e7990ffccc148, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:30.755293 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885df1a-ed46-46c2-8eb7-edcd42876623 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:30.835841 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1072/2157] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:30 2022] PUT /identity/v3/projects/6785a53b02ac4d5cb1ee8dc77b19f0e4/users/bf530387868f4c81816e7990ffccc148/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:30.848057 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e175008-2d87-4e31-9bf9-60d89720b6f5 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:30.848350 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e175008-2d87-4e31-9bf9-60d89720b6f5 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:30.848650 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e175008-2d87-4e31-9bf9-60d89720b6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:30.861786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885df1a-ed46-46c2-8eb7-edcd42876623 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:30.863777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-5885df1a-ed46-46c2-8eb7-edcd42876623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:30.886033 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-8e175008-2d87-4e31-9bf9-60d89720b6f5 None None] MFA Rules not processed for user `bf530387868f4c81816e7990ffccc148`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:30.886378 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-8e175008-2d87-4e31-9bf9-60d89720b6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:30.949490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885df1a-ed46-46c2-8eb7-edcd42876623 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:30.954714 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b1792-d134-4b25-8640-e69e0d0e8187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:30.955346 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b1792-d134-4b25-8640-e69e0d0e8187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:30.955815 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b1792-d134-4b25-8640-e69e0d0e8187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:30.956097 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b1792-d134-4b25-8640-e69e0d0e8187 admin admin] PATH_INFO: `/v3/projects/72885ea806a24545bb200733d8a5f9a7` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:30.957238 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b1792-d134-4b25-8640-e69e0d0e8187 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72885ea806a24545bb200733d8a5f9a7)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:30.959134 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b1792-d134-4b25-8640-e69e0d0e8187 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:30.966925 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1086/2158] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:30.971542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e175008-2d87-4e31-9bf9-60d89720b6f5 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:30.984466 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e175008-2d87-4e31-9bf9-60d89720b6f5 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:30.989666 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc3ca2-2ae3-46bd-87e5-09c8ae310642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:30.990291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc3ca2-2ae3-46bd-87e5-09c8ae310642 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:30.990573 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc3ca2-2ae3-46bd-87e5-09c8ae310642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:30.990850 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc3ca2-2ae3-46bd-87e5-09c8ae310642 admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:30.991482 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc3ca2-2ae3-46bd-87e5-09c8ae310642 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:30.993450 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc3ca2-2ae3-46bd-87e5-09c8ae310642 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:31.111264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c60b1792-d134-4b25-8640-e69e0d0e8187 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72885ea806a24545bb200733d8a5f9a7', 'request_id': 'req-c60b1792-d134-4b25-8640-e69e0d0e8187'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:31.116719 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c60b1792-d134-4b25-8640-e69e0d0e8187 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72885ea806a24545bb200733d8a5f9a7', 'request_id': 'req-c60b1792-d134-4b25-8640-e69e0d0e8187'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:31.125043 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c60b1792-d134-4b25-8640-e69e0d0e8187 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72885ea806a24545bb200733d8a5f9a7', 'request_id': 'req-c60b1792-d134-4b25-8640-e69e0d0e8187'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:31.133164 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1087/2159] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:04:30 2022] POST /identity/v3/projects => generated 381 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:31.134459 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc3ca2-2ae3-46bd-87e5-09c8ae310642 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:31.198397 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc3ca2-2ae3-46bd-87e5-09c8ae310642 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:31.203748 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518b2f1-85c6-49fd-a202-6cc6148d3302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:31.204357 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518b2f1-85c6-49fd-a202-6cc6148d3302 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:31.204672 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518b2f1-85c6-49fd-a202-6cc6148d3302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:31.205001 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518b2f1-85c6-49fd-a202-6cc6148d3302 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:31.205642 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f518b2f1-85c6-49fd-a202-6cc6148d3302 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:31.207574 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:31.210213 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f518b2f1-85c6-49fd-a202-6cc6148d3302 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:31.212254 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c60b1792-d134-4b25-8640-e69e0d0e8187 admin admin] The token cache is being invalidate because project 72885ea806a24545bb200733d8a5f9a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:04:31.212549 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c60b1792-d134-4b25-8640-e69e0d0e8187 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:31.213236 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c60b1792-d134-4b25-8640-e69e0d0e8187 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:31.215477 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1073/2160] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:04:30 2022] DELETE /identity/v3/projects/72885ea806a24545bb200733d8a5f9a7 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:31.225751 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330acf06-8557-460a-8516-90fa74a9f1ba None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:31.226119 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330acf06-8557-460a-8516-90fa74a9f1ba None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:31.226459 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330acf06-8557-460a-8516-90fa74a9f1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:31.246718 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-330acf06-8557-460a-8516-90fa74a9f1ba None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:31.248515 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-330acf06-8557-460a-8516-90fa74a9f1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:31.257432 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1074/2161] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:04:31.265804 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d2ea2-bd13-4e9f-9ba6-02c1fa6b23b5 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:31.266091 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d2ea2-bd13-4e9f-9ba6-02c1fa6b23b5 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:31.266364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d2ea2-bd13-4e9f-9ba6-02c1fa6b23b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:31.293436 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-434d2ea2-bd13-4e9f-9ba6-02c1fa6b23b5 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:31.295324 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-434d2ea2-bd13-4e9f-9ba6-02c1fa6b23b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:31.303258 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1075/2162] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:04:31.306282 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1088/2163] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:04:31 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:31.308872 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d2ea2-bd13-4e9f-9ba6-02c1fa6b23b5 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:31.310483 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518b2f1-85c6-49fd-a202-6cc6148d3302 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:31.310698 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-434d2ea2-bd13-4e9f-9ba6-02c1fa6b23b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:31.320841 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518b2f1-85c6-49fd-a202-6cc6148d3302 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:31.322467 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d2ea2-bd13-4e9f-9ba6-02c1fa6b23b5 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:31.325715 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b37312-f0c4-4fb4-a14f-2adb7716b13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:31.329107 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b37312-f0c4-4fb4-a14f-2adb7716b13a admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:31.329107 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b37312-f0c4-4fb4-a14f-2adb7716b13a admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:31.329107 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b37312-f0c4-4fb4-a14f-2adb7716b13a admin admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:31.329107 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b37312-f0c4-4fb4-a14f-2adb7716b13a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:04:31.329450 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94b0ab-9774-4a76-aa90-9bad6a92d129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:31.329549 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b37312-f0c4-4fb4-a14f-2adb7716b13a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:31.329634 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94b0ab-9774-4a76-aa90-9bad6a92d129 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:31.329634 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94b0ab-9774-4a76-aa90-9bad6a92d129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:31.329634 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94b0ab-9774-4a76-aa90-9bad6a92d129 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:31.329879 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b37312-f0c4-4fb4-a14f-2adb7716b13a admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:31.329961 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94b0ab-9774-4a76-aa90-9bad6a92d129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:31.331219 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94b0ab-9774-4a76-aa90-9bad6a92d129 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:31.341906 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1076/2164] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:31.346215 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94b0ab-9774-4a76-aa90-9bad6a92d129 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:31.348428 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1089/2165] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:04:31.349364 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b37312-f0c4-4fb4-a14f-2adb7716b13a admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:31.357199 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94b0ab-9774-4a76-aa90-9bad6a92d129 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:31.360205 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b37312-f0c4-4fb4-a14f-2adb7716b13a admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:31.362474 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae7504-3fe8-4a53-9f84-6bd71a7bc390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:31.363125 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae7504-3fe8-4a53-9f84-6bd71a7bc390 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:31.363412 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae7504-3fe8-4a53-9f84-6bd71a7bc390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:31.363687 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae7504-3fe8-4a53-9f84-6bd71a7bc390 admin admin] PATH_INFO: `/v3/projects/d117bdcd309c457a841bab0fc917e449/users/4d87275d49584354b71d4e1ae16971a6/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:31.365256 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd289f-463c-4174-aa9e-ab3a71cf26d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:31.365851 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd289f-463c-4174-aa9e-ab3a71cf26d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:31.366137 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd289f-463c-4174-aa9e-ab3a71cf26d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:31.366444 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd289f-463c-4174-aa9e-ab3a71cf26d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:31.367071 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd289f-463c-4174-aa9e-ab3a71cf26d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:31.369010 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd289f-463c-4174-aa9e-ab3a71cf26d8 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:31.378363 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae7504-3fe8-4a53-9f84-6bd71a7bc390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d117bdcd309c457a841bab0fc917e449, user_id=4d87275d49584354b71d4e1ae16971a6, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:31.381050 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae7504-3fe8-4a53-9f84-6bd71a7bc390 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:31.407108 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:31.446363 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1077/2166] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:31 2022] PUT /identity/v3/projects/d117bdcd309c457a841bab0fc917e449/users/4d87275d49584354b71d4e1ae16971a6/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:04:31.450426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae7504-3fe8-4a53-9f84-6bd71a7bc390 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:31.472285 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1090/2167] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:04:31 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:04:31.476319 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd289f-463c-4174-aa9e-ab3a71cf26d8 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:31.511258 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae7504-3fe8-4a53-9f84-6bd71a7bc390 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:31.537713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd289f-463c-4174-aa9e-ab3a71cf26d8 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:31.542447 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26981ddf-0ad4-493f-b2b3-26a5d91ad838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:31.543050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26981ddf-0ad4-493f-b2b3-26a5d91ad838 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:31.543325 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26981ddf-0ad4-493f-b2b3-26a5d91ad838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:31.543597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26981ddf-0ad4-493f-b2b3-26a5d91ad838 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:31.548766 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26981ddf-0ad4-493f-b2b3-26a5d91ad838 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:31.548766 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26981ddf-0ad4-493f-b2b3-26a5d91ad838 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:31.568170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f89fc5-c901-4b9f-8428-f8a1d5ff9be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:31.568821 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f89fc5-c901-4b9f-8428-f8a1d5ff9be6 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:31.569111 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f89fc5-c901-4b9f-8428-f8a1d5ff9be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:31.574097 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f89fc5-c901-4b9f-8428-f8a1d5ff9be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:31.574097 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f89fc5-c901-4b9f-8428-f8a1d5ff9be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:31.574097 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f89fc5-c901-4b9f-8428-f8a1d5ff9be6 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:31.581643 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1078/2168] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:04:31.585758 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f89fc5-c901-4b9f-8428-f8a1d5ff9be6 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:31.595793 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f89fc5-c901-4b9f-8428-f8a1d5ff9be6 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:31.600527 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d11c73-5173-4d1d-b77f-3e213d27cfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:31.601288 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d11c73-5173-4d1d-b77f-3e213d27cfeb admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:31.601473 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d11c73-5173-4d1d-b77f-3e213d27cfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:31.601747 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d11c73-5173-4d1d-b77f-3e213d27cfeb admin admin] PATH_INFO: `/v3/projects/d117bdcd309c457a841bab0fc917e449/users/4d87275d49584354b71d4e1ae16971a6/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:31.603655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d11c73-5173-4d1d-b77f-3e213d27cfeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d117bdcd309c457a841bab0fc917e449, user_id=4d87275d49584354b71d4e1ae16971a6, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:31.606436 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d11c73-5173-4d1d-b77f-3e213d27cfeb admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:31.617479 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1079/2169] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:31 2022] PUT /identity/v3/projects/d117bdcd309c457a841bab0fc917e449/users/4d87275d49584354b71d4e1ae16971a6/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:04:31.628586 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1091/2170] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:04:31 2022] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:04:31.628800 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13454b00-5f71-4327-85e9-421401a694e1 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:31.629103 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13454b00-5f71-4327-85e9-421401a694e1 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:31.629437 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13454b00-5f71-4327-85e9-421401a694e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:31.633394 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26981ddf-0ad4-493f-b2b3-26a5d91ad838 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:31.645387 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26981ddf-0ad4-493f-b2b3-26a5d91ad838 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:31.661286 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-13454b00-5f71-4327-85e9-421401a694e1 None None] MFA Rules not processed for user `4d87275d49584354b71d4e1ae16971a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:31.662593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-13454b00-5f71-4327-85e9-421401a694e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:31.706818 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32e8e2-bd21-4975-9e6d-3bdc00ff6658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:31.707453 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32e8e2-bd21-4975-9e6d-3bdc00ff6658 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:31.707745 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32e8e2-bd21-4975-9e6d-3bdc00ff6658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:31.708017 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32e8e2-bd21-4975-9e6d-3bdc00ff6658 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:31.708826 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b32e8e2-bd21-4975-9e6d-3bdc00ff6658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:31.710427 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b32e8e2-bd21-4975-9e6d-3bdc00ff6658 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:31.721196 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1092/2171] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:31.725157 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32e8e2-bd21-4975-9e6d-3bdc00ff6658 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:31.736057 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32e8e2-bd21-4975-9e6d-3bdc00ff6658 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:31.740432 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1080/2172] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:31 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:31.741631 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16852409-5677-4018-b35c-a2f8aef49ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:31.742331 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16852409-5677-4018-b35c-a2f8aef49ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:31.742626 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16852409-5677-4018-b35c-a2f8aef49ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:31.742911 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16852409-5677-4018-b35c-a2f8aef49ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:31.743556 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16852409-5677-4018-b35c-a2f8aef49ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:31.745303 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16852409-5677-4018-b35c-a2f8aef49ac3 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:31.752331 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13454b00-5f71-4327-85e9-421401a694e1 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:31.753786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-13454b00-5f71-4327-85e9-421401a694e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:31.757851 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1093/2173] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:31.762220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16852409-5677-4018-b35c-a2f8aef49ac3 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:31.775660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16852409-5677-4018-b35c-a2f8aef49ac3 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:31.781429 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f262eb2-a895-407e-8f0f-c5c069c7a89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:31.782093 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f262eb2-a895-407e-8f0f-c5c069c7a89c admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:31.783445 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f262eb2-a895-407e-8f0f-c5c069c7a89c admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:31.783445 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f262eb2-a895-407e-8f0f-c5c069c7a89c admin admin] PATH_INFO: `/v3/projects/5d1dcbeb7a1b455fa99941a4bb62c8d3/users/175f4d53fc25478d9c89278cebe19fbd/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:31.799098 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f262eb2-a895-407e-8f0f-c5c069c7a89c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d1dcbeb7a1b455fa99941a4bb62c8d3, user_id=175f4d53fc25478d9c89278cebe19fbd, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:31.801874 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f262eb2-a895-407e-8f0f-c5c069c7a89c admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:31.816746 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13454b00-5f71-4327-85e9-421401a694e1 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:31.820331 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab119a5-fa8b-4d4e-88dc-0b1f7fbc1072 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:31.820962 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab119a5-fa8b-4d4e-88dc-0b1f7fbc1072 service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:31.821249 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab119a5-fa8b-4d4e-88dc-0b1f7fbc1072 service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:31.821523 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab119a5-fa8b-4d4e-88dc-0b1f7fbc1072 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:31.831457 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab119a5-fa8b-4d4e-88dc-0b1f7fbc1072 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:31.832908 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab119a5-fa8b-4d4e-88dc-0b1f7fbc1072 service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:31.842661 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1081/2174] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:31 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:04:31.886207 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1094/2175] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:31 2022] PUT /identity/v3/projects/5d1dcbeb7a1b455fa99941a4bb62c8d3/users/175f4d53fc25478d9c89278cebe19fbd/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:04:31.897999 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2bcf9f-9758-4d40-8293-8649a0254dbe None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:31.898285 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2bcf9f-9758-4d40-8293-8649a0254dbe None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:31.898561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2bcf9f-9758-4d40-8293-8649a0254dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:31.926627 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-4e2bcf9f-9758-4d40-8293-8649a0254dbe None None] MFA Rules not processed for user `175f4d53fc25478d9c89278cebe19fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:31.927821 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-4e2bcf9f-9758-4d40-8293-8649a0254dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:32.005562 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1082/2176] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:32.010047 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f262eb2-a895-407e-8f0f-c5c069c7a89c admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:32.087750 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f262eb2-a895-407e-8f0f-c5c069c7a89c admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:32.092814 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b9f24-66e7-4cdb-9400-4e2d7ab096c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:32.093678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b9f24-66e7-4cdb-9400-4e2d7ab096c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:32.102077 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b9f24-66e7-4cdb-9400-4e2d7ab096c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:32.102371 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b9f24-66e7-4cdb-9400-4e2d7ab096c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:32.103195 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b9f24-66e7-4cdb-9400-4e2d7ab096c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:32.105490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b9f24-66e7-4cdb-9400-4e2d7ab096c4 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:32.205328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1095/2177] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:04:32 2022] POST /identity/v3/projects => generated 375 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:32.209904 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2bcf9f-9758-4d40-8293-8649a0254dbe None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:32.236026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2bcf9f-9758-4d40-8293-8649a0254dbe None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:32.239868 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:32.328831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6670c2-9f35-43f5-b831-fd6f5c72c586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:32.329724 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6670c2-9f35-43f5-b831-fd6f5c72c586 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:32.330197 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6670c2-9f35-43f5-b831-fd6f5c72c586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:32.330655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6670c2-9f35-43f5-b831-fd6f5c72c586 admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:32.331467 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6670c2-9f35-43f5-b831-fd6f5c72c586 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:32.333725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6670c2-9f35-43f5-b831-fd6f5c72c586 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:32.426026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1083/2178] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:04:32 2022] POST /identity/v3/users => generated 288 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:04:32.429797 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b9f24-66e7-4cdb-9400-4e2d7ab096c4 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:32.443697 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b9f24-66e7-4cdb-9400-4e2d7ab096c4 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:32.451596 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af8db7-0ed3-4c3c-888d-6324798fd7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:32.452220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af8db7-0ed3-4c3c-888d-6324798fd7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:32.452502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af8db7-0ed3-4c3c-888d-6324798fd7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:32.452811 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af8db7-0ed3-4c3c-888d-6324798fd7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:32.453523 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af8db7-0ed3-4c3c-888d-6324798fd7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:32.455128 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af8db7-0ed3-4c3c-888d-6324798fd7b7 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:32.471052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1096/2179] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:32.473455 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6670c2-9f35-43f5-b831-fd6f5c72c586 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:32.500803 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6670c2-9f35-43f5-b831-fd6f5c72c586 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:32.509238 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d5160b-f6bf-4b45-9f1c-a1eee5d5b7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:32.510239 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5160b-f6bf-4b45-9f1c-a1eee5d5b7ab admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:32.510710 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5160b-f6bf-4b45-9f1c-a1eee5d5b7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:32.511167 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5160b-f6bf-4b45-9f1c-a1eee5d5b7ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:32.512267 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d5160b-f6bf-4b45-9f1c-a1eee5d5b7ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:32.515763 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:32.515959 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d5160b-f6bf-4b45-9f1c-a1eee5d5b7ab admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:32.533577 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1084/2180] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:04:32.534803 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af8db7-0ed3-4c3c-888d-6324798fd7b7 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:32.545766 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af8db7-0ed3-4c3c-888d-6324798fd7b7 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:32.550362 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e6f95-1c85-4ed6-8328-c628b1e4057e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:32.550998 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e6f95-1c85-4ed6-8328-c628b1e4057e admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:32.551274 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e6f95-1c85-4ed6-8328-c628b1e4057e admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:32.551544 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e6f95-1c85-4ed6-8328-c628b1e4057e admin admin] PATH_INFO: `/v3/projects/2cd2df3f6de74325b46a85ed24f4a1df/users/649424691c2b4187959cb2c89c452984/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:32.567133 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e6f95-1c85-4ed6-8328-c628b1e4057e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cd2df3f6de74325b46a85ed24f4a1df, user_id=649424691c2b4187959cb2c89c452984, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:32.569919 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e6f95-1c85-4ed6-8328-c628b1e4057e admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:32.616417 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d5160b-f6bf-4b45-9f1c-a1eee5d5b7ab admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:32.627238 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d5160b-f6bf-4b45-9f1c-a1eee5d5b7ab admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:32.631956 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a25b5-2f07-451c-b0d4-54fae7437b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:32.632580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a25b5-2f07-451c-b0d4-54fae7437b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:32.632887 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a25b5-2f07-451c-b0d4-54fae7437b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:32.633156 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a25b5-2f07-451c-b0d4-54fae7437b34 admin admin] PATH_INFO: `/v3/users/bf530387868f4c81816e7990ffccc148` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:32.634288 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a25b5-2f07-451c-b0d4-54fae7437b34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf530387868f4c81816e7990ffccc148)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:32.636180 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a25b5-2f07-451c-b0d4-54fae7437b34 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:32.670592 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1097/2181] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:32 2022] PUT /identity/v3/projects/2cd2df3f6de74325b46a85ed24f4a1df/users/649424691c2b4187959cb2c89c452984/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:32.680560 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8197cf-0264-4e06-83a1-2a7b9269b6ad None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:32.680878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8197cf-0264-4e06-83a1-2a7b9269b6ad None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:32.681149 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8197cf-0264-4e06-83a1-2a7b9269b6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:32.708281 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-5f8197cf-0264-4e06-83a1-2a7b9269b6ad None None] MFA Rules not processed for user `649424691c2b4187959cb2c89c452984`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:32.709511 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-5f8197cf-0264-4e06-83a1-2a7b9269b6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:32.772551 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1098/2182] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:04:32.777071 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8197cf-0264-4e06-83a1-2a7b9269b6ad None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:32.804559 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-f42a25b5-2f07-451c-b0d4-54fae7437b34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf530387868f4c81816e7990ffccc148'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:32.805316 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-f42a25b5-2f07-451c-b0d4-54fae7437b34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf530387868f4c81816e7990ffccc148'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:32.806010 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-f42a25b5-2f07-451c-b0d4-54fae7437b34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf530387868f4c81816e7990ffccc148'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:32.839934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8197cf-0264-4e06-83a1-2a7b9269b6ad None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:32.845516 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4d3e6-23ce-4527-8853-dcc85ff1c5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:32.846129 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4d3e6-23ce-4527-8853-dcc85ff1c5ca admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:32.846411 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4d3e6-23ce-4527-8853-dcc85ff1c5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:32.846686 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4d3e6-23ce-4527-8853-dcc85ff1c5ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:32.847316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4d3e6-23ce-4527-8853-dcc85ff1c5ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:32.849282 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4d3e6-23ce-4527-8853-dcc85ff1c5ca admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:32.874486 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-f42a25b5-2f07-451c-b0d4-54fae7437b34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf530387868f4c81816e7990ffccc148'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:32.882107 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-f42a25b5-2f07-451c-b0d4-54fae7437b34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf530387868f4c81816e7990ffccc148'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:32.900069 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1085/2183] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:04:32 2022] DELETE /identity/v3/users/bf530387868f4c81816e7990ffccc148 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:04:32.904822 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742eecb3-3303-406a-96d9-1daf7220fabd None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:32.905036 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742eecb3-3303-406a-96d9-1daf7220fabd None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:32.905309 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742eecb3-3303-406a-96d9-1daf7220fabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:32.924171 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-742eecb3-3303-406a-96d9-1daf7220fabd None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:32.925535 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-742eecb3-3303-406a-96d9-1daf7220fabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:32.935319 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1099/2184] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:04:32 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:04:32.939362 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4d3e6-23ce-4527-8853-dcc85ff1c5ca admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:32.941025 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-e3f4d3e6-23ce-4527-8853-dcc85ff1c5ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:32.992286 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1086/2185] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:33.002791 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742eecb3-3303-406a-96d9-1daf7220fabd None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:33.004139 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-742eecb3-3303-406a-96d9-1daf7220fabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:33.009597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4d3e6-23ce-4527-8853-dcc85ff1c5ca admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:33.015125 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde32882-15b7-44c4-94a8-1cfa738c2e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:33.015730 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde32882-15b7-44c4-94a8-1cfa738c2e21 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:33.016013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde32882-15b7-44c4-94a8-1cfa738c2e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:33.016286 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde32882-15b7-44c4-94a8-1cfa738c2e21 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:33.016941 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde32882-15b7-44c4-94a8-1cfa738c2e21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:33.018872 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde32882-15b7-44c4-94a8-1cfa738c2e21 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:33.061570 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742eecb3-3303-406a-96d9-1daf7220fabd None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:33.110947 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318b43d-9131-47c3-bd12-73e4488797ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:33.111570 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318b43d-9131-47c3-bd12-73e4488797ff service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:33.111835 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318b43d-9131-47c3-bd12-73e4488797ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:33.112112 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318b43d-9131-47c3-bd12-73e4488797ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:33.121224 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318b43d-9131-47c3-bd12-73e4488797ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:33.123221 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318b43d-9131-47c3-bd12-73e4488797ff service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:33.132840 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1087/2186] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:04:33.141099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1100/2187] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:04:32 2022] POST /identity/v3/users => generated 295 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:04:33.143890 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318b43d-9131-47c3-bd12-73e4488797ff service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:33.154088 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318b43d-9131-47c3-bd12-73e4488797ff service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:33.158956 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb5156-5fed-4ba7-bc56-d3f375f359ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:33.159615 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb5156-5fed-4ba7-bc56-d3f375f359ed admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:33.159896 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb5156-5fed-4ba7-bc56-d3f375f359ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:33.160165 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb5156-5fed-4ba7-bc56-d3f375f359ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:33.160979 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb5156-5fed-4ba7-bc56-d3f375f359ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:33.162565 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb5156-5fed-4ba7-bc56-d3f375f359ed admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:33.173327 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1088/2188] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:33.177460 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde32882-15b7-44c4-94a8-1cfa738c2e21 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:33.188294 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde32882-15b7-44c4-94a8-1cfa738c2e21 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:33.193411 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3f31a-6fee-455e-81fa-7f776583c296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:33.194088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3f31a-6fee-455e-81fa-7f776583c296 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:33.194359 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3f31a-6fee-455e-81fa-7f776583c296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:33.194635 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3f31a-6fee-455e-81fa-7f776583c296 admin admin] PATH_INFO: `/v3/projects/2705e0c8fa564e3aae01435d5241f5ef/users/4f3afa6b4b7a4984aa86cd97401f60fa/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:33.211133 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3f31a-6fee-455e-81fa-7f776583c296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2705e0c8fa564e3aae01435d5241f5ef, user_id=4f3afa6b4b7a4984aa86cd97401f60fa, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:33.213856 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3f31a-6fee-455e-81fa-7f776583c296 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:33.325924 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1101/2189] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:33 2022] PUT /identity/v3/projects/2705e0c8fa564e3aae01435d5241f5ef/users/4f3afa6b4b7a4984aa86cd97401f60fa/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:33.330436 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb5156-5fed-4ba7-bc56-d3f375f359ed admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:33.346503 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb5156-5fed-4ba7-bc56-d3f375f359ed admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:33.419531 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6e6bd-3fa2-4982-9260-86da5061829a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:33.420138 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6e6bd-3fa2-4982-9260-86da5061829a admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:33.420418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6e6bd-3fa2-4982-9260-86da5061829a admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:33.420721 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6e6bd-3fa2-4982-9260-86da5061829a admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:33.421368 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6e6bd-3fa2-4982-9260-86da5061829a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:33.423063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6e6bd-3fa2-4982-9260-86da5061829a admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:33.433184 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1089/2190] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:33.437562 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3f31a-6fee-455e-81fa-7f776583c296 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:33.448221 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3f31a-6fee-455e-81fa-7f776583c296 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:33.461514 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac64bae-995c-44bd-8101-e3f51d252ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:33.463414 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac64bae-995c-44bd-8101-e3f51d252ac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:33.463414 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac64bae-995c-44bd-8101-e3f51d252ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:33.463414 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac64bae-995c-44bd-8101-e3f51d252ac5 admin admin] PATH_INFO: `/v3/projects/2705e0c8fa564e3aae01435d5241f5ef/users/4f3afa6b4b7a4984aa86cd97401f60fa/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:33.466424 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac64bae-995c-44bd-8101-e3f51d252ac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2705e0c8fa564e3aae01435d5241f5ef, user_id=4f3afa6b4b7a4984aa86cd97401f60fa, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:33.469321 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac64bae-995c-44bd-8101-e3f51d252ac5 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:33.480958 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1102/2191] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:33 2022] PUT /identity/v3/projects/2705e0c8fa564e3aae01435d5241f5ef/users/4f3afa6b4b7a4984aa86cd97401f60fa/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:33.492679 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52199871-e176-49be-a394-66def625f857 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:33.493186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52199871-e176-49be-a394-66def625f857 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:33.493457 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52199871-e176-49be-a394-66def625f857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:33.520437 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:33.528987 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-52199871-e176-49be-a394-66def625f857 None None] MFA Rules not processed for user `4f3afa6b4b7a4984aa86cd97401f60fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:33.530946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-52199871-e176-49be-a394-66def625f857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:33.608508 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1090/2192] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:33.619807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac64bae-995c-44bd-8101-e3f51d252ac5 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:33.621634 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-1ac64bae-995c-44bd-8101-e3f51d252ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:33.638768 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52199871-e176-49be-a394-66def625f857 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:33.640483 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-52199871-e176-49be-a394-66def625f857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:33.679786 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:33.701789 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac64bae-995c-44bd-8101-e3f51d252ac5 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:33.706264 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bdf6b9-0dc0-4762-b59f-d60d7c8abc79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:33.706961 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bdf6b9-0dc0-4762-b59f-d60d7c8abc79 service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:33.707314 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bdf6b9-0dc0-4762-b59f-d60d7c8abc79 service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:33.707663 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bdf6b9-0dc0-4762-b59f-d60d7c8abc79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:33.710175 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-28bdf6b9-0dc0-4762-b59f-d60d7c8abc79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:33.727467 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52199871-e176-49be-a394-66def625f857 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:33.744997 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a845c7c-3f5c-47ca-b039-c0dcd3aa51e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:33.745939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a845c7c-3f5c-47ca-b039-c0dcd3aa51e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:33.746380 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a845c7c-3f5c-47ca-b039-c0dcd3aa51e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:33.746663 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a845c7c-3f5c-47ca-b039-c0dcd3aa51e0 admin admin] PATH_INFO: `/v3/projects/6785a53b02ac4d5cb1ee8dc77b19f0e4` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:33.748330 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a845c7c-3f5c-47ca-b039-c0dcd3aa51e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6785a53b02ac4d5cb1ee8dc77b19f0e4)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:33.751299 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a845c7c-3f5c-47ca-b039-c0dcd3aa51e0 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:33.780480 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bdf6b9-0dc0-4762-b59f-d60d7c8abc79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:33.781907 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bdf6b9-0dc0-4762-b59f-d60d7c8abc79 service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:33.791070 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1103/2193] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:04:33.909958 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-8a845c7c-3f5c-47ca-b039-c0dcd3aa51e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6785a53b02ac4d5cb1ee8dc77b19f0e4', 'request_id': 'req-8a845c7c-3f5c-47ca-b039-c0dcd3aa51e0'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:33.915940 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-8a845c7c-3f5c-47ca-b039-c0dcd3aa51e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6785a53b02ac4d5cb1ee8dc77b19f0e4', 'request_id': 'req-8a845c7c-3f5c-47ca-b039-c0dcd3aa51e0'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:33.922507 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-8a845c7c-3f5c-47ca-b039-c0dcd3aa51e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6785a53b02ac4d5cb1ee8dc77b19f0e4', 'request_id': 'req-8a845c7c-3f5c-47ca-b039-c0dcd3aa51e0'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:34.031911 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-8a845c7c-3f5c-47ca-b039-c0dcd3aa51e0 admin admin] The token cache is being invalidate because project 6785a53b02ac4d5cb1ee8dc77b19f0e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:04:34.032126 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-8a845c7c-3f5c-47ca-b039-c0dcd3aa51e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:34.032847 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-8a845c7c-3f5c-47ca-b039-c0dcd3aa51e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:34.034405 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1091/2194] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:04:33 2022] DELETE /identity/v3/projects/6785a53b02ac4d5cb1ee8dc77b19f0e4 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:34.039138 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bdf6b9-0dc0-4762-b59f-d60d7c8abc79 service cinder] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:34.054247 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bdf6b9-0dc0-4762-b59f-d60d7c8abc79 service cinder] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:34.112549 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94989dc-dece-4575-9532-d8d956e29339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:34.113344 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94989dc-dece-4575-9532-d8d956e29339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:34.113472 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94989dc-dece-4575-9532-d8d956e29339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:34.113821 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94989dc-dece-4575-9532-d8d956e29339 admin admin] PATH_INFO: `/v3/users/4d87275d49584354b71d4e1ae16971a6` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:34.114966 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94989dc-dece-4575-9532-d8d956e29339 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d87275d49584354b71d4e1ae16971a6)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:34.116945 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94989dc-dece-4575-9532-d8d956e29339 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:34.193503 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:34.228312 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:34.317997 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f94989dc-dece-4575-9532-d8d956e29339 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d87275d49584354b71d4e1ae16971a6'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:34.318666 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f94989dc-dece-4575-9532-d8d956e29339 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d87275d49584354b71d4e1ae16971a6'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:34.319271 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f94989dc-dece-4575-9532-d8d956e29339 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d87275d49584354b71d4e1ae16971a6'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:34.331071 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f94989dc-dece-4575-9532-d8d956e29339 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d87275d49584354b71d4e1ae16971a6'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:34.400918 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f94989dc-dece-4575-9532-d8d956e29339 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d87275d49584354b71d4e1ae16971a6'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:34.418027 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1104/2195] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:04:34 2022] DELETE /identity/v3/users/4d87275d49584354b71d4e1ae16971a6 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:34.851648 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:34.885070 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:35.105225 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a845c7c-3f5c-47ca-b039-c0dcd3aa51e0 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:35.106758 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-8a845c7c-3f5c-47ca-b039-c0dcd3aa51e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:35.120077 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a845c7c-3f5c-47ca-b039-c0dcd3aa51e0 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:35.180423 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e062db-7cff-499b-8ce8-0995285604a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:35.181085 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e062db-7cff-499b-8ce8-0995285604a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:35.181475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e062db-7cff-499b-8ce8-0995285604a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:35.181769 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e062db-7cff-499b-8ce8-0995285604a0 admin admin] PATH_INFO: `/v3/projects/d117bdcd309c457a841bab0fc917e449` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:35.182882 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e062db-7cff-499b-8ce8-0995285604a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d117bdcd309c457a841bab0fc917e449)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:35.184825 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e062db-7cff-499b-8ce8-0995285604a0 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:35.334683 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-44e062db-7cff-499b-8ce8-0995285604a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd117bdcd309c457a841bab0fc917e449', 'request_id': 'req-44e062db-7cff-499b-8ce8-0995285604a0'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:35.340338 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-44e062db-7cff-499b-8ce8-0995285604a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd117bdcd309c457a841bab0fc917e449', 'request_id': 'req-44e062db-7cff-499b-8ce8-0995285604a0'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:35.350507 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-44e062db-7cff-499b-8ce8-0995285604a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd117bdcd309c457a841bab0fc917e449', 'request_id': 'req-44e062db-7cff-499b-8ce8-0995285604a0'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:35.427770 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-44e062db-7cff-499b-8ce8-0995285604a0 admin admin] The token cache is being invalidate because project d117bdcd309c457a841bab0fc917e449 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:04:35.428158 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-44e062db-7cff-499b-8ce8-0995285604a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:35.428972 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-44e062db-7cff-499b-8ce8-0995285604a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:35.430611 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1092/2196] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:04:35 2022] DELETE /identity/v3/projects/d117bdcd309c457a841bab0fc917e449 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:35.434129 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:35.436111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08150e8f-d4b4-4ead-809a-b57d5c6033c0 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:35.436739 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08150e8f-d4b4-4ead-809a-b57d5c6033c0 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:35.450736 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08150e8f-d4b4-4ead-809a-b57d5c6033c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:35.458092 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-08150e8f-d4b4-4ead-809a-b57d5c6033c0 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:35.459309 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-08150e8f-d4b4-4ead-809a-b57d5c6033c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:35.520279 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1105/2197] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:35.528484 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c78a2d-04e8-4e4b-93ad-46cd25b900cf None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:35.528804 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c78a2d-04e8-4e4b-93ad-46cd25b900cf None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:35.529235 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c78a2d-04e8-4e4b-93ad-46cd25b900cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:35.552726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-a3c78a2d-04e8-4e4b-93ad-46cd25b900cf None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:35.553937 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-a3c78a2d-04e8-4e4b-93ad-46cd25b900cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:35.582076 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1093/2198] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:04:35.585109 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08150e8f-d4b4-4ead-809a-b57d5c6033c0 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:35.599124 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08150e8f-d4b4-4ead-809a-b57d5c6033c0 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:35.620804 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f031b8e-22c5-4b41-b5b7-20bd5e67303e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:35.620804 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f031b8e-22c5-4b41-b5b7-20bd5e67303e admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:35.620804 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f031b8e-22c5-4b41-b5b7-20bd5e67303e admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:35.620804 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f031b8e-22c5-4b41-b5b7-20bd5e67303e admin admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:35.621231 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f031b8e-22c5-4b41-b5b7-20bd5e67303e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:04:35.621231 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f031b8e-22c5-4b41-b5b7-20bd5e67303e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:35.621231 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f031b8e-22c5-4b41-b5b7-20bd5e67303e admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:35.621423 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:35.623587 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1106/2199] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:04:35.628526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c78a2d-04e8-4e4b-93ad-46cd25b900cf None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:35.638081 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c78a2d-04e8-4e4b-93ad-46cd25b900cf None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:35.645397 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798cc8b1-1ce0-4d8b-b91d-adb613514232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:35.649549 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798cc8b1-1ce0-4d8b-b91d-adb613514232 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:35.649549 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798cc8b1-1ce0-4d8b-b91d-adb613514232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:35.649549 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798cc8b1-1ce0-4d8b-b91d-adb613514232 admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:35.649549 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798cc8b1-1ce0-4d8b-b91d-adb613514232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:35.649549 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798cc8b1-1ce0-4d8b-b91d-adb613514232 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:35.778087 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f031b8e-22c5-4b41-b5b7-20bd5e67303e admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:35.781555 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1094/2200] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:04:35 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:35.820835 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f031b8e-22c5-4b41-b5b7-20bd5e67303e admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:35.890757 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798cc8b1-1ce0-4d8b-b91d-adb613514232 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:35.895021 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-798cc8b1-1ce0-4d8b-b91d-adb613514232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:35.914860 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ec6e8-974a-4949-90be-9e56bddc8b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:35.915518 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ec6e8-974a-4949-90be-9e56bddc8b70 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:35.915801 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ec6e8-974a-4949-90be-9e56bddc8b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:35.916077 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ec6e8-974a-4949-90be-9e56bddc8b70 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:35.916769 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ec6e8-974a-4949-90be-9e56bddc8b70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:35.918972 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ec6e8-974a-4949-90be-9e56bddc8b70 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:35.969656 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798cc8b1-1ce0-4d8b-b91d-adb613514232 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:35.976239 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48e260-474b-467e-8119-71a0d806650f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:35.976239 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48e260-474b-467e-8119-71a0d806650f service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:35.976239 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48e260-474b-467e-8119-71a0d806650f service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:35.976239 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48e260-474b-467e-8119-71a0d806650f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:35.976886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-dd48e260-474b-467e-8119-71a0d806650f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:36.031263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1107/2201] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:04:35 2022] POST /identity/v3/users => generated 292 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:04:36.035784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ec6e8-974a-4949-90be-9e56bddc8b70 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:36.043193 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48e260-474b-467e-8119-71a0d806650f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:36.044759 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48e260-474b-467e-8119-71a0d806650f service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:36.048975 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ec6e8-974a-4949-90be-9e56bddc8b70 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:36.054095 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd265318-2c69-4bb2-87fa-faa016306444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:36.054709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd265318-2c69-4bb2-87fa-faa016306444 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:36.055202 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd265318-2c69-4bb2-87fa-faa016306444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:36.055830 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1095/2202] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:04:36.072755 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd265318-2c69-4bb2-87fa-faa016306444 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:36.072755 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd265318-2c69-4bb2-87fa-faa016306444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:36.072755 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd265318-2c69-4bb2-87fa-faa016306444 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:36.087170 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1108/2203] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:04:36.088498 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48e260-474b-467e-8119-71a0d806650f service cinder] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:36.103655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48e260-474b-467e-8119-71a0d806650f service cinder] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:36.114178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fceaf7-fc6f-4a79-8077-cf3d4550b59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:36.115540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fceaf7-fc6f-4a79-8077-cf3d4550b59d admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:36.115832 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fceaf7-fc6f-4a79-8077-cf3d4550b59d admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:36.116110 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fceaf7-fc6f-4a79-8077-cf3d4550b59d admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:36.116787 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fceaf7-fc6f-4a79-8077-cf3d4550b59d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:36.118545 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fceaf7-fc6f-4a79-8077-cf3d4550b59d admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:36.137908 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1096/2204] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:36.140600 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd265318-2c69-4bb2-87fa-faa016306444 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:36.166586 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd265318-2c69-4bb2-87fa-faa016306444 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:36.172317 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a51ed6-28f9-4cc2-84f6-69cc326f2483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:36.173389 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a51ed6-28f9-4cc2-84f6-69cc326f2483 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:36.173681 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a51ed6-28f9-4cc2-84f6-69cc326f2483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:36.173959 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a51ed6-28f9-4cc2-84f6-69cc326f2483 admin admin] PATH_INFO: `/v3/projects/60cca40704214bfa99018c3bfaef2878/users/2cc759809e264979b4882f684638f9b7/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:36.189974 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a51ed6-28f9-4cc2-84f6-69cc326f2483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60cca40704214bfa99018c3bfaef2878, user_id=2cc759809e264979b4882f684638f9b7, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:36.192749 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a51ed6-28f9-4cc2-84f6-69cc326f2483 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:36.260170 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1109/2205] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:36 2022] PUT /identity/v3/projects/60cca40704214bfa99018c3bfaef2878/users/2cc759809e264979b4882f684638f9b7/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:36.271948 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b289d2-1cb5-48e0-97c9-dd328be35120 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:36.272271 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b289d2-1cb5-48e0-97c9-dd328be35120 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:36.272558 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b289d2-1cb5-48e0-97c9-dd328be35120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:36.308832 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-a1b289d2-1cb5-48e0-97c9-dd328be35120 None None] MFA Rules not processed for user `2cc759809e264979b4882f684638f9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:36.310069 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-a1b289d2-1cb5-48e0-97c9-dd328be35120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:36.383203 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1097/2206] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:36.429924 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a51ed6-28f9-4cc2-84f6-69cc326f2483 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:36.431725 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-a1a51ed6-28f9-4cc2-84f6-69cc326f2483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:36.477285 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:36.492576 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a51ed6-28f9-4cc2-84f6-69cc326f2483 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:36.497228 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4e464-a87a-4ae6-b93d-23d50d3d4f4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:36.497839 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4e464-a87a-4ae6-b93d-23d50d3d4f4c service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:36.498123 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4e464-a87a-4ae6-b93d-23d50d3d4f4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:36.498404 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4e464-a87a-4ae6-b93d-23d50d3d4f4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:36.507832 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4e464-a87a-4ae6-b93d-23d50d3d4f4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:36.512752 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4e464-a87a-4ae6-b93d-23d50d3d4f4c service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:36.519440 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1110/2207] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:04:36.545729 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b289d2-1cb5-48e0-97c9-dd328be35120 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:36.617484 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b289d2-1cb5-48e0-97c9-dd328be35120 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:36.622418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386c659-01a3-40c8-997e-7b106b6bd152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:36.623239 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386c659-01a3-40c8-997e-7b106b6bd152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:36.623578 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386c659-01a3-40c8-997e-7b106b6bd152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:36.623854 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386c659-01a3-40c8-997e-7b106b6bd152 admin admin] PATH_INFO: `/v3/users/2cc759809e264979b4882f684638f9b7` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:36.625741 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386c659-01a3-40c8-997e-7b106b6bd152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cc759809e264979b4882f684638f9b7)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:36.627927 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386c659-01a3-40c8-997e-7b106b6bd152 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:36.755542 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:36.895011 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0386c659-01a3-40c8-997e-7b106b6bd152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cc759809e264979b4882f684638f9b7'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:36.895671 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0386c659-01a3-40c8-997e-7b106b6bd152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cc759809e264979b4882f684638f9b7'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:36.896277 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0386c659-01a3-40c8-997e-7b106b6bd152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cc759809e264979b4882f684638f9b7'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:37.004446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0386c659-01a3-40c8-997e-7b106b6bd152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cc759809e264979b4882f684638f9b7'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:37.013174 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0386c659-01a3-40c8-997e-7b106b6bd152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cc759809e264979b4882f684638f9b7'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:37.030606 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1098/2208] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:04:36 2022] DELETE /identity/v3/users/2cc759809e264979b4882f684638f9b7 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:37.035539 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba40b9d-45c8-481a-ba50-2e97296dc72a None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:37.035824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba40b9d-45c8-481a-ba50-2e97296dc72a None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:37.036099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba40b9d-45c8-481a-ba50-2e97296dc72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:37.055461 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-bba40b9d-45c8-481a-ba50-2e97296dc72a None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:37.056702 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-bba40b9d-45c8-481a-ba50-2e97296dc72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:37.119694 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1111/2209] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:37.130424 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386c659-01a3-40c8-997e-7b106b6bd152 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:37.131944 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-0386c659-01a3-40c8-997e-7b106b6bd152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:37.194877 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386c659-01a3-40c8-997e-7b106b6bd152 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:37.201664 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064eeee-78df-4695-90e8-d36593bc96ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:37.202364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064eeee-78df-4695-90e8-d36593bc96ff service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:37.202819 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064eeee-78df-4695-90e8-d36593bc96ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:37.203305 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064eeee-78df-4695-90e8-d36593bc96ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:37.213182 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f064eeee-78df-4695-90e8-d36593bc96ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:37.214625 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f064eeee-78df-4695-90e8-d36593bc96ff service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:37.225550 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1099/2210] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:04:37.611254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba40b9d-45c8-481a-ba50-2e97296dc72a None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:37.613446 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-bba40b9d-45c8-481a-ba50-2e97296dc72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:37.635936 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba40b9d-45c8-481a-ba50-2e97296dc72a None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:37.641141 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7af07-3b93-42b3-9c87-d76048c444f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:37.642096 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7af07-3b93-42b3-9c87-d76048c444f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:37.642592 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7af07-3b93-42b3-9c87-d76048c444f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:37.642981 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7af07-3b93-42b3-9c87-d76048c444f9 admin admin] PATH_INFO: `/v3/projects/60cca40704214bfa99018c3bfaef2878` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:37.644367 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7af07-3b93-42b3-9c87-d76048c444f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60cca40704214bfa99018c3bfaef2878)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:37.646450 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7af07-3b93-42b3-9c87-d76048c444f9 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:37.793030 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-dbb7af07-3b93-42b3-9c87-d76048c444f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60cca40704214bfa99018c3bfaef2878', 'request_id': 'req-dbb7af07-3b93-42b3-9c87-d76048c444f9'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:37.850588 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064eeee-78df-4695-90e8-d36593bc96ff service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:37.852010 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-f064eeee-78df-4695-90e8-d36593bc96ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:37.913105 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064eeee-78df-4695-90e8-d36593bc96ff service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:37.924495 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-dbb7af07-3b93-42b3-9c87-d76048c444f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60cca40704214bfa99018c3bfaef2878', 'request_id': 'req-dbb7af07-3b93-42b3-9c87-d76048c444f9'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:37.931912 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-dbb7af07-3b93-42b3-9c87-d76048c444f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60cca40704214bfa99018c3bfaef2878', 'request_id': 'req-dbb7af07-3b93-42b3-9c87-d76048c444f9'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:37.946945 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-dbb7af07-3b93-42b3-9c87-d76048c444f9 admin admin] The token cache is being invalidate because project 60cca40704214bfa99018c3bfaef2878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:04:37.947237 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-dbb7af07-3b93-42b3-9c87-d76048c444f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:37.948239 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-dbb7af07-3b93-42b3-9c87-d76048c444f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:37.954211 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1112/2211] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:04:37 2022] DELETE /identity/v3/projects/60cca40704214bfa99018c3bfaef2878 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:37.955573 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379569c3-3eb1-42f3-8f93-6f96e06833af None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:37.956117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379569c3-3eb1-42f3-8f93-6f96e06833af None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:37.956549 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379569c3-3eb1-42f3-8f93-6f96e06833af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:37.977580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feeb3e2-e9ef-468a-a951-4666fbe491ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:37.978444 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feeb3e2-e9ef-468a-a951-4666fbe491ba service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:37.978721 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feeb3e2-e9ef-468a-a951-4666fbe491ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:37.978995 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feeb3e2-e9ef-468a-a951-4666fbe491ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:37.980864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-7feeb3e2-e9ef-468a-a951-4666fbe491ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:37.987211 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-379569c3-3eb1-42f3-8f93-6f96e06833af None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:37.988082 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-379569c3-3eb1-42f3-8f93-6f96e06833af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:38.024607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:38.053660 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feeb3e2-e9ef-468a-a951-4666fbe491ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:38.055175 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feeb3e2-e9ef-468a-a951-4666fbe491ba service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:38.057643 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1113/2212] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:38.065876 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645f71e-1151-477a-b20c-e2f491918468 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:38.066157 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645f71e-1151-477a-b20c-e2f491918468 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:38.072089 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645f71e-1151-477a-b20c-e2f491918468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:38.072201 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1100/2213] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:04:38.086708 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-6645f71e-1151-477a-b20c-e2f491918468 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:38.087900 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-6645f71e-1151-477a-b20c-e2f491918468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:38.105253 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1114/2214] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:04:38.115468 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feeb3e2-e9ef-468a-a951-4666fbe491ba service cinder] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:38.126319 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feeb3e2-e9ef-468a-a951-4666fbe491ba service cinder] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:38.132576 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2d6e2-5da9-485e-9736-49490c4a046c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:38.134699 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2d6e2-5da9-485e-9736-49490c4a046c admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:38.134699 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2d6e2-5da9-485e-9736-49490c4a046c admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:38.134699 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2d6e2-5da9-485e-9736-49490c4a046c admin admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:38.134699 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2d6e2-5da9-485e-9736-49490c4a046c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:04:38.135097 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2d6e2-5da9-485e-9736-49490c4a046c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:38.136669 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2d6e2-5da9-485e-9736-49490c4a046c admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:38.151997 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1101/2215] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:04:38.153399 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645f71e-1151-477a-b20c-e2f491918468 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:38.163882 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645f71e-1151-477a-b20c-e2f491918468 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:38.168609 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36bc9d-f970-43c6-b003-b85651a5b0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:38.174834 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36bc9d-f970-43c6-b003-b85651a5b0af admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:38.174834 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36bc9d-f970-43c6-b003-b85651a5b0af admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:38.174834 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36bc9d-f970-43c6-b003-b85651a5b0af admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:38.174834 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36bc9d-f970-43c6-b003-b85651a5b0af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:38.174834 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36bc9d-f970-43c6-b003-b85651a5b0af admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:38.262194 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1115/2216] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:04:38 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:38.266653 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2d6e2-5da9-485e-9736-49490c4a046c admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:38.276492 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2d6e2-5da9-485e-9736-49490c4a046c admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:38.336251 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ba076-e3e5-4355-9194-6e9b8bd18199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:38.336801 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ba076-e3e5-4355-9194-6e9b8bd18199 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:38.337077 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ba076-e3e5-4355-9194-6e9b8bd18199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:38.342219 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ba076-e3e5-4355-9194-6e9b8bd18199 admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:38.342976 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ba076-e3e5-4355-9194-6e9b8bd18199 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:38.346069 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ba076-e3e5-4355-9194-6e9b8bd18199 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:38.436197 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1102/2217] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:04:38 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:38.440438 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36bc9d-f970-43c6-b003-b85651a5b0af admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:38.452716 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36bc9d-f970-43c6-b003-b85651a5b0af admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:38.458404 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e662ec-d803-4b01-a487-29b0f69920ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:38.459015 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e662ec-d803-4b01-a487-29b0f69920ca admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:38.459300 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e662ec-d803-4b01-a487-29b0f69920ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:38.459577 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e662ec-d803-4b01-a487-29b0f69920ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:38.460265 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e662ec-d803-4b01-a487-29b0f69920ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:38.461908 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e662ec-d803-4b01-a487-29b0f69920ca admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:38.475135 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1116/2218] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:38.479135 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ba076-e3e5-4355-9194-6e9b8bd18199 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:38.489872 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ba076-e3e5-4355-9194-6e9b8bd18199 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:38.494574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202fec13-bcd3-4124-983c-f935bd631a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:38.495170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202fec13-bcd3-4124-983c-f935bd631a61 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:38.495455 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202fec13-bcd3-4124-983c-f935bd631a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:38.495730 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202fec13-bcd3-4124-983c-f935bd631a61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:38.496405 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202fec13-bcd3-4124-983c-f935bd631a61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:38.498055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202fec13-bcd3-4124-983c-f935bd631a61 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:38.509013 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1103/2219] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:04:38.513218 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e662ec-d803-4b01-a487-29b0f69920ca admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:38.523934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e662ec-d803-4b01-a487-29b0f69920ca admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:38.526780 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:38.530408 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71468479-9548-431e-b21a-64ab8ef29448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:38.532083 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71468479-9548-431e-b21a-64ab8ef29448 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:38.532302 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71468479-9548-431e-b21a-64ab8ef29448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:38.532574 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71468479-9548-431e-b21a-64ab8ef29448 admin admin] PATH_INFO: `/v3/projects/1c1ba44b35a246c3b536a297767cdf87/users/ae23adb0a49e482a9f89bb54fc711ac7/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:38.547266 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71468479-9548-431e-b21a-64ab8ef29448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c1ba44b35a246c3b536a297767cdf87, user_id=ae23adb0a49e482a9f89bb54fc711ac7, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:38.550115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71468479-9548-431e-b21a-64ab8ef29448 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:38.623681 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1117/2220] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:38 2022] PUT /identity/v3/projects/1c1ba44b35a246c3b536a297767cdf87/users/ae23adb0a49e482a9f89bb54fc711ac7/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:38.634073 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7929d-c13c-4edb-9d41-4aeda65e45fe None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:38.634358 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7929d-c13c-4edb-9d41-4aeda65e45fe None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:38.634661 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7929d-c13c-4edb-9d41-4aeda65e45fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:38.663439 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-8dd7929d-c13c-4edb-9d41-4aeda65e45fe None None] MFA Rules not processed for user `ae23adb0a49e482a9f89bb54fc711ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:38.664832 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-8dd7929d-c13c-4edb-9d41-4aeda65e45fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:38.730895 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1104/2221] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:38.742891 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71468479-9548-431e-b21a-64ab8ef29448 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:38.744769 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-71468479-9548-431e-b21a-64ab8ef29448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:38.800769 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71468479-9548-431e-b21a-64ab8ef29448 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:38.804536 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62f59c-9a81-4f92-a738-ea900ae5036e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:38.805182 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62f59c-9a81-4f92-a738-ea900ae5036e service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:38.805469 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62f59c-9a81-4f92-a738-ea900ae5036e service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:38.805740 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62f59c-9a81-4f92-a738-ea900ae5036e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:38.814494 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62f59c-9a81-4f92-a738-ea900ae5036e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:38.816050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62f59c-9a81-4f92-a738-ea900ae5036e service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:38.825297 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1118/2222] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:04:39.468287 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:40.108031 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:40.253320 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:40.616118 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:40.675290 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:40.841250 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:40.932223 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:41.081452 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:41.503943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:41.560963 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:41.707853 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:41.776332 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:42.881157 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:42.997764 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7929d-c13c-4edb-9d41-4aeda65e45fe None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:42.999196 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-8dd7929d-c13c-4edb-9d41-4aeda65e45fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:43.073262 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7929d-c13c-4edb-9d41-4aeda65e45fe None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:43.078211 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf30554-e961-4389-a4b4-8473144e9308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:43.079125 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf30554-e961-4389-a4b4-8473144e9308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:43.080202 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf30554-e961-4389-a4b4-8473144e9308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:43.080511 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf30554-e961-4389-a4b4-8473144e9308 admin admin] PATH_INFO: `/v3/users/175f4d53fc25478d9c89278cebe19fbd` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:43.081777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf30554-e961-4389-a4b4-8473144e9308 admin admin] RBAC: Authorizing `identity:delete_user(user_id=175f4d53fc25478d9c89278cebe19fbd)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:43.084353 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf30554-e961-4389-a4b4-8473144e9308 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:43.194187 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:43.314755 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0bf30554-e961-4389-a4b4-8473144e9308 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '175f4d53fc25478d9c89278cebe19fbd'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:43.315563 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0bf30554-e961-4389-a4b4-8473144e9308 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '175f4d53fc25478d9c89278cebe19fbd'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:43.316315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0bf30554-e961-4389-a4b4-8473144e9308 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '175f4d53fc25478d9c89278cebe19fbd'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:43.384230 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0bf30554-e961-4389-a4b4-8473144e9308 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '175f4d53fc25478d9c89278cebe19fbd'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:43.392989 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0bf30554-e961-4389-a4b4-8473144e9308 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '175f4d53fc25478d9c89278cebe19fbd'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:43.412324 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1105/2223] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:04:42 2022] DELETE /identity/v3/users/175f4d53fc25478d9c89278cebe19fbd => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:43.418758 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8178e-281c-4ccf-acf8-bd21127d280d None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:43.418758 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8178e-281c-4ccf-acf8-bd21127d280d None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:43.418758 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8178e-281c-4ccf-acf8-bd21127d280d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:43.427982 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf30554-e961-4389-a4b4-8473144e9308 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:43.429501 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-0bf30554-e961-4389-a4b4-8473144e9308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:43.438099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-3cd8178e-281c-4ccf-acf8-bd21127d280d None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:43.439776 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-3cd8178e-281c-4ccf-acf8-bd21127d280d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:43.510048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf30554-e961-4389-a4b4-8473144e9308 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:43.510418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1119/2224] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:43.510516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a455d5-f802-42c9-84ca-f97c0c98a2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:43.510801 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a455d5-f802-42c9-84ca-f97c0c98a2c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:43.511027 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a455d5-f802-42c9-84ca-f97c0c98a2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:43.511293 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a455d5-f802-42c9-84ca-f97c0c98a2c5 admin admin] PATH_INFO: `/v3/users/ae23adb0a49e482a9f89bb54fc711ac7` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:43.512521 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a455d5-f802-42c9-84ca-f97c0c98a2c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae23adb0a49e482a9f89bb54fc711ac7)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:43.514626 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a455d5-f802-42c9-84ca-f97c0c98a2c5 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:43.518783 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8178e-281c-4ccf-acf8-bd21127d280d None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:43.520525 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-3cd8178e-281c-4ccf-acf8-bd21127d280d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:43.579114 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8178e-281c-4ccf-acf8-bd21127d280d None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:43.583036 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b00215-9964-40af-83e0-3896dd9e9ed8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:43.583668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b00215-9964-40af-83e0-3896dd9e9ed8 service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:43.583950 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b00215-9964-40af-83e0-3896dd9e9ed8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:43.584225 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b00215-9964-40af-83e0-3896dd9e9ed8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:43.594071 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b00215-9964-40af-83e0-3896dd9e9ed8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:43.595569 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b00215-9964-40af-83e0-3896dd9e9ed8 service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:43.604851 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1120/2225] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:04:43.695006 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-e1a455d5-f802-42c9-84ca-f97c0c98a2c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae23adb0a49e482a9f89bb54fc711ac7'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:43.695815 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-e1a455d5-f802-42c9-84ca-f97c0c98a2c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae23adb0a49e482a9f89bb54fc711ac7'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:43.697003 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-e1a455d5-f802-42c9-84ca-f97c0c98a2c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae23adb0a49e482a9f89bb54fc711ac7'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:43.861470 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-e1a455d5-f802-42c9-84ca-f97c0c98a2c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae23adb0a49e482a9f89bb54fc711ac7'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:43.875970 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-e1a455d5-f802-42c9-84ca-f97c0c98a2c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae23adb0a49e482a9f89bb54fc711ac7'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:43.902174 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1106/2226] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:04:43 2022] DELETE /identity/v3/users/ae23adb0a49e482a9f89bb54fc711ac7 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:04:43.915665 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23559e-135c-4560-b988-edf19ce2e3a2 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:43.916323 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23559e-135c-4560-b988-edf19ce2e3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:43.916323 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23559e-135c-4560-b988-edf19ce2e3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:43.939989 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-4b23559e-135c-4560-b988-edf19ce2e3a2 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:43.941539 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-4b23559e-135c-4560-b988-edf19ce2e3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:44.006500 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1121/2227] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:44.023667 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:44.027619 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a455d5-f802-42c9-84ca-f97c0c98a2c5 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:44.029062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e1a455d5-f802-42c9-84ca-f97c0c98a2c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:44.092930 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:44.097537 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a455d5-f802-42c9-84ca-f97c0c98a2c5 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:44.102054 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedc713-f001-4045-a46f-62130a03ece0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:44.102866 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedc713-f001-4045-a46f-62130a03ece0 service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:44.103214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedc713-f001-4045-a46f-62130a03ece0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:44.103524 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedc713-f001-4045-a46f-62130a03ece0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:44.114715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebedc713-f001-4045-a46f-62130a03ece0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:44.116140 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebedc713-f001-4045-a46f-62130a03ece0 service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:44.125891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1107/2228] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:04:44.134338 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23559e-135c-4560-b988-edf19ce2e3a2 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:44.135879 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-4b23559e-135c-4560-b988-edf19ce2e3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:44.150066 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23559e-135c-4560-b988-edf19ce2e3a2 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:44.154974 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2b6b3-42b8-4f2d-9873-c63dbe37f611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:44.155616 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2b6b3-42b8-4f2d-9873-c63dbe37f611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:44.156087 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2b6b3-42b8-4f2d-9873-c63dbe37f611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:44.156366 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2b6b3-42b8-4f2d-9873-c63dbe37f611 admin admin] PATH_INFO: `/v3/projects/5d1dcbeb7a1b455fa99941a4bb62c8d3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:44.158606 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d2b6b3-42b8-4f2d-9873-c63dbe37f611 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d1dcbeb7a1b455fa99941a4bb62c8d3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:44.160568 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d2b6b3-42b8-4f2d-9873-c63dbe37f611 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:44.284407 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d1d2b6b3-42b8-4f2d-9873-c63dbe37f611 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d1dcbeb7a1b455fa99941a4bb62c8d3', 'request_id': 'req-d1d2b6b3-42b8-4f2d-9873-c63dbe37f611'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:44.376182 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d1d2b6b3-42b8-4f2d-9873-c63dbe37f611 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d1dcbeb7a1b455fa99941a4bb62c8d3', 'request_id': 'req-d1d2b6b3-42b8-4f2d-9873-c63dbe37f611'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:44.378931 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:44.386017 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d1d2b6b3-42b8-4f2d-9873-c63dbe37f611 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d1dcbeb7a1b455fa99941a4bb62c8d3', 'request_id': 'req-d1d2b6b3-42b8-4f2d-9873-c63dbe37f611'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:44.399226 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d1d2b6b3-42b8-4f2d-9873-c63dbe37f611 admin admin] The token cache is being invalidate because project 5d1dcbeb7a1b455fa99941a4bb62c8d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:04:44.399520 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d1d2b6b3-42b8-4f2d-9873-c63dbe37f611 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:44.400526 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d1d2b6b3-42b8-4f2d-9873-c63dbe37f611 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:44.401959 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1122/2229] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:04:44 2022] DELETE /identity/v3/projects/5d1dcbeb7a1b455fa99941a4bb62c8d3 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:44.407211 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedc713-f001-4045-a46f-62130a03ece0 service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:44.420654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedc713-f001-4045-a46f-62130a03ece0 service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:44.491471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11258b55-3997-4d95-a2ce-d9f68ff1f8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:44.492101 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11258b55-3997-4d95-a2ce-d9f68ff1f8c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:44.492379 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11258b55-3997-4d95-a2ce-d9f68ff1f8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:44.492681 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11258b55-3997-4d95-a2ce-d9f68ff1f8c2 admin admin] PATH_INFO: `/v3/users/649424691c2b4187959cb2c89c452984` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:44.493799 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11258b55-3997-4d95-a2ce-d9f68ff1f8c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=649424691c2b4187959cb2c89c452984)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:44.495703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11258b55-3997-4d95-a2ce-d9f68ff1f8c2 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:44.571537 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2b6b3-42b8-4f2d-9873-c63dbe37f611 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:44.573349 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-d1d2b6b3-42b8-4f2d-9873-c63dbe37f611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:44.589391 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2b6b3-42b8-4f2d-9873-c63dbe37f611 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:44.594726 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e18a5-2363-4cc0-9eb5-615bdebb12e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:44.597476 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e18a5-2363-4cc0-9eb5-615bdebb12e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:44.600481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e18a5-2363-4cc0-9eb5-615bdebb12e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:44.600821 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e18a5-2363-4cc0-9eb5-615bdebb12e2 admin admin] PATH_INFO: `/v3/projects/1c1ba44b35a246c3b536a297767cdf87` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:44.602046 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e18a5-2363-4cc0-9eb5-615bdebb12e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c1ba44b35a246c3b536a297767cdf87)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:44.604028 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e18a5-2363-4cc0-9eb5-615bdebb12e2 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:44.699711 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-11258b55-3997-4d95-a2ce-d9f68ff1f8c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '649424691c2b4187959cb2c89c452984'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:44.700370 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-11258b55-3997-4d95-a2ce-d9f68ff1f8c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '649424691c2b4187959cb2c89c452984'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:44.700990 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-11258b55-3997-4d95-a2ce-d9f68ff1f8c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '649424691c2b4187959cb2c89c452984'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:44.727946 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-836e18a5-2363-4cc0-9eb5-615bdebb12e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c1ba44b35a246c3b536a297767cdf87', 'request_id': 'req-836e18a5-2363-4cc0-9eb5-615bdebb12e2'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:44.783553 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-11258b55-3997-4d95-a2ce-d9f68ff1f8c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '649424691c2b4187959cb2c89c452984'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:44.791134 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-11258b55-3997-4d95-a2ce-d9f68ff1f8c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '649424691c2b4187959cb2c89c452984'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:44.808280 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1108/2230] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:04:44 2022] DELETE /identity/v3/users/649424691c2b4187959cb2c89c452984 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:44.874917 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:44.897623 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-836e18a5-2363-4cc0-9eb5-615bdebb12e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c1ba44b35a246c3b536a297767cdf87', 'request_id': 'req-836e18a5-2363-4cc0-9eb5-615bdebb12e2'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:44.906535 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-836e18a5-2363-4cc0-9eb5-615bdebb12e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c1ba44b35a246c3b536a297767cdf87', 'request_id': 'req-836e18a5-2363-4cc0-9eb5-615bdebb12e2'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:44.917899 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-836e18a5-2363-4cc0-9eb5-615bdebb12e2 admin admin] The token cache is being invalidate because project 1c1ba44b35a246c3b536a297767cdf87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:04:44.918187 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-836e18a5-2363-4cc0-9eb5-615bdebb12e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:44.919046 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-836e18a5-2363-4cc0-9eb5-615bdebb12e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:44.920679 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1123/2231] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:04:44 2022] DELETE /identity/v3/projects/1c1ba44b35a246c3b536a297767cdf87 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:04:44.926250 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be02b8d-156a-4b39-8335-0b9214f09945 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:44.926250 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be02b8d-156a-4b39-8335-0b9214f09945 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:44.926751 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be02b8d-156a-4b39-8335-0b9214f09945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:44.949385 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-7be02b8d-156a-4b39-8335-0b9214f09945 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:44.950581 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-7be02b8d-156a-4b39-8335-0b9214f09945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:45.016314 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:45.024123 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1109/2232] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:45.032994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dfbbb-47d4-4a7b-88b3-0c0af4fb77f2 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:45.033291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dfbbb-47d4-4a7b-88b3-0c0af4fb77f2 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:45.033565 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dfbbb-47d4-4a7b-88b3-0c0af4fb77f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:45.059076 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-cf5dfbbb-47d4-4a7b-88b3-0c0af4fb77f2 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:45.061000 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-cf5dfbbb-47d4-4a7b-88b3-0c0af4fb77f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:45.070488 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1124/2233] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:45.074895 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be02b8d-156a-4b39-8335-0b9214f09945 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:45.085588 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be02b8d-156a-4b39-8335-0b9214f09945 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:45.090683 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52199dc7-5974-4a43-be78-0ef5bbd23017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:45.091289 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52199dc7-5974-4a43-be78-0ef5bbd23017 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:45.091565 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52199dc7-5974-4a43-be78-0ef5bbd23017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:45.091836 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52199dc7-5974-4a43-be78-0ef5bbd23017 admin admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:45.092484 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52199dc7-5974-4a43-be78-0ef5bbd23017 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:04:45.092818 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52199dc7-5974-4a43-be78-0ef5bbd23017 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:45.094414 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52199dc7-5974-4a43-be78-0ef5bbd23017 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:45.107908 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1110/2234] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:04:45.112931 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dfbbb-47d4-4a7b-88b3-0c0af4fb77f2 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:45.122251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dfbbb-47d4-4a7b-88b3-0c0af4fb77f2 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:45.127327 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d40a0e-2c1e-4f08-8f3e-01a92a785d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:45.128013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d40a0e-2c1e-4f08-8f3e-01a92a785d17 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:45.128353 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d40a0e-2c1e-4f08-8f3e-01a92a785d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:45.128823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d40a0e-2c1e-4f08-8f3e-01a92a785d17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:45.129539 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d40a0e-2c1e-4f08-8f3e-01a92a785d17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:45.131688 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d40a0e-2c1e-4f08-8f3e-01a92a785d17 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:45.264767 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1125/2235] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:04:45 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:45.267725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52199dc7-5974-4a43-be78-0ef5bbd23017 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:45.269900 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-52199dc7-5974-4a43-be78-0ef5bbd23017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:45.273081 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d40a0e-2c1e-4f08-8f3e-01a92a785d17 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:45.285677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52199dc7-5974-4a43-be78-0ef5bbd23017 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:45.346917 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723068a0-669a-4bc4-8776-87511d31cc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:45.347560 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723068a0-669a-4bc4-8776-87511d31cc0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:45.347960 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723068a0-669a-4bc4-8776-87511d31cc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:45.348241 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723068a0-669a-4bc4-8776-87511d31cc0f admin admin] PATH_INFO: `/v3/projects/2cd2df3f6de74325b46a85ed24f4a1df` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:45.349413 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723068a0-669a-4bc4-8776-87511d31cc0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cd2df3f6de74325b46a85ed24f4a1df)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:45.351404 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723068a0-669a-4bc4-8776-87511d31cc0f admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:45.357673 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d40a0e-2c1e-4f08-8f3e-01a92a785d17 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:45.365144 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2dfde-64bf-43e1-bcab-b21361b894c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:45.369273 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2dfde-64bf-43e1-bcab-b21361b894c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:45.369273 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2dfde-64bf-43e1-bcab-b21361b894c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:45.369273 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2dfde-64bf-43e1-bcab-b21361b894c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:45.369273 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2dfde-64bf-43e1-bcab-b21361b894c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:45.369804 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2dfde-64bf-43e1-bcab-b21361b894c8 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:45.442215 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1126/2236] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:04:45 2022] POST /identity/v3/users => generated 287 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:45.446188 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2dfde-64bf-43e1-bcab-b21361b894c8 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:45.455299 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-723068a0-669a-4bc4-8776-87511d31cc0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cd2df3f6de74325b46a85ed24f4a1df', 'request_id': 'req-723068a0-669a-4bc4-8776-87511d31cc0f'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:45.458225 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2dfde-64bf-43e1-bcab-b21361b894c8 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:45.461433 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-723068a0-669a-4bc4-8776-87511d31cc0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cd2df3f6de74325b46a85ed24f4a1df', 'request_id': 'req-723068a0-669a-4bc4-8776-87511d31cc0f'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:45.468295 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-723068a0-669a-4bc4-8776-87511d31cc0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cd2df3f6de74325b46a85ed24f4a1df', 'request_id': 'req-723068a0-669a-4bc4-8776-87511d31cc0f'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:45.516218 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4633c-9a9c-402a-86a2-dd333018f56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:45.516766 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4633c-9a9c-402a-86a2-dd333018f56d admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:45.517610 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4633c-9a9c-402a-86a2-dd333018f56d admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:45.517978 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4633c-9a9c-402a-86a2-dd333018f56d admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:45.518620 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e4633c-9a9c-402a-86a2-dd333018f56d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:45.520207 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e4633c-9a9c-402a-86a2-dd333018f56d admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:45.529592 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1127/2237] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:04:45.534269 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4633c-9a9c-402a-86a2-dd333018f56d admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:45.542677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-723068a0-669a-4bc4-8776-87511d31cc0f admin admin] The token cache is being invalidate because project 2cd2df3f6de74325b46a85ed24f4a1df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:04:45.542970 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-723068a0-669a-4bc4-8776-87511d31cc0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:45.543552 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4633c-9a9c-402a-86a2-dd333018f56d admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:45.543680 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-723068a0-669a-4bc4-8776-87511d31cc0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:45.545340 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1111/2238] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:04:45 2022] DELETE /identity/v3/projects/2cd2df3f6de74325b46a85ed24f4a1df => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:04:45.548148 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93297d-ae33-4fac-a775-6f541c43f2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:45.549326 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93297d-ae33-4fac-a775-6f541c43f2bc admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:45.549782 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93297d-ae33-4fac-a775-6f541c43f2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:45.549916 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723068a0-669a-4bc4-8776-87511d31cc0f admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:45.550059 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93297d-ae33-4fac-a775-6f541c43f2bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:45.550695 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93297d-ae33-4fac-a775-6f541c43f2bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:45.551152 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-723068a0-669a-4bc4-8776-87511d31cc0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:45.552270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93297d-ae33-4fac-a775-6f541c43f2bc admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:45.566706 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1128/2239] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:04:45.566909 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723068a0-669a-4bc4-8776-87511d31cc0f admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:45.567728 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93297d-ae33-4fac-a775-6f541c43f2bc admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:45.569375 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-5a93297d-ae33-4fac-a775-6f541c43f2bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:45.571383 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211cdc4-d237-4993-be5d-95a79b8be1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:45.572026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211cdc4-d237-4993-be5d-95a79b8be1ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:45.572309 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211cdc4-d237-4993-be5d-95a79b8be1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:45.572586 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211cdc4-d237-4993-be5d-95a79b8be1ca admin admin] PATH_INFO: `/v3/users/4f3afa6b4b7a4984aa86cd97401f60fa` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:45.573765 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211cdc4-d237-4993-be5d-95a79b8be1ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f3afa6b4b7a4984aa86cd97401f60fa)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:45.575773 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211cdc4-d237-4993-be5d-95a79b8be1ca admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:45.585553 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93297d-ae33-4fac-a775-6f541c43f2bc admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:45.590603 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be376a-f9ed-463f-8ffb-568c4ebcff14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:45.591226 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be376a-f9ed-463f-8ffb-568c4ebcff14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:45.591521 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be376a-f9ed-463f-8ffb-568c4ebcff14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:45.593397 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be376a-f9ed-463f-8ffb-568c4ebcff14 admin admin] PATH_INFO: `/v3/projects/6c550075e92d4aac890b9369aa72073b/users/97c6c92b17344e4ea24f71306d5b20e3/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:45.607697 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be376a-f9ed-463f-8ffb-568c4ebcff14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c550075e92d4aac890b9369aa72073b, user_id=97c6c92b17344e4ea24f71306d5b20e3, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:45.610470 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be376a-f9ed-463f-8ffb-568c4ebcff14 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:45.684172 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1129/2240] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:45 2022] PUT /identity/v3/projects/6c550075e92d4aac890b9369aa72073b/users/97c6c92b17344e4ea24f71306d5b20e3/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:45.695014 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7e005-88ee-47cf-8753-3347f1696811 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:45.695306 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7e005-88ee-47cf-8753-3347f1696811 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:45.695582 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7e005-88ee-47cf-8753-3347f1696811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:45.723145 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-cfb7e005-88ee-47cf-8753-3347f1696811 None None] MFA Rules not processed for user `97c6c92b17344e4ea24f71306d5b20e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:45.724339 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-cfb7e005-88ee-47cf-8753-3347f1696811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:45.756002 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-2211cdc4-d237-4993-be5d-95a79b8be1ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f3afa6b4b7a4984aa86cd97401f60fa'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:45.756967 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-2211cdc4-d237-4993-be5d-95a79b8be1ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f3afa6b4b7a4984aa86cd97401f60fa'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:45.757990 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-2211cdc4-d237-4993-be5d-95a79b8be1ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f3afa6b4b7a4984aa86cd97401f60fa'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:45.793202 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1130/2241] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:04:45.804905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7e005-88ee-47cf-8753-3347f1696811 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:45.807072 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-cfb7e005-88ee-47cf-8753-3347f1696811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:45.847880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-2211cdc4-d237-4993-be5d-95a79b8be1ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f3afa6b4b7a4984aa86cd97401f60fa'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:45.856123 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-2211cdc4-d237-4993-be5d-95a79b8be1ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f3afa6b4b7a4984aa86cd97401f60fa'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:45.869120 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7e005-88ee-47cf-8753-3347f1696811 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:45.872976 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb74133-c66e-4a9d-bcf1-07a718c7ceff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:45.873630 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb74133-c66e-4a9d-bcf1-07a718c7ceff service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:45.873914 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb74133-c66e-4a9d-bcf1-07a718c7ceff service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:45.874189 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb74133-c66e-4a9d-bcf1-07a718c7ceff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:45.882146 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1112/2242] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:04:45 2022] DELETE /identity/v3/users/4f3afa6b4b7a4984aa86cd97401f60fa => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:04:45.894833 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb74133-c66e-4a9d-bcf1-07a718c7ceff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:45.896324 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb74133-c66e-4a9d-bcf1-07a718c7ceff service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:45.906950 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1131/2243] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:04:46.004798 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:46.120351 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:46.384976 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211cdc4-d237-4993-be5d-95a79b8be1ca admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:46.388899 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-2211cdc4-d237-4993-be5d-95a79b8be1ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:46.458425 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211cdc4-d237-4993-be5d-95a79b8be1ca admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:46.463379 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291ed42-0e51-458a-bc4d-ff195a125344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:46.464012 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291ed42-0e51-458a-bc4d-ff195a125344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:46.464293 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291ed42-0e51-458a-bc4d-ff195a125344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:46.464566 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291ed42-0e51-458a-bc4d-ff195a125344 admin admin] PATH_INFO: `/v3/projects/2705e0c8fa564e3aae01435d5241f5ef` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:46.466458 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f291ed42-0e51-458a-bc4d-ff195a125344 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2705e0c8fa564e3aae01435d5241f5ef)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:46.468514 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f291ed42-0e51-458a-bc4d-ff195a125344 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:46.599410 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-f291ed42-0e51-458a-bc4d-ff195a125344 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2705e0c8fa564e3aae01435d5241f5ef', 'request_id': 'req-f291ed42-0e51-458a-bc4d-ff195a125344'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:46.604762 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-f291ed42-0e51-458a-bc4d-ff195a125344 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2705e0c8fa564e3aae01435d5241f5ef', 'request_id': 'req-f291ed42-0e51-458a-bc4d-ff195a125344'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:46.611781 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-f291ed42-0e51-458a-bc4d-ff195a125344 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2705e0c8fa564e3aae01435d5241f5ef', 'request_id': 'req-f291ed42-0e51-458a-bc4d-ff195a125344'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:46.725850 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-f291ed42-0e51-458a-bc4d-ff195a125344 admin admin] The token cache is being invalidate because project 2705e0c8fa564e3aae01435d5241f5ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:04:46.726138 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-f291ed42-0e51-458a-bc4d-ff195a125344 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:46.726977 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-f291ed42-0e51-458a-bc4d-ff195a125344 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:46.728471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1113/2244] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:04:46 2022] DELETE /identity/v3/projects/2705e0c8fa564e3aae01435d5241f5ef => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:46.737990 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3368ed-c486-4539-914e-b6c81df3db7b None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:46.738485 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3368ed-c486-4539-914e-b6c81df3db7b None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:46.738882 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3368ed-c486-4539-914e-b6c81df3db7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:46.754037 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:46.768496 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-6e3368ed-c486-4539-914e-b6c81df3db7b None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:46.769745 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-6e3368ed-c486-4539-914e-b6c81df3db7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:46.815701 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:46.835270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1132/2245] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:46.842781 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77d935-50a3-492b-8016-65b8edcc5eeb None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:46.843071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77d935-50a3-492b-8016-65b8edcc5eeb None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:46.843347 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77d935-50a3-492b-8016-65b8edcc5eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:46.865652 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-9c77d935-50a3-492b-8016-65b8edcc5eeb None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:46.866781 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-9c77d935-50a3-492b-8016-65b8edcc5eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:46.874911 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1114/2246] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:46.879934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3368ed-c486-4539-914e-b6c81df3db7b None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:46.892190 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3368ed-c486-4539-914e-b6c81df3db7b None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:46.897293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2406c30-30d9-4ba5-944d-8017af455b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:46.897929 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2406c30-30d9-4ba5-944d-8017af455b9a admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:46.898211 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2406c30-30d9-4ba5-944d-8017af455b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:46.898487 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2406c30-30d9-4ba5-944d-8017af455b9a admin admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:46.899145 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2406c30-30d9-4ba5-944d-8017af455b9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:04:46.899446 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2406c30-30d9-4ba5-944d-8017af455b9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:46.901118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2406c30-30d9-4ba5-944d-8017af455b9a admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:46.913812 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1133/2247] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:04:46.918278 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77d935-50a3-492b-8016-65b8edcc5eeb None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:46.928561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77d935-50a3-492b-8016-65b8edcc5eeb None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:46.933824 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bcf06-59b7-4ec9-8994-5b72e05333e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:46.934419 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bcf06-59b7-4ec9-8994-5b72e05333e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:46.934698 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bcf06-59b7-4ec9-8994-5b72e05333e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:46.934968 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bcf06-59b7-4ec9-8994-5b72e05333e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:46.935586 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5bcf06-59b7-4ec9-8994-5b72e05333e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:46.937524 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5bcf06-59b7-4ec9-8994-5b72e05333e3 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:46.950351 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:47.019507 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1115/2248] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:04:46 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:47.024167 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2406c30-30d9-4ba5-944d-8017af455b9a admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:47.036173 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2406c30-30d9-4ba5-944d-8017af455b9a admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:47.098122 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882bda5-1ba8-420e-aca5-4e3f9a34a783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:47.098746 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882bda5-1ba8-420e-aca5-4e3f9a34a783 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:47.099029 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882bda5-1ba8-420e-aca5-4e3f9a34a783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:47.099304 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882bda5-1ba8-420e-aca5-4e3f9a34a783 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:47.100000 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882bda5-1ba8-420e-aca5-4e3f9a34a783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:47.102037 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882bda5-1ba8-420e-aca5-4e3f9a34a783 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:47.195374 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1134/2249] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:04:47 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:04:47.199446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bcf06-59b7-4ec9-8994-5b72e05333e3 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:47.210740 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bcf06-59b7-4ec9-8994-5b72e05333e3 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:47.215695 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6addc99-52ad-4e80-be4f-2924d31d087c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:47.216330 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6addc99-52ad-4e80-be4f-2924d31d087c admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:47.216612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6addc99-52ad-4e80-be4f-2924d31d087c admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:47.216915 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6addc99-52ad-4e80-be4f-2924d31d087c admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:47.217558 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6addc99-52ad-4e80-be4f-2924d31d087c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:47.219211 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6addc99-52ad-4e80-be4f-2924d31d087c admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:47.230812 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1116/2250] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:47.235270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882bda5-1ba8-420e-aca5-4e3f9a34a783 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:47.245668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882bda5-1ba8-420e-aca5-4e3f9a34a783 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:47.250825 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c3433-29e4-4a28-bb04-cbf00b252752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:47.258327 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c3433-29e4-4a28-bb04-cbf00b252752 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:47.258327 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c3433-29e4-4a28-bb04-cbf00b252752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:47.258327 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c3433-29e4-4a28-bb04-cbf00b252752 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:47.258327 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c3433-29e4-4a28-bb04-cbf00b252752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:47.258327 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c3433-29e4-4a28-bb04-cbf00b252752 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:47.267145 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1135/2251] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:04:47.271790 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6addc99-52ad-4e80-be4f-2924d31d087c admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:47.282283 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6addc99-52ad-4e80-be4f-2924d31d087c admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:47.288755 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af375b-f237-47fa-983c-3f4521be58f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:47.289428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af375b-f237-47fa-983c-3f4521be58f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:47.290114 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af375b-f237-47fa-983c-3f4521be58f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:47.290405 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af375b-f237-47fa-983c-3f4521be58f4 admin admin] PATH_INFO: `/v3/projects/b0296b51a2d644719b1c3bb4ce896ca1/users/eddd25e92b304a509f29e1bc5a422874/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:47.305850 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af375b-f237-47fa-983c-3f4521be58f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0296b51a2d644719b1c3bb4ce896ca1, user_id=eddd25e92b304a509f29e1bc5a422874, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:47.308790 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af375b-f237-47fa-983c-3f4521be58f4 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:47.406350 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1117/2252] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:04:47 2022] PUT /identity/v3/projects/b0296b51a2d644719b1c3bb4ce896ca1/users/eddd25e92b304a509f29e1bc5a422874/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:47.417632 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d7e05-4d80-49c4-b6a7-49d3e00986e0 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:47.417954 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d7e05-4d80-49c4-b6a7-49d3e00986e0 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:47.418223 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d7e05-4d80-49c4-b6a7-49d3e00986e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:47.447069 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-d37d7e05-4d80-49c4-b6a7-49d3e00986e0 None None] MFA Rules not processed for user `eddd25e92b304a509f29e1bc5a422874`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:47.448385 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-d37d7e05-4d80-49c4-b6a7-49d3e00986e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:47.458807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:47.516573 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1136/2253] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:47.528499 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af375b-f237-47fa-983c-3f4521be58f4 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:47.530324 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-b5af375b-f237-47fa-983c-3f4521be58f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:47.609619 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af375b-f237-47fa-983c-3f4521be58f4 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:47.613521 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14bd17-d4ff-4d14-b27c-a6650f8a4f5f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21fda517a384dc5a6a9f36d68ac1a2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:47.614128 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14bd17-d4ff-4d14-b27c-a6650f8a4f5f service glance] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:47.614408 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14bd17-d4ff-4d14-b27c-a6650f8a4f5f service glance] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:47.614679 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14bd17-d4ff-4d14-b27c-a6650f8a4f5f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:47.622357 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:47.623745 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14bd17-d4ff-4d14-b27c-a6650f8a4f5f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:47.625153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14bd17-d4ff-4d14-b27c-a6650f8a4f5f service glance] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:47.635528 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1118/2254] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:04:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:04:47.822301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=88,keystone:INSERT=6,keystone:DELETE=6 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:47.879616 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:48.718987 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:49.004482 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:49.229150 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:50.450382 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:50.507176 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:50.510677 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b32fe-0c77-4ec5-85e2-67c65bd48b21 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:50.510677 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b32fe-0c77-4ec5-85e2-67c65bd48b21 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:50.510677 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b32fe-0c77-4ec5-85e2-67c65bd48b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:50.530213 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-d37b32fe-0c77-4ec5-85e2-67c65bd48b21 None None] MFA Rules not processed for user `a555b35e0657498fa68fe32e3b0f21cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:04:50.531421 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-d37b32fe-0c77-4ec5-85e2-67c65bd48b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:50.593364 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1137/2255] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:04:50.647183 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:50.676230 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:51.005811 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:51.318277 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:51.406302 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:52.099084 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:52.263249 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:52.594423 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:52.649782 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:53.053761 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:53.170367 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:53.463151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:53.553541 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:53.786019 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:53.892145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:54.332233 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:54.460390 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:54.560167 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:54.914926 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:55.230918 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:55.309190 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:55.914549 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:56.057282 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:56.325620 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:56.696879 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:57.055567 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:57.268908 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:57.594295 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:57.680073 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:58.228385 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:58.308342 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:58.341014 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:58.645686 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:58.763674 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:58.920569 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:59.091351 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:59.593286 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14bd17-d4ff-4d14-b27c-a6650f8a4f5f service glance] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:04:59.594674 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-df14bd17-d4ff-4d14-b27c-a6650f8a4f5f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:04:59.661734 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14bd17-d4ff-4d14-b27c-a6650f8a4f5f service glance] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:04:59.666586 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c230b8-8d15-4419-9591-4eb7e117947b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:04:59.667223 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c230b8-8d15-4419-9591-4eb7e117947b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:59.667507 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c230b8-8d15-4419-9591-4eb7e117947b admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:59.667789 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c230b8-8d15-4419-9591-4eb7e117947b admin admin] PATH_INFO: `/v3/users/97c6c92b17344e4ea24f71306d5b20e3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:04:59.668965 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c230b8-8d15-4419-9591-4eb7e117947b admin admin] RBAC: Authorizing `identity:delete_user(user_id=97c6c92b17344e4ea24f71306d5b20e3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:04:59.670895 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c230b8-8d15-4419-9591-4eb7e117947b admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:04:59.865433 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-68c230b8-8d15-4419-9591-4eb7e117947b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97c6c92b17344e4ea24f71306d5b20e3'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:59.866056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-68c230b8-8d15-4419-9591-4eb7e117947b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97c6c92b17344e4ea24f71306d5b20e3'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:59.866682 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-68c230b8-8d15-4419-9591-4eb7e117947b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97c6c92b17344e4ea24f71306d5b20e3'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:59.963075 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-68c230b8-8d15-4419-9591-4eb7e117947b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97c6c92b17344e4ea24f71306d5b20e3'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:59.970592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-68c230b8-8d15-4419-9591-4eb7e117947b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97c6c92b17344e4ea24f71306d5b20e3'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:04:59.992541 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1119/2256] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:04:59 2022] DELETE /identity/v3/users/97c6c92b17344e4ea24f71306d5b20e3 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:04:59.997345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f82ef-a578-4160-89dd-b4bcb5155d31 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:04:59.997785 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f82ef-a578-4160-89dd-b4bcb5155d31 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:04:59.997876 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f82ef-a578-4160-89dd-b4bcb5155d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:00.017838 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-ec9f82ef-a578-4160-89dd-b4bcb5155d31 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:05:00.019436 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-ec9f82ef-a578-4160-89dd-b4bcb5155d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:00.070621 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:00.086885 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1138/2257] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:05:00.097506 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c230b8-8d15-4419-9591-4eb7e117947b admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:00.104815 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-68c230b8-8d15-4419-9591-4eb7e117947b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:00.170841 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:00.176513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c230b8-8d15-4419-9591-4eb7e117947b admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:00.180339 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0351d9a-13a8-4114-bb98-7db3787705d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:00.180969 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0351d9a-13a8-4114-bb98-7db3787705d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:00.181809 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0351d9a-13a8-4114-bb98-7db3787705d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:00.181809 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0351d9a-13a8-4114-bb98-7db3787705d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:00.192426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0351d9a-13a8-4114-bb98-7db3787705d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:00.194771 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0351d9a-13a8-4114-bb98-7db3787705d6 service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:00.206420 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1120/2258] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:05:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:05:00.735062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f82ef-a578-4160-89dd-b4bcb5155d31 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:00.736517 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-ec9f82ef-a578-4160-89dd-b4bcb5155d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:00.751695 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f82ef-a578-4160-89dd-b4bcb5155d31 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:00.768143 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d85c5-6356-4e84-bb86-68fcd9a779aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:00.769611 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d85c5-6356-4e84-bb86-68fcd9a779aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:00.769954 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d85c5-6356-4e84-bb86-68fcd9a779aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:00.770225 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d85c5-6356-4e84-bb86-68fcd9a779aa admin admin] PATH_INFO: `/v3/projects/6c550075e92d4aac890b9369aa72073b` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:00.776923 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d85c5-6356-4e84-bb86-68fcd9a779aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c550075e92d4aac890b9369aa72073b)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:00.778978 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d85c5-6356-4e84-bb86-68fcd9a779aa admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:00.891733 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-ab5d85c5-6356-4e84-bb86-68fcd9a779aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c550075e92d4aac890b9369aa72073b', 'request_id': 'req-ab5d85c5-6356-4e84-bb86-68fcd9a779aa'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:00.982503 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-ab5d85c5-6356-4e84-bb86-68fcd9a779aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c550075e92d4aac890b9369aa72073b', 'request_id': 'req-ab5d85c5-6356-4e84-bb86-68fcd9a779aa'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:00.990042 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-ab5d85c5-6356-4e84-bb86-68fcd9a779aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c550075e92d4aac890b9369aa72073b', 'request_id': 'req-ab5d85c5-6356-4e84-bb86-68fcd9a779aa'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:01.000815 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-ab5d85c5-6356-4e84-bb86-68fcd9a779aa admin admin] The token cache is being invalidate because project 6c550075e92d4aac890b9369aa72073b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:05:01.001411 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-ab5d85c5-6356-4e84-bb86-68fcd9a779aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:01.001762 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-ab5d85c5-6356-4e84-bb86-68fcd9a779aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:01.004078 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1139/2259] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:05:00 2022] DELETE /identity/v3/projects/6c550075e92d4aac890b9369aa72073b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:05:01.009210 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f3acc-06c8-4e9d-a8a7-c266b01cdd95 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:01.009751 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f3acc-06c8-4e9d-a8a7-c266b01cdd95 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:01.009861 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f3acc-06c8-4e9d-a8a7-c266b01cdd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:01.030091 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-db8f3acc-06c8-4e9d-a8a7-c266b01cdd95 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:05:01.031409 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-db8f3acc-06c8-4e9d-a8a7-c266b01cdd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:01.098220 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1121/2260] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:05:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:05:01.107539 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634eadf-07f8-4b68-96eb-fda64f89f776 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:01.107835 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634eadf-07f8-4b68-96eb-fda64f89f776 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:01.108115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634eadf-07f8-4b68-96eb-fda64f89f776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:01.130030 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-7634eadf-07f8-4b68-96eb-fda64f89f776 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:05:01.131307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-7634eadf-07f8-4b68-96eb-fda64f89f776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:01.139381 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1140/2261] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:05:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:05:01.143802 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f3acc-06c8-4e9d-a8a7-c266b01cdd95 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:01.153772 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f3acc-06c8-4e9d-a8a7-c266b01cdd95 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:01.158397 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf12163-d2cc-4c81-b892-1f73304c3cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:01.159514 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf12163-d2cc-4c81-b892-1f73304c3cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:01.159789 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf12163-d2cc-4c81-b892-1f73304c3cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:01.160059 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf12163-d2cc-4c81-b892-1f73304c3cb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:01.160810 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf12163-d2cc-4c81-b892-1f73304c3cb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:05:01.161118 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf12163-d2cc-4c81-b892-1f73304c3cb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:01.162714 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf12163-d2cc-4c81-b892-1f73304c3cb7 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:01.180669 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1122/2262] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:05:01.183214 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634eadf-07f8-4b68-96eb-fda64f89f776 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:01.193838 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634eadf-07f8-4b68-96eb-fda64f89f776 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:01.198906 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c892775-0467-411f-ac1c-a1ce9c0fca8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:01.199518 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c892775-0467-411f-ac1c-a1ce9c0fca8b admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:01.199797 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c892775-0467-411f-ac1c-a1ce9c0fca8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:01.200072 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c892775-0467-411f-ac1c-a1ce9c0fca8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:01.200749 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c892775-0467-411f-ac1c-a1ce9c0fca8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:01.202667 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c892775-0467-411f-ac1c-a1ce9c0fca8b admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:01.324106 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1141/2263] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:05:01 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:05:01.328562 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf12163-d2cc-4c81-b892-1f73304c3cb7 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:01.339729 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf12163-d2cc-4c81-b892-1f73304c3cb7 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:01.406518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83321f-18ee-4bfe-af2e-51818db2a2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:01.407225 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83321f-18ee-4bfe-af2e-51818db2a2f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:01.407551 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83321f-18ee-4bfe-af2e-51818db2a2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:01.407825 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83321f-18ee-4bfe-af2e-51818db2a2f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:01.408468 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83321f-18ee-4bfe-af2e-51818db2a2f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:01.410625 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83321f-18ee-4bfe-af2e-51818db2a2f5 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:01.516816 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1123/2264] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:05:01 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:05:01.517934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c892775-0467-411f-ac1c-a1ce9c0fca8b admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:01.534420 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c892775-0467-411f-ac1c-a1ce9c0fca8b admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:01.540789 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e400b-7fbb-4899-b8f3-8535be50a86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:01.541453 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e400b-7fbb-4899-b8f3-8535be50a86a admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:01.542494 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e400b-7fbb-4899-b8f3-8535be50a86a admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:01.546013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e400b-7fbb-4899-b8f3-8535be50a86a admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:01.546013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e400b-7fbb-4899-b8f3-8535be50a86a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:01.546013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e400b-7fbb-4899-b8f3-8535be50a86a admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:01.559600 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1142/2265] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:05:01.563542 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83321f-18ee-4bfe-af2e-51818db2a2f5 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:01.582365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83321f-18ee-4bfe-af2e-51818db2a2f5 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:01.587789 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abda1c9-6e7f-43b8-9a73-7f786ba660c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:01.588405 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abda1c9-6e7f-43b8-9a73-7f786ba660c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:01.588720 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abda1c9-6e7f-43b8-9a73-7f786ba660c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:01.588998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abda1c9-6e7f-43b8-9a73-7f786ba660c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:01.589782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abda1c9-6e7f-43b8-9a73-7f786ba660c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:01.591936 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abda1c9-6e7f-43b8-9a73-7f786ba660c0 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:01.614320 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1124/2266] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:05:01.618482 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e400b-7fbb-4899-b8f3-8535be50a86a admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:01.631528 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e400b-7fbb-4899-b8f3-8535be50a86a admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:01.651735 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4d79b-88f3-4735-8c90-73029b08ddba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:01.651735 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4d79b-88f3-4735-8c90-73029b08ddba admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:01.651735 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4d79b-88f3-4735-8c90-73029b08ddba admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:01.651735 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4d79b-88f3-4735-8c90-73029b08ddba admin admin] PATH_INFO: `/v3/projects/f3786b4cc5124bbeb4e8e52af023b1f7/users/069ca20cb895423f9fba63dd63c1cf3d/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:01.665230 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4d79b-88f3-4735-8c90-73029b08ddba admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3786b4cc5124bbeb4e8e52af023b1f7, user_id=069ca20cb895423f9fba63dd63c1cf3d, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:01.667911 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4d79b-88f3-4735-8c90-73029b08ddba admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:01.760615 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1143/2267] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:05:01 2022] PUT /identity/v3/projects/f3786b4cc5124bbeb4e8e52af023b1f7/users/069ca20cb895423f9fba63dd63c1cf3d/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:05:01.772910 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843435f-9e1e-4d5a-a2f4-fa50c7e978bf None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:01.773132 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843435f-9e1e-4d5a-a2f4-fa50c7e978bf None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:01.773485 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843435f-9e1e-4d5a-a2f4-fa50c7e978bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:01.796068 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-0843435f-9e1e-4d5a-a2f4-fa50c7e978bf None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:05:01.797336 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-0843435f-9e1e-4d5a-a2f4-fa50c7e978bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:01.849379 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:01.861248 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1125/2268] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:05:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:05:01.871011 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4d79b-88f3-4735-8c90-73029b08ddba admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:01.872934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-7ef4d79b-88f3-4735-8c90-73029b08ddba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:01.944688 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4d79b-88f3-4735-8c90-73029b08ddba admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:01.950153 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db5035-4f01-428c-b6bf-a9dfd70df565 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:01.950826 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db5035-4f01-428c-b6bf-a9dfd70df565 service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:01.951122 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db5035-4f01-428c-b6bf-a9dfd70df565 service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:01.951396 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db5035-4f01-428c-b6bf-a9dfd70df565 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:01.962684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db5035-4f01-428c-b6bf-a9dfd70df565 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:01.964192 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db5035-4f01-428c-b6bf-a9dfd70df565 service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:01.975338 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1144/2269] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:05:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:05:08.940727 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71cdcc-f89b-4068-bda3-779e3d3a2ed1 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:08.941213 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71cdcc-f89b-4068-bda3-779e3d3a2ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:08.941379 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71cdcc-f89b-4068-bda3-779e3d3a2ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:08.970760 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-4c71cdcc-f89b-4068-bda3-779e3d3a2ed1 None None] MFA Rules not processed for user `069ca20cb895423f9fba63dd63c1cf3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:05:08.972400 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-4c71cdcc-f89b-4068-bda3-779e3d3a2ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:09.037561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1126/2270] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:05:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:05:09.042702 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db5035-4f01-428c-b6bf-a9dfd70df565 service neutron] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:09.053576 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db5035-4f01-428c-b6bf-a9dfd70df565 service neutron] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:09.058239 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e794f-f237-4cdc-8214-7c7fb6b2c6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:09.058914 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e794f-f237-4cdc-8214-7c7fb6b2c6d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:09.059193 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e794f-f237-4cdc-8214-7c7fb6b2c6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:09.059463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e794f-f237-4cdc-8214-7c7fb6b2c6d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:09.060097 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e794f-f237-4cdc-8214-7c7fb6b2c6d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:09.062030 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e794f-f237-4cdc-8214-7c7fb6b2c6d5 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:09.072476 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:09.182173 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1145/2271] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:05:09 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:05:09.183296 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71cdcc-f89b-4068-bda3-779e3d3a2ed1 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:09.195061 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71cdcc-f89b-4068-bda3-779e3d3a2ed1 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:09.256535 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cce64-d56e-4b27-ab95-97a24888196d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:09.257201 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cce64-d56e-4b27-ab95-97a24888196d admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:09.257534 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cce64-d56e-4b27-ab95-97a24888196d admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:09.257808 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cce64-d56e-4b27-ab95-97a24888196d admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:09.258494 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2cce64-d56e-4b27-ab95-97a24888196d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:09.260505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2cce64-d56e-4b27-ab95-97a24888196d admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:09.354974 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1127/2272] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:05:09 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:05:09.359405 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e794f-f237-4cdc-8214-7c7fb6b2c6d5 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:09.371210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e794f-f237-4cdc-8214-7c7fb6b2c6d5 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:09.376008 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f3df2-3eb2-4326-8722-b7dabce4845b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:09.381981 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f3df2-3eb2-4326-8722-b7dabce4845b admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:09.381981 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f3df2-3eb2-4326-8722-b7dabce4845b admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:09.381981 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f3df2-3eb2-4326-8722-b7dabce4845b admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:09.381981 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f3df2-3eb2-4326-8722-b7dabce4845b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:09.381981 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f3df2-3eb2-4326-8722-b7dabce4845b admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:09.389611 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1146/2273] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:05:09.393880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cce64-d56e-4b27-ab95-97a24888196d admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:09.405419 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cce64-d56e-4b27-ab95-97a24888196d admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:09.411342 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a5631-2d21-429e-9bbe-ce2986e863d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:09.411974 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a5631-2d21-429e-9bbe-ce2986e863d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:09.412271 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a5631-2d21-429e-9bbe-ce2986e863d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:09.412545 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a5631-2d21-429e-9bbe-ce2986e863d7 admin admin] PATH_INFO: `/v3/projects/7e61429d004744a5a1674fdeb08d4781/users/e43c7c61d4b84de48e434683fc90434c/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:09.429485 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a5631-2d21-429e-9bbe-ce2986e863d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e61429d004744a5a1674fdeb08d4781, user_id=e43c7c61d4b84de48e434683fc90434c, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:09.434493 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a5631-2d21-429e-9bbe-ce2986e863d7 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:09.546676 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1128/2274] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:05:09 2022] PUT /identity/v3/projects/7e61429d004744a5a1674fdeb08d4781/users/e43c7c61d4b84de48e434683fc90434c/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:05:09.551320 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f3df2-3eb2-4326-8722-b7dabce4845b admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:09.562257 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f3df2-3eb2-4326-8722-b7dabce4845b admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:09.637493 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387c3e4-6251-455e-b35c-a08f94e7d3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:09.638187 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387c3e4-6251-455e-b35c-a08f94e7d3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:09.638513 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387c3e4-6251-455e-b35c-a08f94e7d3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:09.638818 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387c3e4-6251-455e-b35c-a08f94e7d3c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:09.639530 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387c3e4-6251-455e-b35c-a08f94e7d3c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:09.641245 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387c3e4-6251-455e-b35c-a08f94e7d3c0 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:09.654947 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1147/2275] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:05:09.658466 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a5631-2d21-429e-9bbe-ce2986e863d7 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:09.670721 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a5631-2d21-429e-9bbe-ce2986e863d7 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:09.676209 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e7d44-e226-4ddb-8de8-e68a8be55eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:09.677130 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e7d44-e226-4ddb-8de8-e68a8be55eee admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:09.677501 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e7d44-e226-4ddb-8de8-e68a8be55eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:09.677875 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e7d44-e226-4ddb-8de8-e68a8be55eee admin admin] PATH_INFO: `/v3/projects/7e61429d004744a5a1674fdeb08d4781/users/e43c7c61d4b84de48e434683fc90434c/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:09.679880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e7d44-e226-4ddb-8de8-e68a8be55eee admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e61429d004744a5a1674fdeb08d4781, user_id=e43c7c61d4b84de48e434683fc90434c, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:09.683037 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e7d44-e226-4ddb-8de8-e68a8be55eee admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:09.701262 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1129/2276] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:05:09 2022] PUT /identity/v3/projects/7e61429d004744a5a1674fdeb08d4781/users/e43c7c61d4b84de48e434683fc90434c/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:05:15.859031 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387c3e4-6251-455e-b35c-a08f94e7d3c0 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:15.865433 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-c387c3e4-6251-455e-b35c-a08f94e7d3c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:15.879363 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387c3e4-6251-455e-b35c-a08f94e7d3c0 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:16.006737 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4cc209-8b59-49ef-9c4a-4070ee1f1f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:16.008088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4cc209-8b59-49ef-9c4a-4070ee1f1f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:16.008088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4cc209-8b59-49ef-9c4a-4070ee1f1f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:16.008608 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4cc209-8b59-49ef-9c4a-4070ee1f1f03 admin admin] PATH_INFO: `/v3/users/d262369e6b7d42d4a3273bccc7cd48ab` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:16.010002 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4cc209-8b59-49ef-9c4a-4070ee1f1f03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d262369e6b7d42d4a3273bccc7cd48ab)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:16.012121 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4cc209-8b59-49ef-9c4a-4070ee1f1f03 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:16.189313 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87414532-9c1e-4de7-a600-56942e0d2e7e None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:16.189313 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87414532-9c1e-4de7-a600-56942e0d2e7e None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:16.189313 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87414532-9c1e-4de7-a600-56942e0d2e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:16.222790 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-87414532-9c1e-4de7-a600-56942e0d2e7e None None] MFA Rules not processed for user `e43c7c61d4b84de48e434683fc90434c`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:05:16.224165 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-87414532-9c1e-4de7-a600-56942e0d2e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:16.256398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:16.286369 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-eb4cc209-8b59-49ef-9c4a-4070ee1f1f03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd262369e6b7d42d4a3273bccc7cd48ab'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:16.287192 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-eb4cc209-8b59-49ef-9c4a-4070ee1f1f03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd262369e6b7d42d4a3273bccc7cd48ab'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:16.287821 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-eb4cc209-8b59-49ef-9c4a-4070ee1f1f03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd262369e6b7d42d4a3273bccc7cd48ab'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:16.354820 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-eb4cc209-8b59-49ef-9c4a-4070ee1f1f03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd262369e6b7d42d4a3273bccc7cd48ab'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:16.357910 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1130/2277] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:05:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:05:16.372476 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87414532-9c1e-4de7-a600-56942e0d2e7e None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:16.374005 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-87414532-9c1e-4de7-a600-56942e0d2e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:16.456211 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87414532-9c1e-4de7-a600-56942e0d2e7e None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:16.461796 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287aaf92-8ce1-49e6-be96-100495b699cd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21fda517a384dc5a6a9f36d68ac1a2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:16.461796 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287aaf92-8ce1-49e6-be96-100495b699cd service glance] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:16.461796 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287aaf92-8ce1-49e6-be96-100495b699cd service glance] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:16.461796 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287aaf92-8ce1-49e6-be96-100495b699cd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:16.463604 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-287aaf92-8ce1-49e6-be96-100495b699cd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:16.484662 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-eb4cc209-8b59-49ef-9c4a-4070ee1f1f03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd262369e6b7d42d4a3273bccc7cd48ab'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:16.490990 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:16.500355 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1148/2278] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:05:15 2022] DELETE /identity/v3/users/d262369e6b7d42d4a3273bccc7cd48ab => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:05:16.506091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8d2d0-0fac-496f-b662-381e607aa418 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:16.506379 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8d2d0-0fac-496f-b662-381e607aa418 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:16.506660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8d2d0-0fac-496f-b662-381e607aa418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:16.530484 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-6af8d2d0-0fac-496f-b662-381e607aa418 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:05:16.530484 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-6af8d2d0-0fac-496f-b662-381e607aa418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:16.556049 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287aaf92-8ce1-49e6-be96-100495b699cd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:16.557594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287aaf92-8ce1-49e6-be96-100495b699cd service glance] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:16.568995 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1131/2279] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:05:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:05:16.597910 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1149/2280] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:05:16.621384 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287aaf92-8ce1-49e6-be96-100495b699cd service glance] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:16.622880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-287aaf92-8ce1-49e6-be96-100495b699cd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:16.695533 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287aaf92-8ce1-49e6-be96-100495b699cd service glance] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:16.831952 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad49e5-5f15-42a3-81fa-567246fa9b40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:16.832703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad49e5-5f15-42a3-81fa-567246fa9b40 service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:16.832992 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad49e5-5f15-42a3-81fa-567246fa9b40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:16.833265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad49e5-5f15-42a3-81fa-567246fa9b40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:16.861291 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ad49e5-5f15-42a3-81fa-567246fa9b40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:16.863898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ad49e5-5f15-42a3-81fa-567246fa9b40 service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:16.883208 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1132/2281] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:05:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:05:16.977217 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ff7b0-3e51-4258-8609-9b161207dc57 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:16.978194 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ff7b0-3e51-4258-8609-9b161207dc57 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:16.978538 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ff7b0-3e51-4258-8609-9b161207dc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:17.016888 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-788ff7b0-3e51-4258-8609-9b161207dc57 None None] MFA Rules not processed for user `eaf3821dd57a4d8f9ca6385c202bb0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:05:17.018656 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-788ff7b0-3e51-4258-8609-9b161207dc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:17.093678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1150/2282] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 24 16:05:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:05:17.136936 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad49e5-5f15-42a3-81fa-567246fa9b40 service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:17.142365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-87ad49e5-5f15-42a3-81fa-567246fa9b40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:17.215356 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad49e5-5f15-42a3-81fa-567246fa9b40 service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:17.220634 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e099acd-666b-4bc3-9ddc-ab05d209a24e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a0a84e4c4e47fc930881109fc07039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:17.221265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e099acd-666b-4bc3-9ddc-ab05d209a24e service swift] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:17.221548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e099acd-666b-4bc3-9ddc-ab05d209a24e service swift] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:17.221823 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e099acd-666b-4bc3-9ddc-ab05d209a24e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:17.231074 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e099acd-666b-4bc3-9ddc-ab05d209a24e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:17.232857 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e099acd-666b-4bc3-9ddc-ab05d209a24e service swift] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:17.242164 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1133/2283] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 24 16:05:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:05:17.319198 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:17.500233 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ff7b0-3e51-4258-8609-9b161207dc57 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:17.501800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-788ff7b0-3e51-4258-8609-9b161207dc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:17.551227 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ff7b0-3e51-4258-8609-9b161207dc57 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:17.551227 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cc719-b2eb-43c8-9c9e-015949039113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:17.551227 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cc719-b2eb-43c8-9c9e-015949039113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:17.551227 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cc719-b2eb-43c8-9c9e-015949039113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:17.552805 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cc719-b2eb-43c8-9c9e-015949039113 admin admin] PATH_INFO: `/v3/projects/8a64d7c32f44475ba4082b77dd928733` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:17.552805 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92cc719-b2eb-43c8-9c9e-015949039113 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a64d7c32f44475ba4082b77dd928733)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:17.552805 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92cc719-b2eb-43c8-9c9e-015949039113 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:17.737368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f92cc719-b2eb-43c8-9c9e-015949039113 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a64d7c32f44475ba4082b77dd928733', 'request_id': 'req-f92cc719-b2eb-43c8-9c9e-015949039113'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:17.803514 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f92cc719-b2eb-43c8-9c9e-015949039113 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a64d7c32f44475ba4082b77dd928733', 'request_id': 'req-f92cc719-b2eb-43c8-9c9e-015949039113'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:17.811203 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f92cc719-b2eb-43c8-9c9e-015949039113 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a64d7c32f44475ba4082b77dd928733', 'request_id': 'req-f92cc719-b2eb-43c8-9c9e-015949039113'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:17.849693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f92cc719-b2eb-43c8-9c9e-015949039113 admin admin] The token cache is being invalidate because project 8a64d7c32f44475ba4082b77dd928733 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:05:17.849988 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f92cc719-b2eb-43c8-9c9e-015949039113 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:17.850665 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f92cc719-b2eb-43c8-9c9e-015949039113 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:17.852495 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1151/2284] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:05:17 2022] DELETE /identity/v3/projects/8a64d7c32f44475ba4082b77dd928733 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:05:17.856511 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e099acd-666b-4bc3-9ddc-ab05d209a24e service swift] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:17.873940 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e099acd-666b-4bc3-9ddc-ab05d209a24e service swift] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:17.976946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9db861-05fc-4f36-bfd3-7530ddda786a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:17.977620 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9db861-05fc-4f36-bfd3-7530ddda786a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:17.977945 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9db861-05fc-4f36-bfd3-7530ddda786a admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:17.978702 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9db861-05fc-4f36-bfd3-7530ddda786a admin admin] PATH_INFO: `/v3/users/92611425adc843ac97ed5d5d4cc8e7b5` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:17.981376 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9db861-05fc-4f36-bfd3-7530ddda786a admin admin] RBAC: Authorizing `identity:delete_user(user_id=92611425adc843ac97ed5d5d4cc8e7b5)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:17.992899 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9db861-05fc-4f36-bfd3-7530ddda786a admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:18.359181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-3e9db861-05fc-4f36-bfd3-7530ddda786a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92611425adc843ac97ed5d5d4cc8e7b5'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:18.365561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-3e9db861-05fc-4f36-bfd3-7530ddda786a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92611425adc843ac97ed5d5d4cc8e7b5'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:18.379389 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-3e9db861-05fc-4f36-bfd3-7530ddda786a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92611425adc843ac97ed5d5d4cc8e7b5'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:18.462318 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-3e9db861-05fc-4f36-bfd3-7530ddda786a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92611425adc843ac97ed5d5d4cc8e7b5'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:18.471273 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-3e9db861-05fc-4f36-bfd3-7530ddda786a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92611425adc843ac97ed5d5d4cc8e7b5'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:18.477626 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:18.497360 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1134/2285] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:05:17 2022] DELETE /identity/v3/users/92611425adc843ac97ed5d5d4cc8e7b5 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:05:19.227152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cc719-b2eb-43c8-9c9e-015949039113 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:19.229508 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-f92cc719-b2eb-43c8-9c9e-015949039113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:19.284142 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cc719-b2eb-43c8-9c9e-015949039113 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:19.321263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:19.371824 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89c721-91b0-4054-b1ef-d2500b3b9602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:19.372667 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89c721-91b0-4054-b1ef-d2500b3b9602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:19.373021 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89c721-91b0-4054-b1ef-d2500b3b9602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:19.373373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89c721-91b0-4054-b1ef-d2500b3b9602 admin admin] PATH_INFO: `/v3/projects/256ee4951e15450a8c32f4f1753bfc57` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:19.374886 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89c721-91b0-4054-b1ef-d2500b3b9602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=256ee4951e15450a8c32f4f1753bfc57)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:19.384220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89c721-91b0-4054-b1ef-d2500b3b9602 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:19.542862 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-db89c721-91b0-4054-b1ef-d2500b3b9602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '256ee4951e15450a8c32f4f1753bfc57', 'request_id': 'req-db89c721-91b0-4054-b1ef-d2500b3b9602'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:19.616203 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-db89c721-91b0-4054-b1ef-d2500b3b9602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '256ee4951e15450a8c32f4f1753bfc57', 'request_id': 'req-db89c721-91b0-4054-b1ef-d2500b3b9602'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:19.635517 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-db89c721-91b0-4054-b1ef-d2500b3b9602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '256ee4951e15450a8c32f4f1753bfc57', 'request_id': 'req-db89c721-91b0-4054-b1ef-d2500b3b9602'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:19.669848 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-db89c721-91b0-4054-b1ef-d2500b3b9602 admin admin] The token cache is being invalidate because project 256ee4951e15450a8c32f4f1753bfc57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:05:19.671042 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-db89c721-91b0-4054-b1ef-d2500b3b9602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:19.673281 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-db89c721-91b0-4054-b1ef-d2500b3b9602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:19.681006 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1152/2286] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:05:19 2022] DELETE /identity/v3/projects/256ee4951e15450a8c32f4f1753bfc57 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:05:19.682388 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15ebf2-798e-4f4f-a63b-a29811f709fc None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:19.683209 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15ebf2-798e-4f4f-a63b-a29811f709fc None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:19.683662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15ebf2-798e-4f4f-a63b-a29811f709fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:19.716791 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-cf15ebf2-798e-4f4f-a63b-a29811f709fc None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:05:19.718557 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-cf15ebf2-798e-4f4f-a63b-a29811f709fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:19.857853 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1135/2287] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:05:19.866233 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99affd76-a73b-4913-96f9-fdfcab405048 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:19.866567 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99affd76-a73b-4913-96f9-fdfcab405048 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:19.866798 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99affd76-a73b-4913-96f9-fdfcab405048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:19.889772 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-99affd76-a73b-4913-96f9-fdfcab405048 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:05:19.891002 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-99affd76-a73b-4913-96f9-fdfcab405048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:19.906611 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15ebf2-798e-4f4f-a63b-a29811f709fc None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:19.913782 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1153/2288] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:05:19.923804 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15ebf2-798e-4f4f-a63b-a29811f709fc None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:19.930443 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b6e18-351b-499c-b424-cd9fc59a7f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:19.931383 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b6e18-351b-499c-b424-cd9fc59a7f92 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:19.931987 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b6e18-351b-499c-b424-cd9fc59a7f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:19.932450 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b6e18-351b-499c-b424-cd9fc59a7f92 admin admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:19.933323 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b6e18-351b-499c-b424-cd9fc59a7f92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:05:19.933838 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b6e18-351b-499c-b424-cd9fc59a7f92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:19.936337 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b6e18-351b-499c-b424-cd9fc59a7f92 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:19.962524 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1136/2289] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:05:19.963798 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99affd76-a73b-4913-96f9-fdfcab405048 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:19.977507 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99affd76-a73b-4913-96f9-fdfcab405048 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:19.991521 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94225f-e6b0-47c0-8b4a-d84e5f63fc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:19.992159 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94225f-e6b0-47c0-8b4a-d84e5f63fc87 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:19.992423 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94225f-e6b0-47c0-8b4a-d84e5f63fc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:19.996135 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94225f-e6b0-47c0-8b4a-d84e5f63fc87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:19.996872 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af94225f-e6b0-47c0-8b4a-d84e5f63fc87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:20.000054 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af94225f-e6b0-47c0-8b4a-d84e5f63fc87 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:20.206078 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b6e18-351b-499c-b424-cd9fc59a7f92 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:20.207353 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1154/2290] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:05:19 2022] POST /identity/v3/projects => generated 357 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:05:20.222301 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b6e18-351b-499c-b424-cd9fc59a7f92 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:20.381074 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49ce20-6ef8-48fb-a727-594a53f785a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:20.381793 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49ce20-6ef8-48fb-a727-594a53f785a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:20.381978 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49ce20-6ef8-48fb-a727-594a53f785a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:20.382252 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49ce20-6ef8-48fb-a727-594a53f785a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:20.383150 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac49ce20-6ef8-48fb-a727-594a53f785a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:20.385154 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac49ce20-6ef8-48fb-a727-594a53f785a7 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:20.550426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1137/2291] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:05:20 2022] POST /identity/v3/users => generated 279 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:05:20.555440 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94225f-e6b0-47c0-8b4a-d84e5f63fc87 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:20.584345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94225f-e6b0-47c0-8b4a-d84e5f63fc87 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:20.590122 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a2658-c25c-47ed-bb36-083ebda4a6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:20.591393 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a2658-c25c-47ed-bb36-083ebda4a6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:20.591393 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a2658-c25c-47ed-bb36-083ebda4a6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:20.591393 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a2658-c25c-47ed-bb36-083ebda4a6e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:20.591906 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a2658-c25c-47ed-bb36-083ebda4a6e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:20.593541 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a2658-c25c-47ed-bb36-083ebda4a6e1 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:20.606969 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1155/2292] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:05:20.612022 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49ce20-6ef8-48fb-a727-594a53f785a7 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:20.629148 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49ce20-6ef8-48fb-a727-594a53f785a7 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:20.634791 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50021708-ef0d-4b47-b911-b6271dd90d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:20.635414 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50021708-ef0d-4b47-b911-b6271dd90d79 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:20.635699 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50021708-ef0d-4b47-b911-b6271dd90d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:20.635980 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50021708-ef0d-4b47-b911-b6271dd90d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:20.637198 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50021708-ef0d-4b47-b911-b6271dd90d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:20.638891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50021708-ef0d-4b47-b911-b6271dd90d79 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:20.657133 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1138/2293] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:05:20.660147 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a2658-c25c-47ed-bb36-083ebda4a6e1 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:20.680894 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a2658-c25c-47ed-bb36-083ebda4a6e1 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:20.695657 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820437f7-6b56-47b7-ad3c-0a4e14e47846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:20.696970 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820437f7-6b56-47b7-ad3c-0a4e14e47846 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:20.697293 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820437f7-6b56-47b7-ad3c-0a4e14e47846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:20.697573 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820437f7-6b56-47b7-ad3c-0a4e14e47846 admin admin] PATH_INFO: `/v3/projects/d44c3d68a3d44caa915ba74bf565aa04/users/d3563c40e4814f148a18e6a5b693d88f/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:20.720864 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820437f7-6b56-47b7-ad3c-0a4e14e47846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d44c3d68a3d44caa915ba74bf565aa04, user_id=d3563c40e4814f148a18e6a5b693d88f, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:20.724694 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820437f7-6b56-47b7-ad3c-0a4e14e47846 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:20.845210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1156/2294] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:05:20 2022] PUT /identity/v3/projects/d44c3d68a3d44caa915ba74bf565aa04/users/d3563c40e4814f148a18e6a5b693d88f/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:05:20.856517 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48d199-32e0-4c2c-afc2-d32830346737 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:20.857098 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48d199-32e0-4c2c-afc2-d32830346737 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:20.857098 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48d199-32e0-4c2c-afc2-d32830346737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:20.889884 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-5b48d199-32e0-4c2c-afc2-d32830346737 None None] MFA Rules not processed for user `d3563c40e4814f148a18e6a5b693d88f`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:05:20.891156 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-5b48d199-32e0-4c2c-afc2-d32830346737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:20.949995 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:20.995407 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1139/2295] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:05:20 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:05:20.999951 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820437f7-6b56-47b7-ad3c-0a4e14e47846 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:21.132582 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:21.158350 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820437f7-6b56-47b7-ad3c-0a4e14e47846 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:21.177475 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b15ce-89dd-4fc4-ba6a-fbc364b9d769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:21.178119 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b15ce-89dd-4fc4-ba6a-fbc364b9d769 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:21.178403 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b15ce-89dd-4fc4-ba6a-fbc364b9d769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:21.178678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b15ce-89dd-4fc4-ba6a-fbc364b9d769 admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:21.179340 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b15ce-89dd-4fc4-ba6a-fbc364b9d769 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:21.181328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b15ce-89dd-4fc4-ba6a-fbc364b9d769 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:21.611559 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0004a0-5d51-4e89-93e8-39a748efd402 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:21.614648 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0004a0-5d51-4e89-93e8-39a748efd402 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:21.614648 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0004a0-5d51-4e89-93e8-39a748efd402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:21.623132 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1157/2296] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:05:20 2022] POST /identity/v3/projects => generated 357 bytes in 626 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:05:21.628330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b15ce-89dd-4fc4-ba6a-fbc364b9d769 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:21.642588 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-dc0004a0-5d51-4e89-93e8-39a748efd402 None None] MFA Rules not processed for user `eaf3821dd57a4d8f9ca6385c202bb0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:05:21.643398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-dc0004a0-5d51-4e89-93e8-39a748efd402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:21.726847 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1140/2297] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 24 16:05:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:05:21.741552 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0004a0-5d51-4e89-93e8-39a748efd402 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:21.745315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-dc0004a0-5d51-4e89-93e8-39a748efd402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:21.771223 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b15ce-89dd-4fc4-ba6a-fbc364b9d769 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:21.784509 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf40acc-f768-418c-9838-55be0f90ea0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:21.786375 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf40acc-f768-418c-9838-55be0f90ea0c admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:21.786680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf40acc-f768-418c-9838-55be0f90ea0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:21.786955 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf40acc-f768-418c-9838-55be0f90ea0c admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:21.787596 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf40acc-f768-418c-9838-55be0f90ea0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:21.793072 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf40acc-f768-418c-9838-55be0f90ea0c admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:21.894446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0004a0-5d51-4e89-93e8-39a748efd402 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:21.905038 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fd8e6-05ba-4508-9b08-a29ce6761d21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a0a84e4c4e47fc930881109fc07039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:21.905855 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fd8e6-05ba-4508-9b08-a29ce6761d21 service swift] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:21.905980 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fd8e6-05ba-4508-9b08-a29ce6761d21 service swift] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:21.908705 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fd8e6-05ba-4508-9b08-a29ce6761d21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:21.920883 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1fd8e6-05ba-4508-9b08-a29ce6761d21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:21.922747 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1fd8e6-05ba-4508-9b08-a29ce6761d21 service swift] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:21.940006 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1141/2298] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 24 16:05:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:05:21.942372 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c9f88-0aef-4fc4-98fb-757f155f61b2 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:21.942658 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c9f88-0aef-4fc4-98fb-757f155f61b2 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:21.942929 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c9f88-0aef-4fc4-98fb-757f155f61b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:21.959917 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1158/2299] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:05:21 2022] POST /identity/v3/users => generated 285 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:05:21.964669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf40acc-f768-418c-9838-55be0f90ea0c admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:21.975097 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-e77c9f88-0aef-4fc4-98fb-757f155f61b2 None None] MFA Rules not processed for user `c640f4b512f748669f75f297f5bf8df9`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:05:21.976665 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e77c9f88-0aef-4fc4-98fb-757f155f61b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:21.978644 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf40acc-f768-418c-9838-55be0f90ea0c admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:22.007032 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c80a96-84e9-40d2-bdc9-bcd835f65223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:22.011061 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c80a96-84e9-40d2-bdc9-bcd835f65223 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:22.019474 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c80a96-84e9-40d2-bdc9-bcd835f65223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:22.019474 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c80a96-84e9-40d2-bdc9-bcd835f65223 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:22.019474 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c80a96-84e9-40d2-bdc9-bcd835f65223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:22.019474 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c80a96-84e9-40d2-bdc9-bcd835f65223 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:22.051583 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1159/2300] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:05:22.055068 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c80a96-84e9-40d2-bdc9-bcd835f65223 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:22.076954 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c80a96-84e9-40d2-bdc9-bcd835f65223 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:22.100942 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84645485-ac42-48a7-808f-d8123e48dc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:22.101851 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84645485-ac42-48a7-808f-d8123e48dc34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:22.102475 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84645485-ac42-48a7-808f-d8123e48dc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:22.104305 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84645485-ac42-48a7-808f-d8123e48dc34 admin admin] PATH_INFO: `/v3/projects/c9d4af144a1e493f9fbead12ffa761ce/users/1646447709cf484fb96811cc7ef2cb31/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:22.153670 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84645485-ac42-48a7-808f-d8123e48dc34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d4af144a1e493f9fbead12ffa761ce, user_id=1646447709cf484fb96811cc7ef2cb31, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:22.156921 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84645485-ac42-48a7-808f-d8123e48dc34 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:22.168878 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1142/2301] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:05:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:05:22.300026 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1160/2302] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:05:22 2022] PUT /identity/v3/projects/c9d4af144a1e493f9fbead12ffa761ce/users/1646447709cf484fb96811cc7ef2cb31/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:05:22.306264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c9f88-0aef-4fc4-98fb-757f155f61b2 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:22.341513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c9f88-0aef-4fc4-98fb-757f155f61b2 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:22.398480 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:22.498199 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33be381-74c1-4725-b0a8-0659f2abc75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:22.499130 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33be381-74c1-4725-b0a8-0659f2abc75e admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:22.499486 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33be381-74c1-4725-b0a8-0659f2abc75e admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:22.499839 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33be381-74c1-4725-b0a8-0659f2abc75e admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:22.500650 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33be381-74c1-4725-b0a8-0659f2abc75e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:22.502356 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33be381-74c1-4725-b0a8-0659f2abc75e admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:22.528149 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84645485-ac42-48a7-808f-d8123e48dc34 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:22.533520 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1143/2303] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:05:22.547083 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84645485-ac42-48a7-808f-d8123e48dc34 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:22.565061 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666386ce-67fe-4c98-9d63-eee45d51f886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:22.565772 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666386ce-67fe-4c98-9d63-eee45d51f886 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:22.567246 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666386ce-67fe-4c98-9d63-eee45d51f886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:22.569174 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666386ce-67fe-4c98-9d63-eee45d51f886 admin admin] PATH_INFO: `/v3/projects/c9d4af144a1e493f9fbead12ffa761ce/users/1646447709cf484fb96811cc7ef2cb31/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:22.579058 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666386ce-67fe-4c98-9d63-eee45d51f886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d4af144a1e493f9fbead12ffa761ce, user_id=1646447709cf484fb96811cc7ef2cb31, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:22.585111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666386ce-67fe-4c98-9d63-eee45d51f886 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:22.625024 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1161/2304] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:05:22 2022] PUT /identity/v3/projects/c9d4af144a1e493f9fbead12ffa761ce/users/1646447709cf484fb96811cc7ef2cb31/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:05:22.636421 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cc0d7-da95-4522-a140-d000f89e3c9f None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:22.636886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cc0d7-da95-4522-a140-d000f89e3c9f None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:22.637032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cc0d7-da95-4522-a140-d000f89e3c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:22.703620 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-066cc0d7-da95-4522-a140-d000f89e3c9f None None] MFA Rules not processed for user `1646447709cf484fb96811cc7ef2cb31`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:05:22.705113 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-066cc0d7-da95-4522-a140-d000f89e3c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:22.897667 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1144/2305] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:05:22 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:05:22.911151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666386ce-67fe-4c98-9d63-eee45d51f886 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:22.913615 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-666386ce-67fe-4c98-9d63-eee45d51f886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:22.998215 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666386ce-67fe-4c98-9d63-eee45d51f886 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:23.010142 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812a867-791d-419c-828a-1c3e192225a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:23.011366 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812a867-791d-419c-828a-1c3e192225a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:23.011766 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812a867-791d-419c-828a-1c3e192225a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:23.012125 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812a867-791d-419c-828a-1c3e192225a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:23.031005 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812a867-791d-419c-828a-1c3e192225a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:23.035452 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812a867-791d-419c-828a-1c3e192225a8 service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:23.064867 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1162/2306] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:05:22 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:05:23.324722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066cc0d7-da95-4522-a140-d000f89e3c9f None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:23.338988 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066cc0d7-da95-4522-a140-d000f89e3c9f None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:23.343727 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c6ab4-6d1d-400f-a3b0-bfb68e71b9fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:23.344436 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c6ab4-6d1d-400f-a3b0-bfb68e71b9fd service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:23.344876 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c6ab4-6d1d-400f-a3b0-bfb68e71b9fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:23.345360 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c6ab4-6d1d-400f-a3b0-bfb68e71b9fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:23.494336 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c6ab4-6d1d-400f-a3b0-bfb68e71b9fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:23.500410 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c6ab4-6d1d-400f-a3b0-bfb68e71b9fd service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:23.528556 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1145/2307] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:05:23 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:05:28.770201 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812a867-791d-419c-828a-1c3e192225a8 service cinder] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:28.771978 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-1812a867-791d-419c-828a-1c3e192225a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:28.808754 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:28.913921 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812a867-791d-419c-828a-1c3e192225a8 service cinder] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:28.929560 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a2742-e2b7-4f36-84b9-a9a19a3cb713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:28.930443 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a2742-e2b7-4f36-84b9-a9a19a3cb713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:28.930690 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a2742-e2b7-4f36-84b9-a9a19a3cb713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:28.931179 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a2742-e2b7-4f36-84b9-a9a19a3cb713 admin admin] PATH_INFO: `/v3/users/eddd25e92b304a509f29e1bc5a422874` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:28.932131 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a2742-e2b7-4f36-84b9-a9a19a3cb713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eddd25e92b304a509f29e1bc5a422874)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:28.934175 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a2742-e2b7-4f36-84b9-a9a19a3cb713 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:29.262688 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-bc5a2742-e2b7-4f36-84b9-a9a19a3cb713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eddd25e92b304a509f29e1bc5a422874'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:29.263373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-bc5a2742-e2b7-4f36-84b9-a9a19a3cb713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eddd25e92b304a509f29e1bc5a422874'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:29.263987 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-bc5a2742-e2b7-4f36-84b9-a9a19a3cb713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eddd25e92b304a509f29e1bc5a422874'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:29.281541 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-bc5a2742-e2b7-4f36-84b9-a9a19a3cb713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eddd25e92b304a509f29e1bc5a422874'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:29.331997 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-bc5a2742-e2b7-4f36-84b9-a9a19a3cb713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eddd25e92b304a509f29e1bc5a422874'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:29.346331 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1163/2308] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:05:28 2022] DELETE /identity/v3/users/eddd25e92b304a509f29e1bc5a422874 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:05:29.351601 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba1eeb-cdff-4583-8de2-daea3c70d04e None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:29.352190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba1eeb-cdff-4583-8de2-daea3c70d04e None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:29.352292 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba1eeb-cdff-4583-8de2-daea3c70d04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:29.375691 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-67ba1eeb-cdff-4583-8de2-daea3c70d04e None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:05:29.376965 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-67ba1eeb-cdff-4583-8de2-daea3c70d04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:29.437057 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:29.466105 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1146/2309] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:05:29.478261 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a2742-e2b7-4f36-84b9-a9a19a3cb713 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:29.480178 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-bc5a2742-e2b7-4f36-84b9-a9a19a3cb713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:29.555874 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a2742-e2b7-4f36-84b9-a9a19a3cb713 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:29.564857 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be471f-894f-4ccc-b5c4-87c3ab197205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:29.576788 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be471f-894f-4ccc-b5c4-87c3ab197205 service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:29.576788 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be471f-894f-4ccc-b5c4-87c3ab197205 service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:29.576788 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be471f-894f-4ccc-b5c4-87c3ab197205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:29.587882 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be471f-894f-4ccc-b5c4-87c3ab197205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:29.589534 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be471f-894f-4ccc-b5c4-87c3ab197205 service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:29.605912 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1164/2310] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:05:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:05:30.469405 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba1eeb-cdff-4583-8de2-daea3c70d04e None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:30.470849 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-67ba1eeb-cdff-4583-8de2-daea3c70d04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:30.504297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba1eeb-cdff-4583-8de2-daea3c70d04e None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:30.529997 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f0aa3-b610-4452-80a4-bf45e10a0d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:30.530663 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f0aa3-b610-4452-80a4-bf45e10a0d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:30.530937 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f0aa3-b610-4452-80a4-bf45e10a0d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:30.531349 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f0aa3-b610-4452-80a4-bf45e10a0d4b admin admin] PATH_INFO: `/v3/projects/b0296b51a2d644719b1c3bb4ce896ca1` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:30.532603 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f0aa3-b610-4452-80a4-bf45e10a0d4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0296b51a2d644719b1c3bb4ce896ca1)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:30.537195 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f0aa3-b610-4452-80a4-bf45e10a0d4b admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:30.718004 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-942f0aa3-b610-4452-80a4-bf45e10a0d4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0296b51a2d644719b1c3bb4ce896ca1', 'request_id': 'req-942f0aa3-b610-4452-80a4-bf45e10a0d4b'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:30.726315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-942f0aa3-b610-4452-80a4-bf45e10a0d4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0296b51a2d644719b1c3bb4ce896ca1', 'request_id': 'req-942f0aa3-b610-4452-80a4-bf45e10a0d4b'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:30.734833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-942f0aa3-b610-4452-80a4-bf45e10a0d4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0296b51a2d644719b1c3bb4ce896ca1', 'request_id': 'req-942f0aa3-b610-4452-80a4-bf45e10a0d4b'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:30.922612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-942f0aa3-b610-4452-80a4-bf45e10a0d4b admin admin] The token cache is being invalidate because project b0296b51a2d644719b1c3bb4ce896ca1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:05:30.922907 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-942f0aa3-b610-4452-80a4-bf45e10a0d4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:30.923560 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-942f0aa3-b610-4452-80a4-bf45e10a0d4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:30.925352 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1147/2311] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:05:30 2022] DELETE /identity/v3/projects/b0296b51a2d644719b1c3bb4ce896ca1 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:05:31.505095 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844e1b0-aef1-454d-a953-6df441fd0794 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:31.505095 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844e1b0-aef1-454d-a953-6df441fd0794 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:31.505095 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844e1b0-aef1-454d-a953-6df441fd0794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:31.534120 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-6844e1b0-aef1-454d-a953-6df441fd0794 None None] MFA Rules not processed for user `069ca20cb895423f9fba63dd63c1cf3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:05:31.537691 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-6844e1b0-aef1-454d-a953-6df441fd0794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:31.608604 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:31.645744 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1165/2312] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:05:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:05:37.120249 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507ac1f-8e4b-4b55-b0b7-47a61aef9d35 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:37.122022 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507ac1f-8e4b-4b55-b0b7-47a61aef9d35 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:37.122453 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507ac1f-8e4b-4b55-b0b7-47a61aef9d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:37.174446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-d507ac1f-8e4b-4b55-b0b7-47a61aef9d35 None None] MFA Rules not processed for user `eaf3821dd57a4d8f9ca6385c202bb0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:05:37.176855 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-d507ac1f-8e4b-4b55-b0b7-47a61aef9d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:37.352002 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1148/2313] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 24 16:05:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:05:37.368495 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844e1b0-aef1-454d-a953-6df441fd0794 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:37.370700 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-6844e1b0-aef1-454d-a953-6df441fd0794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:37.524159 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844e1b0-aef1-454d-a953-6df441fd0794 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:37.539103 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b7eb3-5c2d-410c-bbdc-5577ae537c53 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a0a84e4c4e47fc930881109fc07039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:37.540459 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b7eb3-5c2d-410c-bbdc-5577ae537c53 service swift] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:37.540820 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b7eb3-5c2d-410c-bbdc-5577ae537c53 service swift] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:37.541129 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b7eb3-5c2d-410c-bbdc-5577ae537c53 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:37.574755 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b7eb3-5c2d-410c-bbdc-5577ae537c53 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:37.576412 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b7eb3-5c2d-410c-bbdc-5577ae537c53 service swift] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:37.586515 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1166/2314] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 24 16:05:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:05:43.117285 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9531a7-6dc6-42ee-8d18-aeb720927c91 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:43.118175 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9531a7-6dc6-42ee-8d18-aeb720927c91 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:43.118605 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9531a7-6dc6-42ee-8d18-aeb720927c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:43.145577 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-7e9531a7-6dc6-42ee-8d18-aeb720927c91 None None] MFA Rules not processed for user `eaf3821dd57a4d8f9ca6385c202bb0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:05:43.148732 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-7e9531a7-6dc6-42ee-8d18-aeb720927c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:43.166965 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1149/2315] 10.222.0.64 () {58 vars in 967 bytes} [Wed Aug 24 16:05:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:05:43.175788 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b7eb3-5c2d-410c-bbdc-5577ae537c53 service swift] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:43.192049 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b7eb3-5c2d-410c-bbdc-5577ae537c53 service swift] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:43.204561 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376db456-7629-4380-85ad-fdda1d807a34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a0a84e4c4e47fc930881109fc07039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:43.207121 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376db456-7629-4380-85ad-fdda1d807a34 service swift] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:43.207409 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376db456-7629-4380-85ad-fdda1d807a34 service swift] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:43.207690 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376db456-7629-4380-85ad-fdda1d807a34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:43.235667 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376db456-7629-4380-85ad-fdda1d807a34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:43.237881 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376db456-7629-4380-85ad-fdda1d807a34 service swift] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:43.257539 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1167/2316] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 24 16:05:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:05:45.161257 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9531a7-6dc6-42ee-8d18-aeb720927c91 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:45.180482 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-7e9531a7-6dc6-42ee-8d18-aeb720927c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:45.260807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9531a7-6dc6-42ee-8d18-aeb720927c91 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:45.265928 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4e4e1-c0c4-45e2-8861-6c8893097bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:45.266574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4e4e1-c0c4-45e2-8861-6c8893097bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:45.266906 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4e4e1-c0c4-45e2-8861-6c8893097bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:45.267360 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4e4e1-c0c4-45e2-8861-6c8893097bc2 admin admin] PATH_INFO: `/v3/users/d3563c40e4814f148a18e6a5b693d88f` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:45.268736 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df4e4e1-c0c4-45e2-8861-6c8893097bc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3563c40e4814f148a18e6a5b693d88f)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:45.271141 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df4e4e1-c0c4-45e2-8861-6c8893097bc2 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:45.275930 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:45.498288 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-9df4e4e1-c0c4-45e2-8861-6c8893097bc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3563c40e4814f148a18e6a5b693d88f'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:45.498952 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-9df4e4e1-c0c4-45e2-8861-6c8893097bc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3563c40e4814f148a18e6a5b693d88f'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:45.499606 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-9df4e4e1-c0c4-45e2-8861-6c8893097bc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3563c40e4814f148a18e6a5b693d88f'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:45.568926 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-9df4e4e1-c0c4-45e2-8861-6c8893097bc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3563c40e4814f148a18e6a5b693d88f'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:45.585240 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-9df4e4e1-c0c4-45e2-8861-6c8893097bc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3563c40e4814f148a18e6a5b693d88f'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:45.612976 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1150/2317] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:05:45 2022] DELETE /identity/v3/users/d3563c40e4814f148a18e6a5b693d88f => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:05:45.617783 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8908d4-c268-47f3-8c99-55a656b156fe None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:45.618722 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8908d4-c268-47f3-8c99-55a656b156fe None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:45.619205 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8908d4-c268-47f3-8c99-55a656b156fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:45.642943 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-1b8908d4-c268-47f3-8c99-55a656b156fe None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:05:45.644564 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-1b8908d4-c268-47f3-8c99-55a656b156fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:45.735745 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1168/2318] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:05:45.747427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4e4e1-c0c4-45e2-8861-6c8893097bc2 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:45.749401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-9df4e4e1-c0c4-45e2-8861-6c8893097bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:45.839328 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4e4e1-c0c4-45e2-8861-6c8893097bc2 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:45.843118 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120816d0-c3a0-4428-91dc-c92317293bb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:45.843787 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120816d0-c3a0-4428-91dc-c92317293bb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:45.844070 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120816d0-c3a0-4428-91dc-c92317293bb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:45.844340 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120816d0-c3a0-4428-91dc-c92317293bb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:45.854991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120816d0-c3a0-4428-91dc-c92317293bb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:45.858446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120816d0-c3a0-4428-91dc-c92317293bb2 service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:45.867541 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1151/2319] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:05:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:05:46.314414 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8908d4-c268-47f3-8c99-55a656b156fe None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:46.316239 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-1b8908d4-c268-47f3-8c99-55a656b156fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:46.357993 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8908d4-c268-47f3-8c99-55a656b156fe None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:46.364865 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7a0ba-c188-4080-a726-5f9e61ad9a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:46.367191 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7a0ba-c188-4080-a726-5f9e61ad9a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:46.367649 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7a0ba-c188-4080-a726-5f9e61ad9a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:46.368092 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7a0ba-c188-4080-a726-5f9e61ad9a70 admin admin] PATH_INFO: `/v3/projects/d44c3d68a3d44caa915ba74bf565aa04` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:46.370142 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7a0ba-c188-4080-a726-5f9e61ad9a70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d44c3d68a3d44caa915ba74bf565aa04)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:46.372681 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7a0ba-c188-4080-a726-5f9e61ad9a70 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:46.492595 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-2de7a0ba-c188-4080-a726-5f9e61ad9a70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd44c3d68a3d44caa915ba74bf565aa04', 'request_id': 'req-2de7a0ba-c188-4080-a726-5f9e61ad9a70'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:46.580793 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-2de7a0ba-c188-4080-a726-5f9e61ad9a70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd44c3d68a3d44caa915ba74bf565aa04', 'request_id': 'req-2de7a0ba-c188-4080-a726-5f9e61ad9a70'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:46.582480 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:46.589773 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-2de7a0ba-c188-4080-a726-5f9e61ad9a70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd44c3d68a3d44caa915ba74bf565aa04', 'request_id': 'req-2de7a0ba-c188-4080-a726-5f9e61ad9a70'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:46.600467 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-2de7a0ba-c188-4080-a726-5f9e61ad9a70 admin admin] The token cache is being invalidate because project d44c3d68a3d44caa915ba74bf565aa04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:05:46.600850 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-2de7a0ba-c188-4080-a726-5f9e61ad9a70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:46.602312 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-2de7a0ba-c188-4080-a726-5f9e61ad9a70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:46.604669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1169/2320] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:05:46 2022] DELETE /identity/v3/projects/d44c3d68a3d44caa915ba74bf565aa04 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:05:46.608487 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120816d0-c3a0-4428-91dc-c92317293bb2 service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:46.619822 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120816d0-c3a0-4428-91dc-c92317293bb2 service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:46.681908 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7755195-c25e-4c03-b8ec-05a93713135f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:46.682659 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7755195-c25e-4c03-b8ec-05a93713135f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:46.683004 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7755195-c25e-4c03-b8ec-05a93713135f admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:46.683371 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7755195-c25e-4c03-b8ec-05a93713135f admin admin] PATH_INFO: `/v3/users/1646447709cf484fb96811cc7ef2cb31` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:46.684564 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7755195-c25e-4c03-b8ec-05a93713135f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1646447709cf484fb96811cc7ef2cb31)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:46.686593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7755195-c25e-4c03-b8ec-05a93713135f admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:46.787177 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:46.893987 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a7755195-c25e-4c03-b8ec-05a93713135f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1646447709cf484fb96811cc7ef2cb31'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:46.894884 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a7755195-c25e-4c03-b8ec-05a93713135f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1646447709cf484fb96811cc7ef2cb31'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:46.895695 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a7755195-c25e-4c03-b8ec-05a93713135f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1646447709cf484fb96811cc7ef2cb31'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:47.009286 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a7755195-c25e-4c03-b8ec-05a93713135f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1646447709cf484fb96811cc7ef2cb31'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:47.018926 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a7755195-c25e-4c03-b8ec-05a93713135f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1646447709cf484fb96811cc7ef2cb31'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:47.040695 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1152/2321] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:05:46 2022] DELETE /identity/v3/users/1646447709cf484fb96811cc7ef2cb31 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:05:47.154361 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7a0ba-c188-4080-a726-5f9e61ad9a70 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:47.163543 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-2de7a0ba-c188-4080-a726-5f9e61ad9a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:47.171359 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7a0ba-c188-4080-a726-5f9e61ad9a70 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:47.242554 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3b7be-6ad4-4cee-8564-df42a3944c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:47.243224 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3b7be-6ad4-4cee-8564-df42a3944c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:47.243532 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3b7be-6ad4-4cee-8564-df42a3944c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:47.243821 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3b7be-6ad4-4cee-8564-df42a3944c15 admin admin] PATH_INFO: `/v3/users/a555b35e0657498fa68fe32e3b0f21cf` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:47.245073 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3b7be-6ad4-4cee-8564-df42a3944c15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a555b35e0657498fa68fe32e3b0f21cf)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:47.247428 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3b7be-6ad4-4cee-8564-df42a3944c15 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:47.437386 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d2d3b7be-6ad4-4cee-8564-df42a3944c15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a555b35e0657498fa68fe32e3b0f21cf'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:47.438169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d2d3b7be-6ad4-4cee-8564-df42a3944c15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a555b35e0657498fa68fe32e3b0f21cf'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:47.438777 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d2d3b7be-6ad4-4cee-8564-df42a3944c15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a555b35e0657498fa68fe32e3b0f21cf'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:47.461998 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d2d3b7be-6ad4-4cee-8564-df42a3944c15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a555b35e0657498fa68fe32e3b0f21cf'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:47.535672 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d2d3b7be-6ad4-4cee-8564-df42a3944c15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a555b35e0657498fa68fe32e3b0f21cf'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:47.544796 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7755195-c25e-4c03-b8ec-05a93713135f admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:47.547136 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-a7755195-c25e-4c03-b8ec-05a93713135f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:47.559019 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1170/2322] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:05:47 2022] DELETE /identity/v3/users/a555b35e0657498fa68fe32e3b0f21cf => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:05:47.596345 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7755195-c25e-4c03-b8ec-05a93713135f admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:47.667677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e934c-f552-4015-99c0-23aee36e207d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:47.668651 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e934c-f552-4015-99c0-23aee36e207d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:47.669090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e934c-f552-4015-99c0-23aee36e207d admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:47.669378 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e934c-f552-4015-99c0-23aee36e207d admin admin] PATH_INFO: `/v3/projects/c9d4af144a1e493f9fbead12ffa761ce` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:47.670664 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e934c-f552-4015-99c0-23aee36e207d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9d4af144a1e493f9fbead12ffa761ce)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:47.672600 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e934c-f552-4015-99c0-23aee36e207d admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:47.821607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-250e934c-f552-4015-99c0-23aee36e207d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9d4af144a1e493f9fbead12ffa761ce', 'request_id': 'req-250e934c-f552-4015-99c0-23aee36e207d'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:47.827548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-250e934c-f552-4015-99c0-23aee36e207d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9d4af144a1e493f9fbead12ffa761ce', 'request_id': 'req-250e934c-f552-4015-99c0-23aee36e207d'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:47.834480 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-250e934c-f552-4015-99c0-23aee36e207d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9d4af144a1e493f9fbead12ffa761ce', 'request_id': 'req-250e934c-f552-4015-99c0-23aee36e207d'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:47.892315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3b7be-6ad4-4cee-8564-df42a3944c15 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:47.894404 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-d2d3b7be-6ad4-4cee-8564-df42a3944c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:47.913647 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3b7be-6ad4-4cee-8564-df42a3944c15 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:47.919671 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-250e934c-f552-4015-99c0-23aee36e207d admin admin] The token cache is being invalidate because project c9d4af144a1e493f9fbead12ffa761ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:05:47.920058 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-250e934c-f552-4015-99c0-23aee36e207d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:47.920699 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-250e934c-f552-4015-99c0-23aee36e207d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:47.922495 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1153/2323] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:05:47 2022] DELETE /identity/v3/projects/c9d4af144a1e493f9fbead12ffa761ce => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:05:47.927965 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0f629-b402-4b0e-a190-26c3af270ffe None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:47.928131 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0f629-b402-4b0e-a190-26c3af270ffe None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:47.928403 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0f629-b402-4b0e-a190-26c3af270ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:47.956638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-bad0f629-b402-4b0e-a190-26c3af270ffe None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:05:47.957916 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-bad0f629-b402-4b0e-a190-26c3af270ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:47.994147 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:47.997977 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0ccc4-257a-4213-a972-5e792e858b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:47.998624 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0ccc4-257a-4213-a972-5e792e858b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:47.998900 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0ccc4-257a-4213-a972-5e792e858b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:47.999175 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0ccc4-257a-4213-a972-5e792e858b98 admin admin] PATH_INFO: `/v3/projects/e82f3859d6f748c7a1433cee9dbe5f8c` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:48.000372 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0ccc4-257a-4213-a972-5e792e858b98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e82f3859d6f748c7a1433cee9dbe5f8c)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:48.002363 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0ccc4-257a-4213-a972-5e792e858b98 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:48.010886 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:48.039098 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1154/2324] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:05:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:05:48.052337 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af36632-b380-4436-bdd8-c15ccfedb785 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:48.052612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af36632-b380-4436-bdd8-c15ccfedb785 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:48.052944 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af36632-b380-4436-bdd8-c15ccfedb785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:48.074871 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-8af36632-b380-4436-bdd8-c15ccfedb785 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:05:48.076043 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-8af36632-b380-4436-bdd8-c15ccfedb785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:48.108968 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1155/2325] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:05:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:05:48.111280 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d6f0ccc4-257a-4213-a972-5e792e858b98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e82f3859d6f748c7a1433cee9dbe5f8c', 'request_id': 'req-d6f0ccc4-257a-4213-a972-5e792e858b98'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:48.113466 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af36632-b380-4436-bdd8-c15ccfedb785 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:48.123635 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af36632-b380-4436-bdd8-c15ccfedb785 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:48.192000 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d6f0ccc4-257a-4213-a972-5e792e858b98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e82f3859d6f748c7a1433cee9dbe5f8c', 'request_id': 'req-d6f0ccc4-257a-4213-a972-5e792e858b98'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:48.204154 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d6f0ccc4-257a-4213-a972-5e792e858b98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e82f3859d6f748c7a1433cee9dbe5f8c', 'request_id': 'req-d6f0ccc4-257a-4213-a972-5e792e858b98'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:48.221413 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d6f0ccc4-257a-4213-a972-5e792e858b98 admin admin] The token cache is being invalidate because project e82f3859d6f748c7a1433cee9dbe5f8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:05:48.221969 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d6f0ccc4-257a-4213-a972-5e792e858b98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:48.222840 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d6f0ccc4-257a-4213-a972-5e792e858b98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:48.225031 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1171/2326] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:05:47 2022] DELETE /identity/v3/projects/e82f3859d6f748c7a1433cee9dbe5f8c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:05:48.230992 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ef37e-d5fd-4cf5-aa76-6768d4d685fb None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:48.232147 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ef37e-d5fd-4cf5-aa76-6768d4d685fb None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:48.237192 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ef37e-d5fd-4cf5-aa76-6768d4d685fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:48.237918 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032f15c-8f9e-45a5-95a0-e8901a537496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:48.238627 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032f15c-8f9e-45a5-95a0-e8901a537496 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:48.238979 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032f15c-8f9e-45a5-95a0-e8901a537496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:48.239332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032f15c-8f9e-45a5-95a0-e8901a537496 admin admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:48.240298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1032f15c-8f9e-45a5-95a0-e8901a537496 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:05:48.240608 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1032f15c-8f9e-45a5-95a0-e8901a537496 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:48.245878 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1032f15c-8f9e-45a5-95a0-e8901a537496 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:48.260953 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1156/2327] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:05:48.263162 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-d95ef37e-d5fd-4cf5-aa76-6768d4d685fb None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:05:48.268072 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-d95ef37e-d5fd-4cf5-aa76-6768d4d685fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:48.268221 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032f15c-8f9e-45a5-95a0-e8901a537496 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:48.270213 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-1032f15c-8f9e-45a5-95a0-e8901a537496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:48.275311 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1172/2328] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:05:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:05:48.283508 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f6d3e-0870-4cfd-a58c-50b045f71ae8 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:48.284144 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f6d3e-0870-4cfd-a58c-50b045f71ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:48.287311 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f6d3e-0870-4cfd-a58c-50b045f71ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:48.293193 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032f15c-8f9e-45a5-95a0-e8901a537496 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:48.299150 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a277d-b247-438d-9ae4-534ee1fa31ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:48.299801 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a277d-b247-438d-9ae4-534ee1fa31ba admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:48.300447 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a277d-b247-438d-9ae4-534ee1fa31ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:48.300777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a277d-b247-438d-9ae4-534ee1fa31ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:48.301581 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a277d-b247-438d-9ae4-534ee1fa31ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:48.306092 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a277d-b247-438d-9ae4-534ee1fa31ba admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:48.328463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-5b4f6d3e-0870-4cfd-a58c-50b045f71ae8 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:05:48.330188 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-5b4f6d3e-0870-4cfd-a58c-50b045f71ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:48.342692 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1173/2329] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:05:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:05:48.347570 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f6d3e-0870-4cfd-a58c-50b045f71ae8 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:48.365194 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f6d3e-0870-4cfd-a58c-50b045f71ae8 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:48.384590 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6040e-3491-4c13-b111-fc6f2929ebc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:48.388907 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6040e-3491-4c13-b111-fc6f2929ebc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:48.389349 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6040e-3491-4c13-b111-fc6f2929ebc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:48.389798 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6040e-3491-4c13-b111-fc6f2929ebc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:48.390699 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6040e-3491-4c13-b111-fc6f2929ebc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:05:48.391284 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6040e-3491-4c13-b111-fc6f2929ebc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:48.393159 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6040e-3491-4c13-b111-fc6f2929ebc1 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:48.411607 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1174/2330] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:05:48.415883 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6040e-3491-4c13-b111-fc6f2929ebc1 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:48.427573 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6040e-3491-4c13-b111-fc6f2929ebc1 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:48.435650 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c6aa1-5197-42e4-8e68-4880001dd810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:48.442670 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c6aa1-5197-42e4-8e68-4880001dd810 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:48.442670 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c6aa1-5197-42e4-8e68-4880001dd810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:48.442670 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c6aa1-5197-42e4-8e68-4880001dd810 admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:48.442670 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c6aa1-5197-42e4-8e68-4880001dd810 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:48.442670 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c6aa1-5197-42e4-8e68-4880001dd810 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:48.443109 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1157/2331] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:05:48 2022] POST /identity/v3/projects => generated 399 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:05:48.443666 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a277d-b247-438d-9ae4-534ee1fa31ba admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:48.516317 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a277d-b247-438d-9ae4-534ee1fa31ba admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:48.521231 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb13147-6dfa-43bd-882b-08775fb68eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:48.521839 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb13147-6dfa-43bd-882b-08775fb68eac admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:48.522116 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb13147-6dfa-43bd-882b-08775fb68eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:48.522384 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb13147-6dfa-43bd-882b-08775fb68eac admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:48.523067 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb13147-6dfa-43bd-882b-08775fb68eac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:48.525532 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb13147-6dfa-43bd-882b-08775fb68eac admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:48.542582 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1175/2332] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:05:48 2022] POST /identity/v3/projects => generated 367 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:05:48.550222 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c6aa1-5197-42e4-8e68-4880001dd810 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:48.622630 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c6aa1-5197-42e4-8e68-4880001dd810 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:48.627550 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a95bd-a314-4818-b942-78f56ffb8e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:48.628156 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a95bd-a314-4818-b942-78f56ffb8e1a admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:48.628469 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a95bd-a314-4818-b942-78f56ffb8e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:48.628772 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a95bd-a314-4818-b942-78f56ffb8e1a admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:48.629390 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a95bd-a314-4818-b942-78f56ffb8e1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:48.634060 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1158/2333] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:05:48 2022] POST /identity/v3/users => generated 300 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:05:48.634273 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a95bd-a314-4818-b942-78f56ffb8e1a admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:48.635186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb13147-6dfa-43bd-882b-08775fb68eac admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:48.645434 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb13147-6dfa-43bd-882b-08775fb68eac admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:48.650823 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfa869-0a11-4f6a-9014-f0987f0bf7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:48.651416 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfa869-0a11-4f6a-9014-f0987f0bf7cc admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:48.651694 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfa869-0a11-4f6a-9014-f0987f0bf7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:48.651960 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfa869-0a11-4f6a-9014-f0987f0bf7cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:48.652593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfa869-0a11-4f6a-9014-f0987f0bf7cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:48.654211 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfa869-0a11-4f6a-9014-f0987f0bf7cc admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:48.665087 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1159/2334] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:05:48.668920 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfa869-0a11-4f6a-9014-f0987f0bf7cc admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:48.678151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfa869-0a11-4f6a-9014-f0987f0bf7cc admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:48.682943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d1709-3d78-4ce0-86bf-83517547c1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:48.683495 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d1709-3d78-4ce0-86bf-83517547c1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:48.683774 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d1709-3d78-4ce0-86bf-83517547c1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:48.684045 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d1709-3d78-4ce0-86bf-83517547c1e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:48.684720 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d1709-3d78-4ce0-86bf-83517547c1e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:48.686312 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d1709-3d78-4ce0-86bf-83517547c1e6 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:48.697821 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1160/2335] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:05:48.702012 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d1709-3d78-4ce0-86bf-83517547c1e6 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:48.713821 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d1709-3d78-4ce0-86bf-83517547c1e6 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:48.719184 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd418d6-d20e-446d-a362-61f796737df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:48.720015 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd418d6-d20e-446d-a362-61f796737df4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:48.720302 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd418d6-d20e-446d-a362-61f796737df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:48.720576 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd418d6-d20e-446d-a362-61f796737df4 admin admin] PATH_INFO: `/v3/projects/bd0411d0084f43de95c8598c9aee7789/users/832fabe5248f4fed99c0143cdc1f704d/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:48.723148 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:48.739883 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1176/2336] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:05:48 2022] POST /identity/v3/users => generated 284 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:05:48.740080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd418d6-d20e-446d-a362-61f796737df4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd0411d0084f43de95c8598c9aee7789, user_id=832fabe5248f4fed99c0143cdc1f704d, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:48.741285 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd418d6-d20e-446d-a362-61f796737df4 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:48.742284 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a95bd-a314-4818-b942-78f56ffb8e1a admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:48.753969 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a95bd-a314-4818-b942-78f56ffb8e1a admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:48.760315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a100a-15cf-42a7-bc6d-912d22c8a284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:48.762855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a100a-15cf-42a7-bc6d-912d22c8a284 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:48.762855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a100a-15cf-42a7-bc6d-912d22c8a284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:48.762855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a100a-15cf-42a7-bc6d-912d22c8a284 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:48.762855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a100a-15cf-42a7-bc6d-912d22c8a284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:48.763969 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a100a-15cf-42a7-bc6d-912d22c8a284 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:48.776029 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1177/2337] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:05:48.779977 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a100a-15cf-42a7-bc6d-912d22c8a284 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:48.790807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a100a-15cf-42a7-bc6d-912d22c8a284 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:48.795726 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ee7bf-59d7-4c8a-8982-f2c3a74bfb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:48.796342 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ee7bf-59d7-4c8a-8982-f2c3a74bfb92 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:48.796649 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ee7bf-59d7-4c8a-8982-f2c3a74bfb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:48.796922 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ee7bf-59d7-4c8a-8982-f2c3a74bfb92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:48.797571 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ee7bf-59d7-4c8a-8982-f2c3a74bfb92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:48.799189 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ee7bf-59d7-4c8a-8982-f2c3a74bfb92 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:48.811834 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1178/2338] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:05:48.815737 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ee7bf-59d7-4c8a-8982-f2c3a74bfb92 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:48.827114 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ee7bf-59d7-4c8a-8982-f2c3a74bfb92 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:48.832148 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f20e6-1d3b-4f97-b478-9a0caeb7df64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:48.832857 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f20e6-1d3b-4f97-b478-9a0caeb7df64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:48.833156 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f20e6-1d3b-4f97-b478-9a0caeb7df64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:48.833414 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f20e6-1d3b-4f97-b478-9a0caeb7df64 admin admin] PATH_INFO: `/v3/projects/383124a8825f4e6da07887dc494023cf/users/e26f02dfeab4477a896f99af30a08a58/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:48.846148 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:48.852076 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1161/2339] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:05:48 2022] PUT /identity/v3/projects/bd0411d0084f43de95c8598c9aee7789/users/832fabe5248f4fed99c0143cdc1f704d/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:05:48.852204 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f20e6-1d3b-4f97-b478-9a0caeb7df64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=383124a8825f4e6da07887dc494023cf, user_id=e26f02dfeab4477a896f99af30a08a58, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:48.854227 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f20e6-1d3b-4f97-b478-9a0caeb7df64 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:48.860848 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ab365-95aa-4c9e-b323-5dbe7112be57 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:48.861265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ab365-95aa-4c9e-b323-5dbe7112be57 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:48.861559 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ab365-95aa-4c9e-b323-5dbe7112be57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:48.893742 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-139ab365-95aa-4c9e-b323-5dbe7112be57 None None] MFA Rules not processed for user `832fabe5248f4fed99c0143cdc1f704d`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:05:48.894998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-139ab365-95aa-4c9e-b323-5dbe7112be57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:48.940856 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1179/2340] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:05:48 2022] PUT /identity/v3/projects/383124a8825f4e6da07887dc494023cf/users/e26f02dfeab4477a896f99af30a08a58/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:05:48.953669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05d40c-9093-4889-9d10-d0906f469b40 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:48.956547 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05d40c-9093-4889-9d10-d0906f469b40 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:48.956547 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05d40c-9093-4889-9d10-d0906f469b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:48.968165 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1162/2341] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:05:48 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:05:48.972499 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ab365-95aa-4c9e-b323-5dbe7112be57 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:48.989762 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-2b05d40c-9093-4889-9d10-d0906f469b40 None None] MFA Rules not processed for user `e26f02dfeab4477a896f99af30a08a58`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:05:48.991017 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-2b05d40c-9093-4889-9d10-d0906f469b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:49.060483 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ab365-95aa-4c9e-b323-5dbe7112be57 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:49.067341 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1180/2342] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:05:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:05:49.080682 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05d40c-9093-4889-9d10-d0906f469b40 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:49.082224 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-2b05d40c-9093-4889-9d10-d0906f469b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:49.138755 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b6ea3-be08-4614-8c9f-3f904701d107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:49.139707 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b6ea3-be08-4614-8c9f-3f904701d107 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:49.139707 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b6ea3-be08-4614-8c9f-3f904701d107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:49.140019 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b6ea3-be08-4614-8c9f-3f904701d107 admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:49.140683 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b6ea3-be08-4614-8c9f-3f904701d107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:49.142806 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b6ea3-be08-4614-8c9f-3f904701d107 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:49.177424 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05d40c-9093-4889-9d10-d0906f469b40 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:49.184135 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d44968-660e-422c-8a27-899bc2000d12 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21fda517a384dc5a6a9f36d68ac1a2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:49.184837 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d44968-660e-422c-8a27-899bc2000d12 service glance] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:49.185057 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d44968-660e-422c-8a27-899bc2000d12 service glance] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:49.185338 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d44968-660e-422c-8a27-899bc2000d12 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:49.194940 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d44968-660e-422c-8a27-899bc2000d12 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:49.196891 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d44968-660e-422c-8a27-899bc2000d12 service glance] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:49.207335 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1181/2343] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:05:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:05:49.252348 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1163/2344] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:05:48 2022] POST /identity/v3/projects => generated 399 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:05:49.260731 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d44968-660e-422c-8a27-899bc2000d12 service glance] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:49.272053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d44968-660e-422c-8a27-899bc2000d12 service glance] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:49.358904 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074eda3-fdbd-4f61-948f-8b26f2ac8a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:49.358904 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074eda3-fdbd-4f61-948f-8b26f2ac8a88 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:49.358904 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074eda3-fdbd-4f61-948f-8b26f2ac8a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:49.358904 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074eda3-fdbd-4f61-948f-8b26f2ac8a88 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:49.359270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074eda3-fdbd-4f61-948f-8b26f2ac8a88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:49.359270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074eda3-fdbd-4f61-948f-8b26f2ac8a88 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:49.460101 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1182/2345] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:05:49 2022] POST /identity/v3/users => generated 306 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:05:49.466919 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b6ea3-be08-4614-8c9f-3f904701d107 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:49.476364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:49.483018 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b6ea3-be08-4614-8c9f-3f904701d107 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:49.500055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52530e1a-0e27-4c6d-b563-cb0814545277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:49.500901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52530e1a-0e27-4c6d-b563-cb0814545277 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:49.501286 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52530e1a-0e27-4c6d-b563-cb0814545277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:49.501663 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52530e1a-0e27-4c6d-b563-cb0814545277 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:49.502525 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52530e1a-0e27-4c6d-b563-cb0814545277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:49.504326 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52530e1a-0e27-4c6d-b563-cb0814545277 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:49.522880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1164/2346] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:05:49.527648 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074eda3-fdbd-4f61-948f-8b26f2ac8a88 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:49.542662 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074eda3-fdbd-4f61-948f-8b26f2ac8a88 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:49.556951 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f1db7-2a3b-4326-ad82-62c3163c171d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:49.558929 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f1db7-2a3b-4326-ad82-62c3163c171d admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:49.559213 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f1db7-2a3b-4326-ad82-62c3163c171d admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:49.559496 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f1db7-2a3b-4326-ad82-62c3163c171d admin admin] PATH_INFO: `/v3/projects/59a8f5bcb42f4b5c8492466e36c7a5bd/users/063631e789564e63b0c9f8c2f147b353/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:49.578649 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:49.595776 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f1db7-2a3b-4326-ad82-62c3163c171d admin admin] RBAC: Authorizing `identity:create_grant(project_id=59a8f5bcb42f4b5c8492466e36c7a5bd, user_id=063631e789564e63b0c9f8c2f147b353, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:49.599485 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f1db7-2a3b-4326-ad82-62c3163c171d admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:49.700731 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1183/2347] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:05:49 2022] PUT /identity/v3/projects/59a8f5bcb42f4b5c8492466e36c7a5bd/users/063631e789564e63b0c9f8c2f147b353/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:05:49.704509 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52530e1a-0e27-4c6d-b563-cb0814545277 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:49.730734 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52530e1a-0e27-4c6d-b563-cb0814545277 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:49.803619 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d686d6f-d3d6-4191-a244-4e4c7a523cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:49.804229 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d686d6f-d3d6-4191-a244-4e4c7a523cfb admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:49.804511 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d686d6f-d3d6-4191-a244-4e4c7a523cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:49.804890 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d686d6f-d3d6-4191-a244-4e4c7a523cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:49.805858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d686d6f-d3d6-4191-a244-4e4c7a523cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:49.810221 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d686d6f-d3d6-4191-a244-4e4c7a523cfb admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:49.824580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1165/2348] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:05:49.825901 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f1db7-2a3b-4326-ad82-62c3163c171d admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:49.838279 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f1db7-2a3b-4326-ad82-62c3163c171d admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:49.844099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70513f8e-f7f6-4c90-88d7-6e09e90183cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:49.844812 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70513f8e-f7f6-4c90-88d7-6e09e90183cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:49.845099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70513f8e-f7f6-4c90-88d7-6e09e90183cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:49.845372 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70513f8e-f7f6-4c90-88d7-6e09e90183cd admin admin] PATH_INFO: `/v3/projects/59a8f5bcb42f4b5c8492466e36c7a5bd/users/063631e789564e63b0c9f8c2f147b353/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:49.847412 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70513f8e-f7f6-4c90-88d7-6e09e90183cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=59a8f5bcb42f4b5c8492466e36c7a5bd, user_id=063631e789564e63b0c9f8c2f147b353, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:49.850110 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70513f8e-f7f6-4c90-88d7-6e09e90183cd admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:49.862569 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1184/2349] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:05:49 2022] PUT /identity/v3/projects/59a8f5bcb42f4b5c8492466e36c7a5bd/users/063631e789564e63b0c9f8c2f147b353/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:05:49.878309 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc064aa2-a0a6-479c-b5c6-c97a93278301 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:49.878618 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc064aa2-a0a6-479c-b5c6-c97a93278301 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:49.878892 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc064aa2-a0a6-479c-b5c6-c97a93278301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:49.919752 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-bc064aa2-a0a6-479c-b5c6-c97a93278301 None None] MFA Rules not processed for user `063631e789564e63b0c9f8c2f147b353`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:05:49.921321 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-bc064aa2-a0a6-479c-b5c6-c97a93278301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:49.997971 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1166/2350] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:05:49 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:05:50.009849 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70513f8e-f7f6-4c90-88d7-6e09e90183cd admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:50.011578 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-70513f8e-f7f6-4c90-88d7-6e09e90183cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:50.076488 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70513f8e-f7f6-4c90-88d7-6e09e90183cd admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:50.089302 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc6c5c-70ba-47e6-883d-e2f4c81fcc04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:50.090083 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc6c5c-70ba-47e6-883d-e2f4c81fcc04 service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:50.090443 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc6c5c-70ba-47e6-883d-e2f4c81fcc04 service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:50.090725 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc6c5c-70ba-47e6-883d-e2f4c81fcc04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:50.103324 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc6c5c-70ba-47e6-883d-e2f4c81fcc04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:50.104823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc6c5c-70ba-47e6-883d-e2f4c81fcc04 service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:50.115392 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1185/2351] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:05:50 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:05:50.343998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc064aa2-a0a6-479c-b5c6-c97a93278301 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:50.355032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc064aa2-a0a6-479c-b5c6-c97a93278301 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:50.359269 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5b0bb-b778-43f0-a15c-71208272dcf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:50.359876 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5b0bb-b778-43f0-a15c-71208272dcf0 service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:50.360153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5b0bb-b778-43f0-a15c-71208272dcf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:50.360454 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5b0bb-b778-43f0-a15c-71208272dcf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:50.425992 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c5b0bb-b778-43f0-a15c-71208272dcf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:50.427682 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c5b0bb-b778-43f0-a15c-71208272dcf0 service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:50.438408 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1167/2352] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:05:50 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:05:58.016136 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc6c5c-70ba-47e6-883d-e2f4c81fcc04 service cinder] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:58.115461 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc6c5c-70ba-47e6-883d-e2f4c81fcc04 service cinder] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:58.121264 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bd051-469c-4aaf-b67e-661531bdd3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:58.122073 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bd051-469c-4aaf-b67e-661531bdd3f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:58.122467 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bd051-469c-4aaf-b67e-661531bdd3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:58.122814 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bd051-469c-4aaf-b67e-661531bdd3f4 admin admin] PATH_INFO: `/v3/users/832fabe5248f4fed99c0143cdc1f704d` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:58.124159 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180bd051-469c-4aaf-b67e-661531bdd3f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=832fabe5248f4fed99c0143cdc1f704d)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:58.127763 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180bd051-469c-4aaf-b67e-661531bdd3f4 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:58.420335 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-180bd051-469c-4aaf-b67e-661531bdd3f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '832fabe5248f4fed99c0143cdc1f704d'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:58.421600 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-180bd051-469c-4aaf-b67e-661531bdd3f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '832fabe5248f4fed99c0143cdc1f704d'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:58.422227 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-180bd051-469c-4aaf-b67e-661531bdd3f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '832fabe5248f4fed99c0143cdc1f704d'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:58.437139 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-180bd051-469c-4aaf-b67e-661531bdd3f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '832fabe5248f4fed99c0143cdc1f704d'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:58.506306 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-180bd051-469c-4aaf-b67e-661531bdd3f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '832fabe5248f4fed99c0143cdc1f704d'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:58.514180 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:58.521526 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1186/2353] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:05:58 2022] DELETE /identity/v3/users/832fabe5248f4fed99c0143cdc1f704d => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:05:58.526597 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d950a-ee42-4020-9dd4-44c0fff00d3e None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:58.527326 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d950a-ee42-4020-9dd4-44c0fff00d3e None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:58.527490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d950a-ee42-4020-9dd4-44c0fff00d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:58.545921 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-559d950a-ee42-4020-9dd4-44c0fff00d3e None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:05:58.547114 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-559d950a-ee42-4020-9dd4-44c0fff00d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:58.556283 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:58.612115 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1168/2354] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:05:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:05:58.622653 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bd051-469c-4aaf-b67e-661531bdd3f4 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:58.624109 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-180bd051-469c-4aaf-b67e-661531bdd3f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:58.690528 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bd051-469c-4aaf-b67e-661531bdd3f4 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:58.693490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f1218-80cc-48b7-82ed-abae43c1957f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:58.694117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f1218-80cc-48b7-82ed-abae43c1957f service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:58.694401 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f1218-80cc-48b7-82ed-abae43c1957f service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:58.694666 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f1218-80cc-48b7-82ed-abae43c1957f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:58.706670 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f1218-80cc-48b7-82ed-abae43c1957f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:58.707678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f1218-80cc-48b7-82ed-abae43c1957f service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:58.718814 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1187/2355] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:05:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:05:59.461915 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d950a-ee42-4020-9dd4-44c0fff00d3e None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:59.463351 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-559d950a-ee42-4020-9dd4-44c0fff00d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:05:59.476338 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d950a-ee42-4020-9dd4-44c0fff00d3e None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:59.481554 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b107ff-96f8-488e-b5a3-ad06b0aa7faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:59.482286 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b107ff-96f8-488e-b5a3-ad06b0aa7faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:59.482494 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b107ff-96f8-488e-b5a3-ad06b0aa7faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:59.482741 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b107ff-96f8-488e-b5a3-ad06b0aa7faf admin admin] PATH_INFO: `/v3/projects/bd0411d0084f43de95c8598c9aee7789` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:59.483929 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b107ff-96f8-488e-b5a3-ad06b0aa7faf admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd0411d0084f43de95c8598c9aee7789)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:59.485901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b107ff-96f8-488e-b5a3-ad06b0aa7faf admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:59.600174 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-19b107ff-96f8-488e-b5a3-ad06b0aa7faf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd0411d0084f43de95c8598c9aee7789', 'request_id': 'req-19b107ff-96f8-488e-b5a3-ad06b0aa7faf'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:59.606344 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-19b107ff-96f8-488e-b5a3-ad06b0aa7faf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd0411d0084f43de95c8598c9aee7789', 'request_id': 'req-19b107ff-96f8-488e-b5a3-ad06b0aa7faf'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:59.613669 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-19b107ff-96f8-488e-b5a3-ad06b0aa7faf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd0411d0084f43de95c8598c9aee7789', 'request_id': 'req-19b107ff-96f8-488e-b5a3-ad06b0aa7faf'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:59.688140 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-19b107ff-96f8-488e-b5a3-ad06b0aa7faf admin admin] The token cache is being invalidate because project bd0411d0084f43de95c8598c9aee7789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:05:59.688436 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-19b107ff-96f8-488e-b5a3-ad06b0aa7faf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:59.689139 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-19b107ff-96f8-488e-b5a3-ad06b0aa7faf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:59.690632 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1169/2356] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:05:59 2022] DELETE /identity/v3/projects/bd0411d0084f43de95c8598c9aee7789 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:05:59.694552 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f1218-80cc-48b7-82ed-abae43c1957f service neutron] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:05:59.705022 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f1218-80cc-48b7-82ed-abae43c1957f service neutron] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:05:59.764864 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580c424-92b5-4e6f-8018-c4d375cb2612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:05:59.765531 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580c424-92b5-4e6f-8018-c4d375cb2612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:05:59.765814 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580c424-92b5-4e6f-8018-c4d375cb2612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:05:59.766090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580c424-92b5-4e6f-8018-c4d375cb2612 admin admin] PATH_INFO: `/v3/users/063631e789564e63b0c9f8c2f147b353` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:05:59.767240 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580c424-92b5-4e6f-8018-c4d375cb2612 admin admin] RBAC: Authorizing `identity:delete_user(user_id=063631e789564e63b0c9f8c2f147b353)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:05:59.769227 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580c424-92b5-4e6f-8018-c4d375cb2612 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:05:59.980061 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-0580c424-92b5-4e6f-8018-c4d375cb2612 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '063631e789564e63b0c9f8c2f147b353'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:59.981639 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-0580c424-92b5-4e6f-8018-c4d375cb2612 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '063631e789564e63b0c9f8c2f147b353'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:59.982534 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-0580c424-92b5-4e6f-8018-c4d375cb2612 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '063631e789564e63b0c9f8c2f147b353'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:05:59.996050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-0580c424-92b5-4e6f-8018-c4d375cb2612 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '063631e789564e63b0c9f8c2f147b353'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:00.077896 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-0580c424-92b5-4e6f-8018-c4d375cb2612 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '063631e789564e63b0c9f8c2f147b353'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:00.096024 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1188/2357] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:05:59 2022] DELETE /identity/v3/users/063631e789564e63b0c9f8c2f147b353 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:06:00.790912 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b107ff-96f8-488e-b5a3-ad06b0aa7faf admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:00.794136 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-19b107ff-96f8-488e-b5a3-ad06b0aa7faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:06:00.807828 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b107ff-96f8-488e-b5a3-ad06b0aa7faf admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:00.893182 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae224a-4454-44fa-9a2b-a7c31c909962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:00.893854 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae224a-4454-44fa-9a2b-a7c31c909962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:00.894186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae224a-4454-44fa-9a2b-a7c31c909962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:00.894769 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae224a-4454-44fa-9a2b-a7c31c909962 admin admin] PATH_INFO: `/v3/projects/59a8f5bcb42f4b5c8492466e36c7a5bd` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:00.896019 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae224a-4454-44fa-9a2b-a7c31c909962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59a8f5bcb42f4b5c8492466e36c7a5bd)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:00.900702 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae224a-4454-44fa-9a2b-a7c31c909962 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:01.057140 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:01.066624 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-abae224a-4454-44fa-9a2b-a7c31c909962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59a8f5bcb42f4b5c8492466e36c7a5bd', 'request_id': 'req-abae224a-4454-44fa-9a2b-a7c31c909962'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:01.072215 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-abae224a-4454-44fa-9a2b-a7c31c909962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59a8f5bcb42f4b5c8492466e36c7a5bd', 'request_id': 'req-abae224a-4454-44fa-9a2b-a7c31c909962'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:01.079796 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-abae224a-4454-44fa-9a2b-a7c31c909962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59a8f5bcb42f4b5c8492466e36c7a5bd', 'request_id': 'req-abae224a-4454-44fa-9a2b-a7c31c909962'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:01.188074 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-abae224a-4454-44fa-9a2b-a7c31c909962 admin admin] The token cache is being invalidate because project 59a8f5bcb42f4b5c8492466e36c7a5bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:06:01.188434 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-abae224a-4454-44fa-9a2b-a7c31c909962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:01.189155 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-abae224a-4454-44fa-9a2b-a7c31c909962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:01.190849 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1170/2358] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:06:00 2022] DELETE /identity/v3/projects/59a8f5bcb42f4b5c8492466e36c7a5bd => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:06:01.196014 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc5e27-6697-49a8-aa00-a43770fbd563 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:01.196543 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc5e27-6697-49a8-aa00-a43770fbd563 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:01.196679 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc5e27-6697-49a8-aa00-a43770fbd563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:01.218118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-3bdc5e27-6697-49a8-aa00-a43770fbd563 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:06:01.219388 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-3bdc5e27-6697-49a8-aa00-a43770fbd563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:06:01.232802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:01.282007 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1189/2359] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:06:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:06:01.291590 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96558d-0c48-4a39-a6a9-714dc1450d80 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:01.291880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96558d-0c48-4a39-a6a9-714dc1450d80 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:01.292162 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96558d-0c48-4a39-a6a9-714dc1450d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:01.311937 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-ad96558d-0c48-4a39-a6a9-714dc1450d80 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:06:01.313231 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-ad96558d-0c48-4a39-a6a9-714dc1450d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:06:01.326983 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1171/2360] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:06:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:06:01.330402 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc5e27-6697-49a8-aa00-a43770fbd563 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:01.341035 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc5e27-6697-49a8-aa00-a43770fbd563 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:01.345677 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe5c7b-71d4-478a-810c-c50329f1b52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:01.346287 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe5c7b-71d4-478a-810c-c50329f1b52d admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:01.346611 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe5c7b-71d4-478a-810c-c50329f1b52d admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:01.346939 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe5c7b-71d4-478a-810c-c50329f1b52d admin admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:01.347571 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe5c7b-71d4-478a-810c-c50329f1b52d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:06:01.347872 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe5c7b-71d4-478a-810c-c50329f1b52d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:01.349518 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe5c7b-71d4-478a-810c-c50329f1b52d admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:01.362544 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1190/2361] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:06:01.366938 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96558d-0c48-4a39-a6a9-714dc1450d80 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:01.377023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96558d-0c48-4a39-a6a9-714dc1450d80 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:01.381994 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c801a1-ab0d-4f68-b5d5-dc8887f54714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:01.383117 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c801a1-ab0d-4f68-b5d5-dc8887f54714 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:01.383117 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c801a1-ab0d-4f68-b5d5-dc8887f54714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:01.383327 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c801a1-ab0d-4f68-b5d5-dc8887f54714 admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:01.383818 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c801a1-ab0d-4f68-b5d5-dc8887f54714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:01.385925 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c801a1-ab0d-4f68-b5d5-dc8887f54714 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:01.473986 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1172/2362] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:06:01 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:06:01.478190 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe5c7b-71d4-478a-810c-c50329f1b52d admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:01.489016 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe5c7b-71d4-478a-810c-c50329f1b52d admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:01.561363 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d14c9a-2777-4086-83c8-b829b302afdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:01.562086 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d14c9a-2777-4086-83c8-b829b302afdd admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:01.562368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d14c9a-2777-4086-83c8-b829b302afdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:01.562641 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d14c9a-2777-4086-83c8-b829b302afdd admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:01.563282 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d14c9a-2777-4086-83c8-b829b302afdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:01.565361 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d14c9a-2777-4086-83c8-b829b302afdd admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:01.664212 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1191/2363] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:06:01 2022] POST /identity/v3/users => generated 291 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:06:01.668380 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c801a1-ab0d-4f68-b5d5-dc8887f54714 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:01.679821 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c801a1-ab0d-4f68-b5d5-dc8887f54714 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:01.684581 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d99e8-8d30-4004-b290-227e0a3fba31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:01.685876 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d99e8-8d30-4004-b290-227e0a3fba31 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:01.686158 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d99e8-8d30-4004-b290-227e0a3fba31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:01.686440 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d99e8-8d30-4004-b290-227e0a3fba31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:01.687073 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d99e8-8d30-4004-b290-227e0a3fba31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:01.688738 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d99e8-8d30-4004-b290-227e0a3fba31 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:01.699235 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1173/2364] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:06:01.703941 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d14c9a-2777-4086-83c8-b829b302afdd admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:01.727154 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d14c9a-2777-4086-83c8-b829b302afdd admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:01.732521 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94fe9f4-4ded-4efa-b229-8d07bc5d2fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:01.733163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fe9f4-4ded-4efa-b229-8d07bc5d2fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:01.733449 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fe9f4-4ded-4efa-b229-8d07bc5d2fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:01.733727 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fe9f4-4ded-4efa-b229-8d07bc5d2fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:01.734430 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94fe9f4-4ded-4efa-b229-8d07bc5d2fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:01.736163 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94fe9f4-4ded-4efa-b229-8d07bc5d2fd9 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:01.748408 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1192/2365] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:06:01.753092 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d99e8-8d30-4004-b290-227e0a3fba31 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:01.763266 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d99e8-8d30-4004-b290-227e0a3fba31 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:01.768757 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d7bcd-6ff8-47b2-b913-4e26fea38bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:01.769415 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d7bcd-6ff8-47b2-b913-4e26fea38bc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:01.769703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d7bcd-6ff8-47b2-b913-4e26fea38bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:01.769980 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d7bcd-6ff8-47b2-b913-4e26fea38bc6 admin admin] PATH_INFO: `/v3/projects/09dfa70fd66c485aa65656bb24aa0ac8/users/f02d1893e5a34677aff70d27f5f10d43/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:01.785000 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d7bcd-6ff8-47b2-b913-4e26fea38bc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09dfa70fd66c485aa65656bb24aa0ac8, user_id=f02d1893e5a34677aff70d27f5f10d43, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:01.787664 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d7bcd-6ff8-47b2-b913-4e26fea38bc6 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:01.862923 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1174/2366] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:06:01 2022] PUT /identity/v3/projects/09dfa70fd66c485aa65656bb24aa0ac8/users/f02d1893e5a34677aff70d27f5f10d43/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:06:01.876619 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889fb93-3fb0-43c6-9a13-fe35aa6795cb None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:01.876619 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889fb93-3fb0-43c6-9a13-fe35aa6795cb None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:01.876619 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889fb93-3fb0-43c6-9a13-fe35aa6795cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:01.908923 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-5889fb93-3fb0-43c6-9a13-fe35aa6795cb None None] MFA Rules not processed for user `f02d1893e5a34677aff70d27f5f10d43`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:06:01.910227 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-5889fb93-3fb0-43c6-9a13-fe35aa6795cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:06:01.980457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1193/2367] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:06:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:06:01.985677 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d7bcd-6ff8-47b2-b913-4e26fea38bc6 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:02.052487 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d7bcd-6ff8-47b2-b913-4e26fea38bc6 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:02.061626 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476c80b-7a69-41c7-a735-47adcb85194f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:02.063024 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476c80b-7a69-41c7-a735-47adcb85194f admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:02.063630 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476c80b-7a69-41c7-a735-47adcb85194f admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:02.064348 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476c80b-7a69-41c7-a735-47adcb85194f admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:02.065306 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476c80b-7a69-41c7-a735-47adcb85194f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:02.067779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476c80b-7a69-41c7-a735-47adcb85194f admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:02.139688 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1175/2368] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:06:01 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:06:02.143738 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889fb93-3fb0-43c6-9a13-fe35aa6795cb None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:02.155222 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889fb93-3fb0-43c6-9a13-fe35aa6795cb None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:02.178546 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:02.227581 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fef926-bd5d-4874-8122-cf27e296a36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:02.228308 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fef926-bd5d-4874-8122-cf27e296a36b admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:02.228450 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fef926-bd5d-4874-8122-cf27e296a36b admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:02.228751 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fef926-bd5d-4874-8122-cf27e296a36b admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:02.229386 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fef926-bd5d-4874-8122-cf27e296a36b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:02.231341 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fef926-bd5d-4874-8122-cf27e296a36b admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:02.336639 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1194/2369] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:06:02 2022] POST /identity/v3/users => generated 298 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:06:02.340299 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476c80b-7a69-41c7-a735-47adcb85194f admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:02.350805 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476c80b-7a69-41c7-a735-47adcb85194f admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:02.355435 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7b72a-6cef-437f-9dc3-1fd91708b896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:02.356031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7b72a-6cef-437f-9dc3-1fd91708b896 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:02.356312 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7b72a-6cef-437f-9dc3-1fd91708b896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:02.356676 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7b72a-6cef-437f-9dc3-1fd91708b896 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:02.357358 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de7b72a-6cef-437f-9dc3-1fd91708b896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:02.359103 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de7b72a-6cef-437f-9dc3-1fd91708b896 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:02.370262 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1176/2370] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:06:02.375691 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fef926-bd5d-4874-8122-cf27e296a36b admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:02.385724 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fef926-bd5d-4874-8122-cf27e296a36b admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:02.391138 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ddbe1-1ae6-4477-a290-0f9fc70023af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:02.391737 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ddbe1-1ae6-4477-a290-0f9fc70023af admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:02.392116 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ddbe1-1ae6-4477-a290-0f9fc70023af admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:02.392294 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ddbe1-1ae6-4477-a290-0f9fc70023af admin admin] PATH_INFO: `/v3/projects/6b28be962f514d99bc3674eadd004e07/users/ad3b0d26fa934b41af9941f839566c9a/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:02.407953 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ddbe1-1ae6-4477-a290-0f9fc70023af admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b28be962f514d99bc3674eadd004e07, user_id=ad3b0d26fa934b41af9941f839566c9a, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:02.410651 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ddbe1-1ae6-4477-a290-0f9fc70023af admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:02.478835 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1195/2371] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:06:02 2022] PUT /identity/v3/projects/6b28be962f514d99bc3674eadd004e07/users/ad3b0d26fa934b41af9941f839566c9a/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:06:02.483524 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7b72a-6cef-437f-9dc3-1fd91708b896 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:02.494600 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7b72a-6cef-437f-9dc3-1fd91708b896 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:02.530043 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:02.553593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2254273-a1b0-4e7e-bc9d-2ba4c9f3f074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:02.554268 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2254273-a1b0-4e7e-bc9d-2ba4c9f3f074 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:02.554548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2254273-a1b0-4e7e-bc9d-2ba4c9f3f074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:02.554824 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2254273-a1b0-4e7e-bc9d-2ba4c9f3f074 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:02.555467 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2254273-a1b0-4e7e-bc9d-2ba4c9f3f074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:02.557273 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2254273-a1b0-4e7e-bc9d-2ba4c9f3f074 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:02.571908 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1177/2372] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:06:02.573215 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ddbe1-1ae6-4477-a290-0f9fc70023af admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:02.584492 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ddbe1-1ae6-4477-a290-0f9fc70023af admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:02.589453 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a738d78-54e6-4e58-9c52-8f5d09a3df05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:02.590149 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a738d78-54e6-4e58-9c52-8f5d09a3df05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:02.590435 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a738d78-54e6-4e58-9c52-8f5d09a3df05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:02.590712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a738d78-54e6-4e58-9c52-8f5d09a3df05 admin admin] PATH_INFO: `/v3/projects/6b28be962f514d99bc3674eadd004e07/users/ad3b0d26fa934b41af9941f839566c9a/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:02.592731 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a738d78-54e6-4e58-9c52-8f5d09a3df05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b28be962f514d99bc3674eadd004e07, user_id=ad3b0d26fa934b41af9941f839566c9a, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:02.595491 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a738d78-54e6-4e58-9c52-8f5d09a3df05 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:02.606344 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1196/2373] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:06:02 2022] PUT /identity/v3/projects/6b28be962f514d99bc3674eadd004e07/users/ad3b0d26fa934b41af9941f839566c9a/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:06:02.617366 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f104d-1925-4613-b663-ed7dbdb95513 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:02.617709 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f104d-1925-4613-b663-ed7dbdb95513 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:02.618008 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f104d-1925-4613-b663-ed7dbdb95513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:02.648202 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-203f104d-1925-4613-b663-ed7dbdb95513 None None] MFA Rules not processed for user `ad3b0d26fa934b41af9941f839566c9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:06:02.649444 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-203f104d-1925-4613-b663-ed7dbdb95513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:06:02.720139 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1178/2374] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:06:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:06:02.731241 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a738d78-54e6-4e58-9c52-8f5d09a3df05 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:02.735636 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-6a738d78-54e6-4e58-9c52-8f5d09a3df05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:06:02.803905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a738d78-54e6-4e58-9c52-8f5d09a3df05 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:02.807975 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a65b00-7167-420f-8f0a-0ba05492133d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:02.808485 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a65b00-7167-420f-8f0a-0ba05492133d service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:02.808928 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a65b00-7167-420f-8f0a-0ba05492133d service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:02.809039 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a65b00-7167-420f-8f0a-0ba05492133d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:02.821614 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a65b00-7167-420f-8f0a-0ba05492133d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:02.823077 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a65b00-7167-420f-8f0a-0ba05492133d service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:02.835474 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1197/2375] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:06:02 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:06:02.958051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f104d-1925-4613-b663-ed7dbdb95513 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:02.959773 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-203f104d-1925-4613-b663-ed7dbdb95513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:06:02.972788 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f104d-1925-4613-b663-ed7dbdb95513 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:02.977312 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b17c92-650d-4888-aabd-7304cf8289b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:02.977923 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b17c92-650d-4888-aabd-7304cf8289b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:02.978631 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b17c92-650d-4888-aabd-7304cf8289b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:02.978631 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b17c92-650d-4888-aabd-7304cf8289b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:03.042956 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b17c92-650d-4888-aabd-7304cf8289b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:03.044418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b17c92-650d-4888-aabd-7304cf8289b2 service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:03.054485 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1179/2376] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:06:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:06:07.222314 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a65b00-7167-420f-8f0a-0ba05492133d service cinder] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:07.278365 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a65b00-7167-420f-8f0a-0ba05492133d service cinder] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:07.283067 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52da3f1-0cd8-4ac7-89d7-17b52b84028c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:07.284199 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52da3f1-0cd8-4ac7-89d7-17b52b84028c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:07.284199 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52da3f1-0cd8-4ac7-89d7-17b52b84028c admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:07.284432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52da3f1-0cd8-4ac7-89d7-17b52b84028c admin admin] PATH_INFO: `/v3/users/f02d1893e5a34677aff70d27f5f10d43` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:07.285483 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52da3f1-0cd8-4ac7-89d7-17b52b84028c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f02d1893e5a34677aff70d27f5f10d43)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:07.287428 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52da3f1-0cd8-4ac7-89d7-17b52b84028c admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:07.298527 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:07.455940 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-b52da3f1-0cd8-4ac7-89d7-17b52b84028c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f02d1893e5a34677aff70d27f5f10d43'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:07.456744 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-b52da3f1-0cd8-4ac7-89d7-17b52b84028c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f02d1893e5a34677aff70d27f5f10d43'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:07.457363 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-b52da3f1-0cd8-4ac7-89d7-17b52b84028c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f02d1893e5a34677aff70d27f5f10d43'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:07.471053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-b52da3f1-0cd8-4ac7-89d7-17b52b84028c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f02d1893e5a34677aff70d27f5f10d43'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:07.532083 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-b52da3f1-0cd8-4ac7-89d7-17b52b84028c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f02d1893e5a34677aff70d27f5f10d43'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:07.544862 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1198/2377] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:06:07 2022] DELETE /identity/v3/users/f02d1893e5a34677aff70d27f5f10d43 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:06:07.550153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ada96-ebc3-41fe-b0dd-01e9e1ff10ce None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:07.550623 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ada96-ebc3-41fe-b0dd-01e9e1ff10ce None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:07.550751 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ada96-ebc3-41fe-b0dd-01e9e1ff10ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:07.569311 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-e84ada96-ebc3-41fe-b0dd-01e9e1ff10ce None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:06:07.570493 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e84ada96-ebc3-41fe-b0dd-01e9e1ff10ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:06:07.620515 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:07.629581 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1180/2378] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:06:07.639235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52da3f1-0cd8-4ac7-89d7-17b52b84028c admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:07.640968 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-b52da3f1-0cd8-4ac7-89d7-17b52b84028c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:06:07.700828 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52da3f1-0cd8-4ac7-89d7-17b52b84028c admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:07.705283 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3dd140-6685-4755-9cde-9dd7a266dfc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:07.705926 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dd140-6685-4755-9cde-9dd7a266dfc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:07.706260 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dd140-6685-4755-9cde-9dd7a266dfc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:07.706478 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dd140-6685-4755-9cde-9dd7a266dfc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:07.716651 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3dd140-6685-4755-9cde-9dd7a266dfc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:07.718975 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3dd140-6685-4755-9cde-9dd7a266dfc0 service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:07.729152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1199/2379] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:06:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:06:08.179601 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ada96-ebc3-41fe-b0dd-01e9e1ff10ce None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:08.181674 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e84ada96-ebc3-41fe-b0dd-01e9e1ff10ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:06:08.194600 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ada96-ebc3-41fe-b0dd-01e9e1ff10ce None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:08.199546 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805879f8-cb1a-44b3-86f6-c226bc09baa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:08.199877 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805879f8-cb1a-44b3-86f6-c226bc09baa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:08.200153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805879f8-cb1a-44b3-86f6-c226bc09baa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:08.200437 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805879f8-cb1a-44b3-86f6-c226bc09baa8 admin admin] PATH_INFO: `/v3/projects/09dfa70fd66c485aa65656bb24aa0ac8` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:08.201674 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805879f8-cb1a-44b3-86f6-c226bc09baa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09dfa70fd66c485aa65656bb24aa0ac8)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:08.210929 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805879f8-cb1a-44b3-86f6-c226bc09baa8 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:08.345998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-805879f8-cb1a-44b3-86f6-c226bc09baa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09dfa70fd66c485aa65656bb24aa0ac8', 'request_id': 'req-805879f8-cb1a-44b3-86f6-c226bc09baa8'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:08.351552 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-805879f8-cb1a-44b3-86f6-c226bc09baa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09dfa70fd66c485aa65656bb24aa0ac8', 'request_id': 'req-805879f8-cb1a-44b3-86f6-c226bc09baa8'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:08.357906 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-805879f8-cb1a-44b3-86f6-c226bc09baa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09dfa70fd66c485aa65656bb24aa0ac8', 'request_id': 'req-805879f8-cb1a-44b3-86f6-c226bc09baa8'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:08.434039 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-805879f8-cb1a-44b3-86f6-c226bc09baa8 admin admin] The token cache is being invalidate because project 09dfa70fd66c485aa65656bb24aa0ac8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:06:08.434350 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-805879f8-cb1a-44b3-86f6-c226bc09baa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:08.435053 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-805879f8-cb1a-44b3-86f6-c226bc09baa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:08.437531 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1181/2380] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:06:08 2022] DELETE /identity/v3/projects/09dfa70fd66c485aa65656bb24aa0ac8 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:06:08.443569 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3dd140-6685-4755-9cde-9dd7a266dfc0 service neutron] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:08.453398 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3dd140-6685-4755-9cde-9dd7a266dfc0 service neutron] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:08.509073 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b306599-4b5f-478a-9ec1-3666aee5e790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:08.509616 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b306599-4b5f-478a-9ec1-3666aee5e790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:08.509892 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b306599-4b5f-478a-9ec1-3666aee5e790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:08.510162 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b306599-4b5f-478a-9ec1-3666aee5e790 admin admin] PATH_INFO: `/v3/users/ad3b0d26fa934b41af9941f839566c9a` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:08.511267 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b306599-4b5f-478a-9ec1-3666aee5e790 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad3b0d26fa934b41af9941f839566c9a)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:08.513204 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b306599-4b5f-478a-9ec1-3666aee5e790 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:08.665306 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:08.677758 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-8b306599-4b5f-478a-9ec1-3666aee5e790 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad3b0d26fa934b41af9941f839566c9a'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:08.678419 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-8b306599-4b5f-478a-9ec1-3666aee5e790 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad3b0d26fa934b41af9941f839566c9a'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:08.679047 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-8b306599-4b5f-478a-9ec1-3666aee5e790 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad3b0d26fa934b41af9941f839566c9a'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:08.691583 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-8b306599-4b5f-478a-9ec1-3666aee5e790 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad3b0d26fa934b41af9941f839566c9a'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:08.743198 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-8b306599-4b5f-478a-9ec1-3666aee5e790 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad3b0d26fa934b41af9941f839566c9a'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:08.757050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1200/2381] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:06:08 2022] DELETE /identity/v3/users/ad3b0d26fa934b41af9941f839566c9a => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:06:09.231507 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805879f8-cb1a-44b3-86f6-c226bc09baa8 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:09.233996 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-805879f8-cb1a-44b3-86f6-c226bc09baa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:06:09.250767 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805879f8-cb1a-44b3-86f6-c226bc09baa8 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:09.335192 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacc430-6685-4588-9dde-4f3c8f512c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:09.336549 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacc430-6685-4588-9dde-4f3c8f512c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:09.337177 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacc430-6685-4588-9dde-4f3c8f512c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:09.337607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacc430-6685-4588-9dde-4f3c8f512c0a admin admin] PATH_INFO: `/v3/projects/6b28be962f514d99bc3674eadd004e07` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:09.339279 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aacc430-6685-4588-9dde-4f3c8f512c0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b28be962f514d99bc3674eadd004e07)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:09.341602 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aacc430-6685-4588-9dde-4f3c8f512c0a admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:09.449459 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-5aacc430-6685-4588-9dde-4f3c8f512c0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b28be962f514d99bc3674eadd004e07', 'request_id': 'req-5aacc430-6685-4588-9dde-4f3c8f512c0a'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:09.455044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-5aacc430-6685-4588-9dde-4f3c8f512c0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b28be962f514d99bc3674eadd004e07', 'request_id': 'req-5aacc430-6685-4588-9dde-4f3c8f512c0a'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:09.461507 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-5aacc430-6685-4588-9dde-4f3c8f512c0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b28be962f514d99bc3674eadd004e07', 'request_id': 'req-5aacc430-6685-4588-9dde-4f3c8f512c0a'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:09.527804 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-5aacc430-6685-4588-9dde-4f3c8f512c0a admin admin] The token cache is being invalidate because project 6b28be962f514d99bc3674eadd004e07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:06:09.531767 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-5aacc430-6685-4588-9dde-4f3c8f512c0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:09.531767 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-5aacc430-6685-4588-9dde-4f3c8f512c0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:09.531767 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1182/2382] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:06:09 2022] DELETE /identity/v3/projects/6b28be962f514d99bc3674eadd004e07 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:06:09.535928 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad89811-0697-434a-a960-d464db78e835 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:09.536756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad89811-0697-434a-a960-d464db78e835 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:09.537179 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad89811-0697-434a-a960-d464db78e835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:09.558545 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-fad89811-0697-434a-a960-d464db78e835 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:06:09.559998 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-fad89811-0697-434a-a960-d464db78e835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:06:09.622162 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1201/2383] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:06:09.633984 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f64d4-3099-4b7d-97b7-42b67c149820 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:09.634270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f64d4-3099-4b7d-97b7-42b67c149820 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:09.634567 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f64d4-3099-4b7d-97b7-42b67c149820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:09.654188 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-c24f64d4-3099-4b7d-97b7-42b67c149820 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:06:09.656181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-c24f64d4-3099-4b7d-97b7-42b67c149820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:06:09.664076 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1183/2384] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:06:09.668285 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad89811-0697-434a-a960-d464db78e835 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:09.678826 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad89811-0697-434a-a960-d464db78e835 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:09.683457 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a05db-c0d6-49e6-b441-9bc7ab2c7507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:09.684051 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a05db-c0d6-49e6-b441-9bc7ab2c7507 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:09.684333 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a05db-c0d6-49e6-b441-9bc7ab2c7507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:09.684607 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a05db-c0d6-49e6-b441-9bc7ab2c7507 admin admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:09.685313 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a05db-c0d6-49e6-b441-9bc7ab2c7507 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:06:09.685611 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a05db-c0d6-49e6-b441-9bc7ab2c7507 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:09.687241 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a05db-c0d6-49e6-b441-9bc7ab2c7507 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:09.701916 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1202/2385] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:06:09.703355 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f64d4-3099-4b7d-97b7-42b67c149820 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:09.709329 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:09.713263 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f64d4-3099-4b7d-97b7-42b67c149820 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:09.718421 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1948d-d7f3-4434-80f5-bb96cd8117f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:09.719120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1948d-d7f3-4434-80f5-bb96cd8117f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:09.719398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1948d-d7f3-4434-80f5-bb96cd8117f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:09.719667 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1948d-d7f3-4434-80f5-bb96cd8117f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:09.720283 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1948d-d7f3-4434-80f5-bb96cd8117f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:09.722197 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1948d-d7f3-4434-80f5-bb96cd8117f3 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:09.806150 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1184/2386] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:06:09 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:06:09.812083 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a05db-c0d6-49e6-b441-9bc7ab2c7507 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:09.822784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a05db-c0d6-49e6-b441-9bc7ab2c7507 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:09.880812 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11c086-6176-472c-befe-529b8d10b19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:09.881432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11c086-6176-472c-befe-529b8d10b19f admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:09.881715 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11c086-6176-472c-befe-529b8d10b19f admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:09.883632 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11c086-6176-472c-befe-529b8d10b19f admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:09.883632 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11c086-6176-472c-befe-529b8d10b19f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:09.885002 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11c086-6176-472c-befe-529b8d10b19f admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:09.956424 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1203/2387] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:06:09 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:06:09.960377 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1948d-d7f3-4434-80f5-bb96cd8117f3 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:09.971724 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1948d-d7f3-4434-80f5-bb96cd8117f3 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:09.976314 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95297f-23bb-46c2-abde-6d5969084655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:09.976939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95297f-23bb-46c2-abde-6d5969084655 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:09.977218 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95297f-23bb-46c2-abde-6d5969084655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:09.977485 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95297f-23bb-46c2-abde-6d5969084655 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:09.978115 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95297f-23bb-46c2-abde-6d5969084655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:09.979702 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95297f-23bb-46c2-abde-6d5969084655 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:09.990248 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1185/2388] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:06:09.998245 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11c086-6176-472c-befe-529b8d10b19f admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:10.008541 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11c086-6176-472c-befe-529b8d10b19f admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:10.013393 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ddae30-b6c2-480a-a89b-514f13d2578a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:10.016346 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddae30-b6c2-480a-a89b-514f13d2578a admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:10.016346 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddae30-b6c2-480a-a89b-514f13d2578a admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:10.016346 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddae30-b6c2-480a-a89b-514f13d2578a admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:10.016346 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ddae30-b6c2-480a-a89b-514f13d2578a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:10.017502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ddae30-b6c2-480a-a89b-514f13d2578a admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:10.037509 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1204/2389] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:06:10.043279 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95297f-23bb-46c2-abde-6d5969084655 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:10.053950 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95297f-23bb-46c2-abde-6d5969084655 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:10.058833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146ca96-4e7a-412d-8997-e049107ad5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:10.059487 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146ca96-4e7a-412d-8997-e049107ad5ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:10.059767 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146ca96-4e7a-412d-8997-e049107ad5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:10.060042 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146ca96-4e7a-412d-8997-e049107ad5ab admin admin] PATH_INFO: `/v3/projects/6a7687e0df1c43a4ba2a77e851843cdd/users/343a476eaf33493d9a30c8f564a1afa9/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:10.076418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146ca96-4e7a-412d-8997-e049107ad5ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a7687e0df1c43a4ba2a77e851843cdd, user_id=343a476eaf33493d9a30c8f564a1afa9, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:10.087182 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146ca96-4e7a-412d-8997-e049107ad5ab admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:10.180287 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1186/2390] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:06:10 2022] PUT /identity/v3/projects/6a7687e0df1c43a4ba2a77e851843cdd/users/343a476eaf33493d9a30c8f564a1afa9/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:06:10.192917 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775e330-ed0a-47f0-bf4a-b25823d4d500 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:10.193348 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775e330-ed0a-47f0-bf4a-b25823d4d500 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:10.193745 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775e330-ed0a-47f0-bf4a-b25823d4d500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:10.214705 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-c775e330-ed0a-47f0-bf4a-b25823d4d500 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:06:10.215979 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-c775e330-ed0a-47f0-bf4a-b25823d4d500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:06:10.226511 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:10.276465 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1205/2391] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:06:10.286835 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146ca96-4e7a-412d-8997-e049107ad5ab admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:10.288761 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-3146ca96-4e7a-412d-8997-e049107ad5ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:06:10.351499 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146ca96-4e7a-412d-8997-e049107ad5ab admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:10.355350 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fef95-c083-4899-b6ac-7ecc5858e573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:10.355951 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fef95-c083-4899-b6ac-7ecc5858e573 service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:10.356258 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fef95-c083-4899-b6ac-7ecc5858e573 service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:10.356530 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fef95-c083-4899-b6ac-7ecc5858e573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:10.366784 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fef95-c083-4899-b6ac-7ecc5858e573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:10.368217 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fef95-c083-4899-b6ac-7ecc5858e573 service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:10.379075 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1187/2392] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:06:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:06:11.618451 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c607b4-475a-4d4b-aafd-9618c253ecb6 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:11.618966 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c607b4-475a-4d4b-aafd-9618c253ecb6 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:11.619141 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c607b4-475a-4d4b-aafd-9618c253ecb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:11.652561 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-35c607b4-475a-4d4b-aafd-9618c253ecb6 None None] MFA Rules not processed for user `343a476eaf33493d9a30c8f564a1afa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:06:11.656597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-35c607b4-475a-4d4b-aafd-9618c253ecb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:06:11.721510 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1206/2393] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:06:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:06:11.732254 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fef95-c083-4899-b6ac-7ecc5858e573 service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:11.734197 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-bc4fef95-c083-4899-b6ac-7ecc5858e573 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:06:11.792514 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fef95-c083-4899-b6ac-7ecc5858e573 service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:11.796662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78849b51-8495-4ad5-a216-143faa4ebcae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:11.797417 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78849b51-8495-4ad5-a216-143faa4ebcae service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:11.797696 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78849b51-8495-4ad5-a216-143faa4ebcae service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:11.797967 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78849b51-8495-4ad5-a216-143faa4ebcae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:11.806182 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78849b51-8495-4ad5-a216-143faa4ebcae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:11.807600 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78849b51-8495-4ad5-a216-143faa4ebcae service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:11.816983 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1188/2394] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:06:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:06:14.547637 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383234c2-752a-4283-b3cc-25909e63f8cc None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:14.548183 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383234c2-752a-4283-b3cc-25909e63f8cc None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:14.548183 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383234c2-752a-4283-b3cc-25909e63f8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:14.566831 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-383234c2-752a-4283-b3cc-25909e63f8cc None None] MFA Rules not processed for user `343a476eaf33493d9a30c8f564a1afa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:06:14.568096 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-383234c2-752a-4283-b3cc-25909e63f8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:06:14.575190 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1207/2395] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:06:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:06:16.522765 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78849b51-8495-4ad5-a216-143faa4ebcae service cinder] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:16.524150 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-78849b51-8495-4ad5-a216-143faa4ebcae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:06:16.576726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:16.594651 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78849b51-8495-4ad5-a216-143faa4ebcae service cinder] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:16.599559 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b2324-344d-4925-baf8-97cfcef1bd31 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6907dfd3254d3c97d07ca2fb648858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:16.600199 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b2324-344d-4925-baf8-97cfcef1bd31 service placement] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:16.600470 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b2324-344d-4925-baf8-97cfcef1bd31 service placement] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:16.600777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b2324-344d-4925-baf8-97cfcef1bd31 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:16.602441 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-741b2324-344d-4925-baf8-97cfcef1bd31 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:06:16.614664 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b2324-344d-4925-baf8-97cfcef1bd31 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:16.616587 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b2324-344d-4925-baf8-97cfcef1bd31 service placement] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:16.627560 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1189/2396] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:06:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:06:21.610497 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383234c2-752a-4283-b3cc-25909e63f8cc None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:21.621223 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383234c2-752a-4283-b3cc-25909e63f8cc None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:21.624880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c53fa-14cc-4203-b268-ff8356113137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:21.625975 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c53fa-14cc-4203-b268-ff8356113137 service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:21.626258 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c53fa-14cc-4203-b268-ff8356113137 service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:21.626728 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c53fa-14cc-4203-b268-ff8356113137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:21.628662 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-ed5c53fa-14cc-4203-b268-ff8356113137 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:06:21.697963 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c53fa-14cc-4203-b268-ff8356113137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:21.699480 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c53fa-14cc-4203-b268-ff8356113137 service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:21.709944 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1208/2397] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:06:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:06:26.639766 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=8 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:27.953670 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b2324-344d-4925-baf8-97cfcef1bd31 service placement] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:27.955684 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-741b2324-344d-4925-baf8-97cfcef1bd31 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:06:27.968915 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b2324-344d-4925-baf8-97cfcef1bd31 service placement] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:27.975242 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5a5ff-9b4a-48ff-9f33-be3e4d94dfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:27.975965 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5a5ff-9b4a-48ff-9f33-be3e4d94dfcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:27.976292 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5a5ff-9b4a-48ff-9f33-be3e4d94dfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:27.976561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5a5ff-9b4a-48ff-9f33-be3e4d94dfcc admin admin] PATH_INFO: `/v3/users/e26f02dfeab4477a896f99af30a08a58` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:27.978021 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c5a5ff-9b4a-48ff-9f33-be3e4d94dfcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e26f02dfeab4477a896f99af30a08a58)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:27.979983 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c5a5ff-9b4a-48ff-9f33-be3e4d94dfcc admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:28.176313 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a8c5a5ff-9b4a-48ff-9f33-be3e4d94dfcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e26f02dfeab4477a896f99af30a08a58'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:28.177035 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a8c5a5ff-9b4a-48ff-9f33-be3e4d94dfcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e26f02dfeab4477a896f99af30a08a58'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:28.177645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a8c5a5ff-9b4a-48ff-9f33-be3e4d94dfcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e26f02dfeab4477a896f99af30a08a58'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:28.250355 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a8c5a5ff-9b4a-48ff-9f33-be3e4d94dfcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e26f02dfeab4477a896f99af30a08a58'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:28.267687 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a8c5a5ff-9b4a-48ff-9f33-be3e4d94dfcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e26f02dfeab4477a896f99af30a08a58'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:28.298923 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1190/2398] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:06:27 2022] DELETE /identity/v3/users/e26f02dfeab4477a896f99af30a08a58 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:06:28.307334 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23911c-5fcc-4d1f-98ca-3368c8e5be50 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:28.310399 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23911c-5fcc-4d1f-98ca-3368c8e5be50 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:28.310906 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23911c-5fcc-4d1f-98ca-3368c8e5be50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:28.336114 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-fb23911c-5fcc-4d1f-98ca-3368c8e5be50 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:06:28.337393 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-fb23911c-5fcc-4d1f-98ca-3368c8e5be50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:06:28.386183 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:28.426964 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1209/2399] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:06:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:06:28.437133 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5a5ff-9b4a-48ff-9f33-be3e4d94dfcc admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:28.438742 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-a8c5a5ff-9b4a-48ff-9f33-be3e4d94dfcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:06:28.507738 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5a5ff-9b4a-48ff-9f33-be3e4d94dfcc admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:28.511978 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08354a-fe3b-41ac-acc3-fc6126b45c6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:28.513923 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08354a-fe3b-41ac-acc3-fc6126b45c6e service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:28.513923 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08354a-fe3b-41ac-acc3-fc6126b45c6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:28.513923 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08354a-fe3b-41ac-acc3-fc6126b45c6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:28.525388 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08354a-fe3b-41ac-acc3-fc6126b45c6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:28.527206 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08354a-fe3b-41ac-acc3-fc6126b45c6e service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:28.542918 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1191/2400] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:06:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:06:29.047613 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23911c-5fcc-4d1f-98ca-3368c8e5be50 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:29.050464 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-fb23911c-5fcc-4d1f-98ca-3368c8e5be50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:06:29.063348 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23911c-5fcc-4d1f-98ca-3368c8e5be50 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:29.069628 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ddac8-418e-404c-84a2-efb6617b5e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:29.071170 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ddac8-418e-404c-84a2-efb6617b5e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:29.071527 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ddac8-418e-404c-84a2-efb6617b5e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:29.071882 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ddac8-418e-404c-84a2-efb6617b5e01 admin admin] PATH_INFO: `/v3/projects/383124a8825f4e6da07887dc494023cf` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:29.073268 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ddac8-418e-404c-84a2-efb6617b5e01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=383124a8825f4e6da07887dc494023cf)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:29.075403 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ddac8-418e-404c-84a2-efb6617b5e01 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:29.182322 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-3e9ddac8-418e-404c-84a2-efb6617b5e01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '383124a8825f4e6da07887dc494023cf', 'request_id': 'req-3e9ddac8-418e-404c-84a2-efb6617b5e01'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:29.247905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-3e9ddac8-418e-404c-84a2-efb6617b5e01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '383124a8825f4e6da07887dc494023cf', 'request_id': 'req-3e9ddac8-418e-404c-84a2-efb6617b5e01'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:29.257860 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-3e9ddac8-418e-404c-84a2-efb6617b5e01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '383124a8825f4e6da07887dc494023cf', 'request_id': 'req-3e9ddac8-418e-404c-84a2-efb6617b5e01'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:29.265857 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-3e9ddac8-418e-404c-84a2-efb6617b5e01 admin admin] The token cache is being invalidate because project 383124a8825f4e6da07887dc494023cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:06:29.266148 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-3e9ddac8-418e-404c-84a2-efb6617b5e01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:29.266885 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-3e9ddac8-418e-404c-84a2-efb6617b5e01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:06:29.268524 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1210/2401] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:06:29 2022] DELETE /identity/v3/projects/383124a8825f4e6da07887dc494023cf => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:06:29.273604 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bc101-3653-487f-b0d9-745014e88b5b None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:29.274032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bc101-3653-487f-b0d9-745014e88b5b None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:29.274137 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bc101-3653-487f-b0d9-745014e88b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:29.294701 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-b01bc101-3653-487f-b0d9-745014e88b5b None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:06:29.296093 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-b01bc101-3653-487f-b0d9-745014e88b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:06:29.358175 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1192/2402] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:06:29.366682 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c6ee1-93f1-44ec-a153-621819a2d1ca None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:29.367328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c6ee1-93f1-44ec-a153-621819a2d1ca None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:29.367328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c6ee1-93f1-44ec-a153-621819a2d1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:29.387282 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-5d3c6ee1-93f1-44ec-a153-621819a2d1ca None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:06:29.392259 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-5d3c6ee1-93f1-44ec-a153-621819a2d1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:06:29.396933 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1211/2403] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:06:29.401214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bc101-3653-487f-b0d9-745014e88b5b None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:29.411905 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bc101-3653-487f-b0d9-745014e88b5b None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:29.416893 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05f674-faf5-40a5-a235-5a69cd49c3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:29.417485 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05f674-faf5-40a5-a235-5a69cd49c3af admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:29.417770 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05f674-faf5-40a5-a235-5a69cd49c3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:29.418044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05f674-faf5-40a5-a235-5a69cd49c3af admin admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:29.418688 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05f674-faf5-40a5-a235-5a69cd49c3af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:06:29.419033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05f674-faf5-40a5-a235-5a69cd49c3af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:29.420680 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05f674-faf5-40a5-a235-5a69cd49c3af admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:29.434695 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1193/2404] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:06:29.439099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c6ee1-93f1-44ec-a153-621819a2d1ca None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:29.449677 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c6ee1-93f1-44ec-a153-621819a2d1ca None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:29.455508 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78a931-0a12-494c-9bf9-4691c18e6641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:29.456124 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78a931-0a12-494c-9bf9-4691c18e6641 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:29.456391 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78a931-0a12-494c-9bf9-4691c18e6641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:29.456700 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78a931-0a12-494c-9bf9-4691c18e6641 admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:29.457335 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78a931-0a12-494c-9bf9-4691c18e6641 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:29.459314 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78a931-0a12-494c-9bf9-4691c18e6641 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:29.576510 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1212/2405] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:06:29 2022] POST /identity/v3/projects => generated 363 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:06:29.581543 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05f674-faf5-40a5-a235-5a69cd49c3af admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:29.586775 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:29.592198 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05f674-faf5-40a5-a235-5a69cd49c3af admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:29.654399 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d5257-e43a-4f56-95a4-42e78d6a3aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:29.656369 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d5257-e43a-4f56-95a4-42e78d6a3aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:29.656369 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d5257-e43a-4f56-95a4-42e78d6a3aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:29.656721 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d5257-e43a-4f56-95a4-42e78d6a3aa2 admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:29.657102 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d5257-e43a-4f56-95a4-42e78d6a3aa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:29.659885 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d5257-e43a-4f56-95a4-42e78d6a3aa2 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:29.745889 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1194/2406] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:06:29 2022] POST /identity/v3/users => generated 282 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:06:29.750142 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78a931-0a12-494c-9bf9-4691c18e6641 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:29.760592 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78a931-0a12-494c-9bf9-4691c18e6641 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:29.766315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17540042-8d2a-4f44-aa1c-4e28540b376c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:29.766315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17540042-8d2a-4f44-aa1c-4e28540b376c admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:29.766315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17540042-8d2a-4f44-aa1c-4e28540b376c admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:29.766637 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17540042-8d2a-4f44-aa1c-4e28540b376c admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:29.767542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17540042-8d2a-4f44-aa1c-4e28540b376c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:29.769305 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17540042-8d2a-4f44-aa1c-4e28540b376c admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:29.779172 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1213/2407] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:06:29.783318 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d5257-e43a-4f56-95a4-42e78d6a3aa2 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:29.794458 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d5257-e43a-4f56-95a4-42e78d6a3aa2 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:29.800097 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e11e4-a0e9-4ad6-a25e-5326d022ced5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:29.800730 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e11e4-a0e9-4ad6-a25e-5326d022ced5 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:29.800949 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e11e4-a0e9-4ad6-a25e-5326d022ced5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:29.801349 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e11e4-a0e9-4ad6-a25e-5326d022ced5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:29.801963 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e11e4-a0e9-4ad6-a25e-5326d022ced5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:29.803551 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e11e4-a0e9-4ad6-a25e-5326d022ced5 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:29.815832 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1195/2408] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:06:29.819678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17540042-8d2a-4f44-aa1c-4e28540b376c admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:29.829768 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17540042-8d2a-4f44-aa1c-4e28540b376c admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:29.834621 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a3d66-c012-4d8e-b34e-745498e5bff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:29.835278 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a3d66-c012-4d8e-b34e-745498e5bff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:29.835560 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a3d66-c012-4d8e-b34e-745498e5bff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:29.835837 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a3d66-c012-4d8e-b34e-745498e5bff5 admin admin] PATH_INFO: `/v3/projects/93675e42672b42118476e9ee846cf7f0/users/b2e0efb2781c4f1aa2c84f88b1c2bda1/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:29.852881 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a3d66-c012-4d8e-b34e-745498e5bff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93675e42672b42118476e9ee846cf7f0, user_id=b2e0efb2781c4f1aa2c84f88b1c2bda1, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:29.856208 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a3d66-c012-4d8e-b34e-745498e5bff5 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:29.931389 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1214/2409] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:06:29 2022] PUT /identity/v3/projects/93675e42672b42118476e9ee846cf7f0/users/b2e0efb2781c4f1aa2c84f88b1c2bda1/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:06:29.942686 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748a7ff-ad09-45df-8c42-6f8dff5f7c30 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:29.943060 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748a7ff-ad09-45df-8c42-6f8dff5f7c30 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:29.943401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748a7ff-ad09-45df-8c42-6f8dff5f7c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:29.974254 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-7748a7ff-ad09-45df-8c42-6f8dff5f7c30 None None] MFA Rules not processed for user `b2e0efb2781c4f1aa2c84f88b1c2bda1`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:06:29.975596 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-7748a7ff-ad09-45df-8c42-6f8dff5f7c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:06:30.040229 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1196/2410] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:06:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:06:30.052787 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a3d66-c012-4d8e-b34e-745498e5bff5 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:30.054512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-134a3d66-c012-4d8e-b34e-745498e5bff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:06:30.119328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a3d66-c012-4d8e-b34e-745498e5bff5 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:30.124149 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07305b-2ac0-4619-8198-2f3464e47f9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:30.124795 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07305b-2ac0-4619-8198-2f3464e47f9b service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:30.125089 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07305b-2ac0-4619-8198-2f3464e47f9b service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:30.125349 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07305b-2ac0-4619-8198-2f3464e47f9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:30.133350 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:30.136111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07305b-2ac0-4619-8198-2f3464e47f9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:30.137843 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07305b-2ac0-4619-8198-2f3464e47f9b service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:30.149997 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1215/2411] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:06:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:06:34.650110 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57be03-a3ea-48e0-88bd-d8b83045b03c None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:34.650110 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57be03-a3ea-48e0-88bd-d8b83045b03c None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:34.650110 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57be03-a3ea-48e0-88bd-d8b83045b03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:34.672504 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-cf57be03-a3ea-48e0-88bd-d8b83045b03c None None] MFA Rules not processed for user `d7e96891e45f427db01549f082d3f808`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:06:34.674541 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-cf57be03-a3ea-48e0-88bd-d8b83045b03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:06:34.746532 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1197/2412] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:06:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:06:40.283722 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=2 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:44.735157 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=90,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:48.632051 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb21c7-1749-4e48-a5f7-6c3f55bc6331 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:48.632744 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb21c7-1749-4e48-a5f7-6c3f55bc6331 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:48.632744 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb21c7-1749-4e48-a5f7-6c3f55bc6331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:48.654698 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-5bfb21c7-1749-4e48-a5f7-6c3f55bc6331 None None] MFA Rules not processed for user `eaf3821dd57a4d8f9ca6385c202bb0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:06:48.655946 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-5bfb21c7-1749-4e48-a5f7-6c3f55bc6331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:06:48.715934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1216/2413] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 24 16:06:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:06:48.873742 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57be03-a3ea-48e0-88bd-d8b83045b03c None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:06:48.875162 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-cf57be03-a3ea-48e0-88bd-d8b83045b03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:06:48.947960 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57be03-a3ea-48e0-88bd-d8b83045b03c None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:06:48.952901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb95b9-5c57-476a-95d9-07dc2a8597ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a0a84e4c4e47fc930881109fc07039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:06:48.953504 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb95b9-5c57-476a-95d9-07dc2a8597ed service swift] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:06:48.953781 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb95b9-5c57-476a-95d9-07dc2a8597ed service swift] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:06:48.954047 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb95b9-5c57-476a-95d9-07dc2a8597ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:06:48.964852 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb95b9-5c57-476a-95d9-07dc2a8597ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:06:48.966463 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb95b9-5c57-476a-95d9-07dc2a8597ed service swift] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:06:48.977192 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1198/2414] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 24 16:06:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:06:58.708430 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=25 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:58.973725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=32 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:07:12.587710 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad63fe-2209-4b95-8e53-f26fa8a76b99 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:07:12.588228 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad63fe-2209-4b95-8e53-f26fa8a76b99 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:07:12.588228 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad63fe-2209-4b95-8e53-f26fa8a76b99 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:07:12.589718 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1217/2415] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 24 16:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:07:12.595490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e7d5d-0584-4fbd-9e81-dfffaeb56fad None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:07:12.596021 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e7d5d-0584-4fbd-9e81-dfffaeb56fad None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:07:12.596123 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e7d5d-0584-4fbd-9e81-dfffaeb56fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:07:12.616886 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-3c2e7d5d-0584-4fbd-9e81-dfffaeb56fad None None] MFA Rules not processed for user `e5f0d8fe42e74d68bfa9a0e365bab4b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:07:12.618287 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-3c2e7d5d-0584-4fbd-9e81-dfffaeb56fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:07:12.689301 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1199/2416] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 24 16:07:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:07:12.702571 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad63fe-2209-4b95-8e53-f26fa8a76b99 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:07:12.704305 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-74ad63fe-2209-4b95-8e53-f26fa8a76b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:07:12.762275 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad63fe-2209-4b95-8e53-f26fa8a76b99 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:07:12.765892 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61295c5-c075-4284-b5a8-2a3a98b4fa63 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21fda517a384dc5a6a9f36d68ac1a2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:07:12.766489 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61295c5-c075-4284-b5a8-2a3a98b4fa63 service glance] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:07:12.766767 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61295c5-c075-4284-b5a8-2a3a98b4fa63 service glance] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:07:12.767035 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61295c5-c075-4284-b5a8-2a3a98b4fa63 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:07:12.779482 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61295c5-c075-4284-b5a8-2a3a98b4fa63 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:07:12.781021 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61295c5-c075-4284-b5a8-2a3a98b4fa63 service glance] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:07:12.791901 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1218/2417] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:07:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:07:13.031448 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66abe10-3b59-4855-a428-47a59d6cd64e None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:07:13.031448 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66abe10-3b59-4855-a428-47a59d6cd64e None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:07:13.031448 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66abe10-3b59-4855-a428-47a59d6cd64e None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:07:13.031448 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1200/2418] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 24 16:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:07:13.036250 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebecef8-2a0c-4769-98b7-f27cb35dbdb6 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:07:13.036769 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebecef8-2a0c-4769-98b7-f27cb35dbdb6 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:07:13.037185 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebecef8-2a0c-4769-98b7-f27cb35dbdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:07:13.059548 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-eebecef8-2a0c-4769-98b7-f27cb35dbdb6 None None] MFA Rules not processed for user `80f7e6f1af76404096d4c717cbcf20f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:07:13.061049 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-eebecef8-2a0c-4769-98b7-f27cb35dbdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:07:13.115461 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1219/2419] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 24 16:07:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:07:13.128069 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66abe10-3b59-4855-a428-47a59d6cd64e None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:07:13.129861 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e66abe10-3b59-4855-a428-47a59d6cd64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:07:13.144159 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66abe10-3b59-4855-a428-47a59d6cd64e None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:07:13.147854 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e958fc-4e4e-4fa8-81c7-b292f1f8f3ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:07:13.148406 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e958fc-4e4e-4fa8-81c7-b292f1f8f3ea service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:07:13.148722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e958fc-4e4e-4fa8-81c7-b292f1f8f3ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:07:13.148997 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e958fc-4e4e-4fa8-81c7-b292f1f8f3ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:07:13.156518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e958fc-4e4e-4fa8-81c7-b292f1f8f3ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:07:13.158063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e958fc-4e4e-4fa8-81c7-b292f1f8f3ea service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:07:13.165851 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1201/2420] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:07:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:07:13.251728 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea89d1-e714-4b8d-8813-5267a36c04c3 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:07:13.252012 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea89d1-e714-4b8d-8813-5267a36c04c3 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:07:13.252306 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea89d1-e714-4b8d-8813-5267a36c04c3 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:07:13.253716 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1220/2421] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 24 16:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:07:13.264893 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5c6b5-4e9e-4178-aba7-c3223f9b9573 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:07:13.265176 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5c6b5-4e9e-4178-aba7-c3223f9b9573 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:07:13.265446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5c6b5-4e9e-4178-aba7-c3223f9b9573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:07:13.285612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-47e5c6b5-4e9e-4178-aba7-c3223f9b9573 None None] MFA Rules not processed for user `e5f0d8fe42e74d68bfa9a0e365bab4b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:07:13.289408 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-47e5c6b5-4e9e-4178-aba7-c3223f9b9573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:07:13.297064 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1202/2422] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 24 16:07:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:07:13.307717 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea89d1-e714-4b8d-8813-5267a36c04c3 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:07:13.319238 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea89d1-e714-4b8d-8813-5267a36c04c3 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:07:13.322995 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4178e8-7745-44c7-a3d7-98c3ca1fd4fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:07:13.323742 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4178e8-7745-44c7-a3d7-98c3ca1fd4fa service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:07:13.324062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4178e8-7745-44c7-a3d7-98c3ca1fd4fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:07:13.324338 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4178e8-7745-44c7-a3d7-98c3ca1fd4fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:07:13.334831 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4178e8-7745-44c7-a3d7-98c3ca1fd4fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:07:13.336257 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4178e8-7745-44c7-a3d7-98c3ca1fd4fa service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:07:13.347143 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1221/2423] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:07:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:07:17.056505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4b20e-6888-40ad-9a9a-bc018d028eaa None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:07:17.057011 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4b20e-6888-40ad-9a9a-bc018d028eaa None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:07:17.057109 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4b20e-6888-40ad-9a9a-bc018d028eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:07:17.076726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-7bb4b20e-6888-40ad-9a9a-bc018d028eaa None None] MFA Rules not processed for user `eaf3821dd57a4d8f9ca6385c202bb0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:07:17.077942 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-7bb4b20e-6888-40ad-9a9a-bc018d028eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:07:17.085124 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1203/2424] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 24 16:07:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:07:17.097072 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4178e8-7745-44c7-a3d7-98c3ca1fd4fa service neutron] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:07:17.109051 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4178e8-7745-44c7-a3d7-98c3ca1fd4fa service neutron] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:07:17.113905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53df1bb-19b5-441f-95ba-129092f805a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a0a84e4c4e47fc930881109fc07039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:07:17.114491 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53df1bb-19b5-441f-95ba-129092f805a4 service swift] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:07:17.114772 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53df1bb-19b5-441f-95ba-129092f805a4 service swift] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:07:17.115043 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53df1bb-19b5-441f-95ba-129092f805a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:07:17.124032 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53df1bb-19b5-441f-95ba-129092f805a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:07:17.125666 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53df1bb-19b5-441f-95ba-129092f805a4 service swift] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:07:17.133588 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1222/2425] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 24 16:07:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:07:27.071908 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=43 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:07:27.130544 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=61 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:07:27.356726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4b20e-6888-40ad-9a9a-bc018d028eaa None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:07:27.426691 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4b20e-6888-40ad-9a9a-bc018d028eaa None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:07:27.431591 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5811b-63b4-4ae8-9d4a-782d0c1bf466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:07:27.432235 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5811b-63b4-4ae8-9d4a-782d0c1bf466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:07:27.432678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5811b-63b4-4ae8-9d4a-782d0c1bf466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:07:27.432961 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5811b-63b4-4ae8-9d4a-782d0c1bf466 admin admin] PATH_INFO: `/v3/users/b2e0efb2781c4f1aa2c84f88b1c2bda1` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:07:27.434111 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5811b-63b4-4ae8-9d4a-782d0c1bf466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2e0efb2781c4f1aa2c84f88b1c2bda1)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:07:27.436420 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5811b-63b4-4ae8-9d4a-782d0c1bf466 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:07:27.636561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-b6e5811b-63b4-4ae8-9d4a-782d0c1bf466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2e0efb2781c4f1aa2c84f88b1c2bda1'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:07:27.639047 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-b6e5811b-63b4-4ae8-9d4a-782d0c1bf466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2e0efb2781c4f1aa2c84f88b1c2bda1'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:07:27.639678 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-b6e5811b-63b4-4ae8-9d4a-782d0c1bf466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2e0efb2781c4f1aa2c84f88b1c2bda1'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:07:27.730106 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-b6e5811b-63b4-4ae8-9d4a-782d0c1bf466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2e0efb2781c4f1aa2c84f88b1c2bda1'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:07:27.738578 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-b6e5811b-63b4-4ae8-9d4a-782d0c1bf466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2e0efb2781c4f1aa2c84f88b1c2bda1'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:07:27.759266 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1204/2426] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:07:27 2022] DELETE /identity/v3/users/b2e0efb2781c4f1aa2c84f88b1c2bda1 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:07:27.764807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cdc86-974b-4fc4-a038-757e70e768b8 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:07:27.770822 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cdc86-974b-4fc4-a038-757e70e768b8 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:07:27.770822 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cdc86-974b-4fc4-a038-757e70e768b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:07:27.786197 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-f68cdc86-974b-4fc4-a038-757e70e768b8 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:07:27.787573 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-f68cdc86-974b-4fc4-a038-757e70e768b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:07:27.857898 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1223/2427] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:07:27.868655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5811b-63b4-4ae8-9d4a-782d0c1bf466 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:07:27.870103 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-b6e5811b-63b4-4ae8-9d4a-782d0c1bf466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:07:27.937773 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5811b-63b4-4ae8-9d4a-782d0c1bf466 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:07:27.942732 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9bb4c-98a7-4e44-9a69-28c6df9ecca6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:07:27.946161 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9bb4c-98a7-4e44-9a69-28c6df9ecca6 service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:07:27.946161 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9bb4c-98a7-4e44-9a69-28c6df9ecca6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:07:27.946161 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9bb4c-98a7-4e44-9a69-28c6df9ecca6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:07:27.955088 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9bb4c-98a7-4e44-9a69-28c6df9ecca6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:07:27.957166 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9bb4c-98a7-4e44-9a69-28c6df9ecca6 service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:07:27.967780 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1205/2428] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:07:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:07:28.401792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cdc86-974b-4fc4-a038-757e70e768b8 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:07:28.403498 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-f68cdc86-974b-4fc4-a038-757e70e768b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:07:28.416481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cdc86-974b-4fc4-a038-757e70e768b8 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:07:28.421654 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b696416-4609-49ca-bc4b-b4a04b699e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:07:28.422298 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b696416-4609-49ca-bc4b-b4a04b699e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:07:28.422583 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b696416-4609-49ca-bc4b-b4a04b699e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:07:28.422857 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b696416-4609-49ca-bc4b-b4a04b699e6f admin admin] PATH_INFO: `/v3/projects/93675e42672b42118476e9ee846cf7f0` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:07:28.424648 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b696416-4609-49ca-bc4b-b4a04b699e6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=93675e42672b42118476e9ee846cf7f0)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:07:28.426636 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b696416-4609-49ca-bc4b-b4a04b699e6f admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:07:28.550878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-4b696416-4609-49ca-bc4b-b4a04b699e6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93675e42672b42118476e9ee846cf7f0', 'request_id': 'req-4b696416-4609-49ca-bc4b-b4a04b699e6f'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:07:28.597970 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-4b696416-4609-49ca-bc4b-b4a04b699e6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93675e42672b42118476e9ee846cf7f0', 'request_id': 'req-4b696416-4609-49ca-bc4b-b4a04b699e6f'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:07:28.605519 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-4b696416-4609-49ca-bc4b-b4a04b699e6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93675e42672b42118476e9ee846cf7f0', 'request_id': 'req-4b696416-4609-49ca-bc4b-b4a04b699e6f'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:07:28.617614 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-4b696416-4609-49ca-bc4b-b4a04b699e6f admin admin] The token cache is being invalidate because project 93675e42672b42118476e9ee846cf7f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:07:28.617934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-4b696416-4609-49ca-bc4b-b4a04b699e6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:07:28.618741 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-4b696416-4609-49ca-bc4b-b4a04b699e6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:07:28.631532 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1224/2429] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:07:28 2022] DELETE /identity/v3/projects/93675e42672b42118476e9ee846cf7f0 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:07:37.962832 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:07:38.614069 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:07:45.043232 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ffd0b-56cc-4ff7-8443-e57c5da5d968 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:07:45.043792 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ffd0b-56cc-4ff7-8443-e57c5da5d968 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:07:45.043792 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ffd0b-56cc-4ff7-8443-e57c5da5d968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:07:45.063636 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-248ffd0b-56cc-4ff7-8443-e57c5da5d968 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:07:45.064972 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-248ffd0b-56cc-4ff7-8443-e57c5da5d968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:07:45.124449 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1206/2430] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Aug 24 16:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:07:45.138837 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b696416-4609-49ca-bc4b-b4a04b699e6f admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:07:45.140291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-4b696416-4609-49ca-bc4b-b4a04b699e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:07:45.215095 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b696416-4609-49ca-bc4b-b4a04b699e6f admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:07:45.220647 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29a160-3334-4f27-af39-ea4f85646cc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:07:45.221255 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29a160-3334-4f27-af39-ea4f85646cc8 service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:07:45.221537 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29a160-3334-4f27-af39-ea4f85646cc8 service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:07:45.221810 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29a160-3334-4f27-af39-ea4f85646cc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:07:45.230978 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29a160-3334-4f27-af39-ea4f85646cc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:07:45.232593 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29a160-3334-4f27-af39-ea4f85646cc8 service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:07:45.243022 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1225/2431] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:07:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:07:46.768751 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bdf4c-e9aa-41ee-800e-17b3eac84be0 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:07:46.769256 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bdf4c-e9aa-41ee-800e-17b3eac84be0 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:07:46.769358 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bdf4c-e9aa-41ee-800e-17b3eac84be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:07:46.789035 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-1b1bdf4c-e9aa-41ee-800e-17b3eac84be0 None None] MFA Rules not processed for user `eaf3821dd57a4d8f9ca6385c202bb0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:07:46.790226 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-1b1bdf4c-e9aa-41ee-800e-17b3eac84be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:07:46.848605 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1207/2432] 10.222.0.64 () {58 vars in 967 bytes} [Wed Aug 24 16:07:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:07:46.860980 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29a160-3334-4f27-af39-ea4f85646cc8 service nova] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:07:46.862355 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-bc29a160-3334-4f27-af39-ea4f85646cc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:07:46.933630 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29a160-3334-4f27-af39-ea4f85646cc8 service nova] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:07:46.938695 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e3191-ba61-49bd-af56-70d3120ca95f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a0a84e4c4e47fc930881109fc07039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:07:46.939296 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e3191-ba61-49bd-af56-70d3120ca95f service swift] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:07:46.939573 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e3191-ba61-49bd-af56-70d3120ca95f service swift] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:07:46.939844 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e3191-ba61-49bd-af56-70d3120ca95f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:07:46.948867 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e3191-ba61-49bd-af56-70d3120ca95f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:07:46.950463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e3191-ba61-49bd-af56-70d3120ca95f service swift] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:07:46.959017 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1226/2433] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 24 16:07:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:07:51.617282 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ba206-494d-4581-857a-9e3e0a3304f1 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:07:51.617859 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ba206-494d-4581-857a-9e3e0a3304f1 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:07:51.617859 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ba206-494d-4581-857a-9e3e0a3304f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:07:51.638395 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-850ba206-494d-4581-857a-9e3e0a3304f1 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:07:51.639665 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-850ba206-494d-4581-857a-9e3e0a3304f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:07:51.648344 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1208/2434] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Aug 24 16:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:07:51.662972 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e3191-ba61-49bd-af56-70d3120ca95f service swift] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:07:51.664405 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-566e3191-ba61-49bd-af56-70d3120ca95f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:07:51.679767 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e3191-ba61-49bd-af56-70d3120ca95f service swift] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:07:51.685236 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954e451-562a-4aba-b84e-81ff16a5a117 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:07:51.685858 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954e451-562a-4aba-b84e-81ff16a5a117 service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:07:51.686144 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954e451-562a-4aba-b84e-81ff16a5a117 service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:07:51.686416 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954e451-562a-4aba-b84e-81ff16a5a117 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:07:51.695078 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b954e451-562a-4aba-b84e-81ff16a5a117 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:07:51.696702 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b954e451-562a-4aba-b84e-81ff16a5a117 service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:07:51.706056 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1227/2435] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:07:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:07:55.950657 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635c83c-8c2c-498a-a1c5-aa459c5ca3cb None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:07:55.951222 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635c83c-8c2c-498a-a1c5-aa459c5ca3cb None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:07:55.951222 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635c83c-8c2c-498a-a1c5-aa459c5ca3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:07:55.970691 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-d635c83c-8c2c-498a-a1c5-aa459c5ca3cb None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:07:55.971904 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-d635c83c-8c2c-498a-a1c5-aa459c5ca3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:07:55.980680 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1209/2436] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Aug 24 16:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:07:55.998249 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954e451-562a-4aba-b84e-81ff16a5a117 service nova] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:07:56.009951 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954e451-562a-4aba-b84e-81ff16a5a117 service nova] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:07:56.015357 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64939fb1-5ddc-4222-887e-5a258834019c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:07:56.015944 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64939fb1-5ddc-4222-887e-5a258834019c service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:07:56.016221 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64939fb1-5ddc-4222-887e-5a258834019c service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:07:56.016601 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64939fb1-5ddc-4222-887e-5a258834019c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:07:56.024971 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64939fb1-5ddc-4222-887e-5a258834019c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:07:56.026540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64939fb1-5ddc-4222-887e-5a258834019c service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:07:56.035989 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1228/2437] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:07:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:08:00.885067 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f62d34-c9d3-449f-895d-ce96e3da5969 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:08:00.885586 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f62d34-c9d3-449f-895d-ce96e3da5969 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:08:00.885715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f62d34-c9d3-449f-895d-ce96e3da5969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:08:00.905211 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-84f62d34-c9d3-449f-895d-ce96e3da5969 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:08:00.906411 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-84f62d34-c9d3-449f-895d-ce96e3da5969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:08:00.914202 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1210/2438] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Aug 24 16:08:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:08:00.929934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64939fb1-5ddc-4222-887e-5a258834019c service nova] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:08:00.941133 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64939fb1-5ddc-4222-887e-5a258834019c service nova] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:08:00.946630 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8cb32-2384-4b1a-a4f7-60e4b82252e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:08:00.947223 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8cb32-2384-4b1a-a4f7-60e4b82252e5 service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:08:00.947507 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8cb32-2384-4b1a-a4f7-60e4b82252e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:08:00.947781 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8cb32-2384-4b1a-a4f7-60e4b82252e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:08:00.956135 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8cb32-2384-4b1a-a4f7-60e4b82252e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:08:00.957769 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8cb32-2384-4b1a-a4f7-60e4b82252e5 service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:08:00.968142 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1229/2439] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:08:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:08:06.176302 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b5365-6a0d-45b0-bf56-c2abbe2aad7b None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:08:06.176808 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b5365-6a0d-45b0-bf56-c2abbe2aad7b None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:08:06.176925 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b5365-6a0d-45b0-bf56-c2abbe2aad7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:08:06.197017 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-ad6b5365-6a0d-45b0-bf56-c2abbe2aad7b None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:08:06.198246 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-ad6b5365-6a0d-45b0-bf56-c2abbe2aad7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:08:06.206822 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1211/2440] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Aug 24 16:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:08:06.234205 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8cb32-2384-4b1a-a4f7-60e4b82252e5 service nova] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:08:06.241872 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8cb32-2384-4b1a-a4f7-60e4b82252e5 service nova] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:08:06.248092 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc486012-67be-4de8-8e45-f263d731e230 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:08:06.248654 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc486012-67be-4de8-8e45-f263d731e230 service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:08:06.248934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc486012-67be-4de8-8e45-f263d731e230 service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:08:06.249206 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc486012-67be-4de8-8e45-f263d731e230 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:08:06.257684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc486012-67be-4de8-8e45-f263d731e230 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:08:06.259330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc486012-67be-4de8-8e45-f263d731e230 service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:08:06.268858 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1230/2441] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:08:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:08:10.447960 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736c54e-4ac3-4de6-bedf-f52dcc8ca2ce None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:08:10.448429 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736c54e-4ac3-4de6-bedf-f52dcc8ca2ce None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:08:10.448540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736c54e-4ac3-4de6-bedf-f52dcc8ca2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:08:10.456077 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=65 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:08:10.468889 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-8736c54e-4ac3-4de6-bedf-f52dcc8ca2ce None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:08:10.470138 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-8736c54e-4ac3-4de6-bedf-f52dcc8ca2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:08:10.477888 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1212/2442] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Aug 24 16:08:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:08:10.498332 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc486012-67be-4de8-8e45-f263d731e230 service nova] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:08:10.508058 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=91 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:08:10.510573 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc486012-67be-4de8-8e45-f263d731e230 service nova] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:08:10.516196 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346ad20-8f77-47a0-8dc3-ddf86507c57b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:08:10.516828 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346ad20-8f77-47a0-8dc3-ddf86507c57b service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:08:10.517112 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346ad20-8f77-47a0-8dc3-ddf86507c57b service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:08:10.517386 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346ad20-8f77-47a0-8dc3-ddf86507c57b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:08:10.526243 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346ad20-8f77-47a0-8dc3-ddf86507c57b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:08:10.528365 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346ad20-8f77-47a0-8dc3-ddf86507c57b service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:08:10.537932 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1231/2443] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:08:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:08:14.636582 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736c54e-4ac3-4de6-bedf-f52dcc8ca2ce None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:08:14.638065 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-8736c54e-4ac3-4de6-bedf-f52dcc8ca2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:08:14.693463 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736c54e-4ac3-4de6-bedf-f52dcc8ca2ce None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:08:14.697107 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e99f1-2c2e-4c54-89d7-adcbae23f08b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:08:14.698228 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e99f1-2c2e-4c54-89d7-adcbae23f08b service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:08:14.698504 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e99f1-2c2e-4c54-89d7-adcbae23f08b service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:08:14.698773 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e99f1-2c2e-4c54-89d7-adcbae23f08b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:08:14.700475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-a13e99f1-2c2e-4c54-89d7-adcbae23f08b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:08:14.714037 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e99f1-2c2e-4c54-89d7-adcbae23f08b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:08:14.715449 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e99f1-2c2e-4c54-89d7-adcbae23f08b service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:08:14.726121 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1213/2444] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:08:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:08:17.677241 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346ad20-8f77-47a0-8dc3-ddf86507c57b service nova] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:08:17.678754 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-c346ad20-8f77-47a0-8dc3-ddf86507c57b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:08:17.736270 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346ad20-8f77-47a0-8dc3-ddf86507c57b service nova] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:08:17.739859 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a97a7-c9b5-4b2e-89fe-3e21f7a42219 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:08:17.740456 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a97a7-c9b5-4b2e-89fe-3e21f7a42219 service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:08:17.740771 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a97a7-c9b5-4b2e-89fe-3e21f7a42219 service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:08:17.741042 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a97a7-c9b5-4b2e-89fe-3e21f7a42219 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:08:17.742751 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-e11a97a7-c9b5-4b2e-89fe-3e21f7a42219 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:08:17.756371 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a97a7-c9b5-4b2e-89fe-3e21f7a42219 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:08:17.757807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a97a7-c9b5-4b2e-89fe-3e21f7a42219 service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:08:17.769412 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1232/2445] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:08:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:08:23.738690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e99f1-2c2e-4c54-89d7-adcbae23f08b service cinder] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:08:23.751188 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e99f1-2c2e-4c54-89d7-adcbae23f08b service cinder] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:08:23.757182 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45149da-63bb-4c21-a3c4-8af9788f24c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:08:23.757921 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45149da-63bb-4c21-a3c4-8af9788f24c3 service nova] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:08:23.758062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45149da-63bb-4c21-a3c4-8af9788f24c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:08:23.758338 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45149da-63bb-4c21-a3c4-8af9788f24c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:08:23.760080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-d45149da-63bb-4c21-a3c4-8af9788f24c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:08:23.820778 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45149da-63bb-4c21-a3c4-8af9788f24c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:08:23.822350 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45149da-63bb-4c21-a3c4-8af9788f24c3 service nova] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:08:23.831214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1214/2446] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:08:23 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:08:27.764538 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=31 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:08:29.034046 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92ca77-bddd-4069-8a13-5ff880bf0105 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:08:29.034653 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92ca77-bddd-4069-8a13-5ff880bf0105 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:08:29.034653 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92ca77-bddd-4069-8a13-5ff880bf0105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:08:29.055796 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-fc92ca77-bddd-4069-8a13-5ff880bf0105 None None] MFA Rules not processed for user `343a476eaf33493d9a30c8f564a1afa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:08:29.057042 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-fc92ca77-bddd-4069-8a13-5ff880bf0105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:08:29.113331 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1233/2447] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:08:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:08:29.348708 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45149da-63bb-4c21-a3c4-8af9788f24c3 service nova] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:08:29.358081 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45149da-63bb-4c21-a3c4-8af9788f24c3 service nova] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:08:29.362193 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba38b1-0c6d-4fca-b18e-549d675640ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:08:29.362784 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba38b1-0c6d-4fca-b18e-549d675640ba service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:08:29.363059 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba38b1-0c6d-4fca-b18e-549d675640ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:08:29.363329 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba38b1-0c6d-4fca-b18e-549d675640ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:08:29.365049 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-7eba38b1-0c6d-4fca-b18e-549d675640ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:08:29.374569 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba38b1-0c6d-4fca-b18e-549d675640ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:08:29.375983 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba38b1-0c6d-4fca-b18e-549d675640ba service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:08:29.384594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1215/2448] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:08:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:08:29.824759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92ca77-bddd-4069-8a13-5ff880bf0105 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:08:29.826379 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-fc92ca77-bddd-4069-8a13-5ff880bf0105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:08:29.898770 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92ca77-bddd-4069-8a13-5ff880bf0105 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:08:29.903739 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf7973-bc36-43b6-bf6a-f5a091c00d22 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6907dfd3254d3c97d07ca2fb648858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:08:29.904372 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf7973-bc36-43b6-bf6a-f5a091c00d22 service placement] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:08:29.904667 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf7973-bc36-43b6-bf6a-f5a091c00d22 service placement] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:08:29.904988 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf7973-bc36-43b6-bf6a-f5a091c00d22 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:08:29.906857 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-5bdf7973-bc36-43b6-bf6a-f5a091c00d22 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:08:29.918557 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf7973-bc36-43b6-bf6a-f5a091c00d22 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:08:29.920202 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf7973-bc36-43b6-bf6a-f5a091c00d22 service placement] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:08:29.930265 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1234/2449] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:08:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:08:32.933252 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba38b1-0c6d-4fca-b18e-549d675640ba service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:08:32.942484 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba38b1-0c6d-4fca-b18e-549d675640ba service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:08:32.946227 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c48cef-7145-4bbc-8203-db7dbaca28ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:08:32.946826 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c48cef-7145-4bbc-8203-db7dbaca28ff service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:08:32.947106 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c48cef-7145-4bbc-8203-db7dbaca28ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:08:32.947377 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c48cef-7145-4bbc-8203-db7dbaca28ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:08:32.949179 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-29c48cef-7145-4bbc-8203-db7dbaca28ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:08:32.959531 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c48cef-7145-4bbc-8203-db7dbaca28ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:08:32.961014 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c48cef-7145-4bbc-8203-db7dbaca28ff service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:08:32.969504 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1216/2450] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:08:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:08:39.926086 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=57 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:08:42.965430 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=68 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:08:44.635485 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9140c5c-814c-45a4-af28-cda2a610e9f3 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:08:44.635991 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9140c5c-814c-45a4-af28-cda2a610e9f3 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:08:44.636088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9140c5c-814c-45a4-af28-cda2a610e9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:08:44.655553 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-a9140c5c-814c-45a4-af28-cda2a610e9f3 None None] MFA Rules not processed for user `c640f4b512f748669f75f297f5bf8df9`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:08:44.656715 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-a9140c5c-814c-45a4-af28-cda2a610e9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:08:44.664314 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1235/2451] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:08:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:08:52.330433 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c48cef-7145-4bbc-8203-db7dbaca28ff service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:08:52.346292 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c48cef-7145-4bbc-8203-db7dbaca28ff service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:08:52.353245 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af899bf-3ddd-4150-a917-2f4b91c10803 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:08:52.354373 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af899bf-3ddd-4150-a917-2f4b91c10803 service nova] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:08:52.354650 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af899bf-3ddd-4150-a917-2f4b91c10803 service nova] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:08:52.354924 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af899bf-3ddd-4150-a917-2f4b91c10803 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:08:52.356772 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-3af899bf-3ddd-4150-a917-2f4b91c10803 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:08:52.370593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af899bf-3ddd-4150-a917-2f4b91c10803 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:08:52.372457 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af899bf-3ddd-4150-a917-2f4b91c10803 service nova] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:08:52.385071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1217/2452] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:08:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:08:52.508392 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d20560-45ab-42a3-919a-f75d91bea486 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:08:52.509334 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d20560-45ab-42a3-919a-f75d91bea486 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:08:52.509605 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d20560-45ab-42a3-919a-f75d91bea486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:08:52.530081 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-56d20560-45ab-42a3-919a-f75d91bea486 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:08:52.531330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-56d20560-45ab-42a3-919a-f75d91bea486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:08:52.540210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1236/2453] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Aug 24 16:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:08:52.555871 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af899bf-3ddd-4150-a917-2f4b91c10803 service nova] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:08:52.570653 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af899bf-3ddd-4150-a917-2f4b91c10803 service nova] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:08:52.580153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34982b06-b20d-48c8-ac1f-aa6aaff47938 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:08:52.585289 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34982b06-b20d-48c8-ac1f-aa6aaff47938 service nova] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:08:52.585289 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34982b06-b20d-48c8-ac1f-aa6aaff47938 service nova] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:08:52.585289 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34982b06-b20d-48c8-ac1f-aa6aaff47938 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:08:52.595436 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34982b06-b20d-48c8-ac1f-aa6aaff47938 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:08:52.598392 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34982b06-b20d-48c8-ac1f-aa6aaff47938 service nova] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:08:52.610276 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1218/2454] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:08:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:08:56.474470 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d20560-45ab-42a3-919a-f75d91bea486 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:08:56.488217 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d20560-45ab-42a3-919a-f75d91bea486 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:08:56.495391 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffc905-4b30-4aed-bcc4-8b3fc480294e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:08:56.496020 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffc905-4b30-4aed-bcc4-8b3fc480294e service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:08:56.496279 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffc905-4b30-4aed-bcc4-8b3fc480294e service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:08:56.496552 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffc905-4b30-4aed-bcc4-8b3fc480294e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:08:56.498318 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-9dffc905-4b30-4aed-bcc4-8b3fc480294e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:08:56.559703 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dffc905-4b30-4aed-bcc4-8b3fc480294e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:08:56.561343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dffc905-4b30-4aed-bcc4-8b3fc480294e service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:08:56.572241 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1237/2455] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:08:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:08:56.993895 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0311e80-3f05-49b1-93b4-968a1bb23e22 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:08:56.994489 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0311e80-3f05-49b1-93b4-968a1bb23e22 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:08:56.994489 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0311e80-3f05-49b1-93b4-968a1bb23e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:08:57.014683 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-b0311e80-3f05-49b1-93b4-968a1bb23e22 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:08:57.016015 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-b0311e80-3f05-49b1-93b4-968a1bb23e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:08:57.024151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1219/2456] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Aug 24 16:08:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:08:57.039597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffc905-4b30-4aed-bcc4-8b3fc480294e service nova] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:08:57.055195 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffc905-4b30-4aed-bcc4-8b3fc480294e service nova] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:08:57.057594 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c4381-1c4a-4fb6-bfc0-fbd35160b9ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:08:57.058199 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c4381-1c4a-4fb6-bfc0-fbd35160b9ba service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:08:57.058480 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c4381-1c4a-4fb6-bfc0-fbd35160b9ba service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:08:57.058749 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c4381-1c4a-4fb6-bfc0-fbd35160b9ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:08:57.067357 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c4381-1c4a-4fb6-bfc0-fbd35160b9ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:08:57.068966 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c4381-1c4a-4fb6-bfc0-fbd35160b9ba service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:08:57.078804 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1238/2457] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:08:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:09:01.711806 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0311e80-3f05-49b1-93b4-968a1bb23e22 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:09:01.724738 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0311e80-3f05-49b1-93b4-968a1bb23e22 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:09:01.731464 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8fc8b-7827-4f70-82e1-bf930a3b0551 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:09:01.732391 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8fc8b-7827-4f70-82e1-bf930a3b0551 service nova] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:09:01.732710 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8fc8b-7827-4f70-82e1-bf930a3b0551 service nova] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:09:01.733115 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8fc8b-7827-4f70-82e1-bf930a3b0551 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:09:01.736239 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-f0f8fc8b-7827-4f70-82e1-bf930a3b0551 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:09:01.752813 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8fc8b-7827-4f70-82e1-bf930a3b0551 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:09:01.755012 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8fc8b-7827-4f70-82e1-bf930a3b0551 service nova] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:09:01.769820 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1220/2458] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:09:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:09:03.056079 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4846a02-1f24-44b8-b321-19f3fde6140b None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:09:03.056580 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4846a02-1f24-44b8-b321-19f3fde6140b None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:09:03.056728 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4846a02-1f24-44b8-b321-19f3fde6140b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:09:03.083167 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-a4846a02-1f24-44b8-b321-19f3fde6140b None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:09:03.083167 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-a4846a02-1f24-44b8-b321-19f3fde6140b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:09:03.087191 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1239/2459] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Aug 24 16:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:09:03.105389 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8fc8b-7827-4f70-82e1-bf930a3b0551 service nova] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:09:03.116893 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8fc8b-7827-4f70-82e1-bf930a3b0551 service nova] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:09:03.122395 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ab073-65ff-4c56-b021-3531d4d3eb81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:09:03.122985 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ab073-65ff-4c56-b021-3531d4d3eb81 service nova] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:09:03.123267 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ab073-65ff-4c56-b021-3531d4d3eb81 service nova] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:09:03.123591 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ab073-65ff-4c56-b021-3531d4d3eb81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:09:03.132324 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ab073-65ff-4c56-b021-3531d4d3eb81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:09:03.133932 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ab073-65ff-4c56-b021-3531d4d3eb81 service nova] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:09:03.143351 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1221/2460] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:09:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:09:07.396639 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4846a02-1f24-44b8-b321-19f3fde6140b None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:09:07.409514 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4846a02-1f24-44b8-b321-19f3fde6140b None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:09:07.417140 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d575634-bd70-4ced-a1be-994234d8389b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:09:07.417740 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d575634-bd70-4ced-a1be-994234d8389b service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:09:07.418020 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d575634-bd70-4ced-a1be-994234d8389b service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:09:07.418289 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d575634-bd70-4ced-a1be-994234d8389b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:09:07.419998 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-6d575634-bd70-4ced-a1be-994234d8389b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:09:07.479767 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d575634-bd70-4ced-a1be-994234d8389b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:09:07.485426 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d575634-bd70-4ced-a1be-994234d8389b service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:09:07.492860 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1240/2461] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:09:07 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:09:10.422632 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab104c2-f5da-42e1-ad79-d2d58168076f None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:09:10.423229 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab104c2-f5da-42e1-ad79-d2d58168076f None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:09:10.423229 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab104c2-f5da-42e1-ad79-d2d58168076f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:09:10.448669 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-4ab104c2-f5da-42e1-ad79-d2d58168076f None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:09:10.451539 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-4ab104c2-f5da-42e1-ad79-d2d58168076f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:09:10.457972 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1222/2462] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Aug 24 16:09:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:09:10.473142 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d575634-bd70-4ced-a1be-994234d8389b service nova] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:09:10.479567 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=72 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:09:10.485505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d575634-bd70-4ced-a1be-994234d8389b service nova] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:09:10.492141 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa285a11-cfff-432e-94d3-fb4bf85b081b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:09:10.492958 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa285a11-cfff-432e-94d3-fb4bf85b081b service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:09:10.493305 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa285a11-cfff-432e-94d3-fb4bf85b081b service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:09:10.493638 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa285a11-cfff-432e-94d3-fb4bf85b081b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:09:10.502617 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa285a11-cfff-432e-94d3-fb4bf85b081b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:09:10.504387 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa285a11-cfff-432e-94d3-fb4bf85b081b service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:09:10.515175 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1241/2463] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:09:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:09:17.775878 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f23fcd-76cd-45a0-be79-9aa7ff7fbaa6 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:09:17.776827 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f23fcd-76cd-45a0-be79-9aa7ff7fbaa6 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:09:17.777101 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f23fcd-76cd-45a0-be79-9aa7ff7fbaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:09:17.785075 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=31 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:09:17.797761 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-19f23fcd-76cd-45a0-be79-9aa7ff7fbaa6 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:09:17.798974 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-19f23fcd-76cd-45a0-be79-9aa7ff7fbaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:09:17.807080 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1223/2464] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Aug 24 16:09:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:09:17.823646 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa285a11-cfff-432e-94d3-fb4bf85b081b service nova] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:09:17.836515 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa285a11-cfff-432e-94d3-fb4bf85b081b service nova] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:09:17.843194 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e822c-8585-4350-903f-a998c56f3977 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:09:17.845343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e822c-8585-4350-903f-a998c56f3977 service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:09:17.845884 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e822c-8585-4350-903f-a998c56f3977 service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:09:17.846282 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e822c-8585-4350-903f-a998c56f3977 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:09:17.855748 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e822c-8585-4350-903f-a998c56f3977 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:09:17.857449 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e822c-8585-4350-903f-a998c56f3977 service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:09:17.868307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1242/2465] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:09:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:09:21.078017 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f02e8-7bb9-41d2-b55e-76fe11da0871 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:09:21.078631 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f02e8-7bb9-41d2-b55e-76fe11da0871 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:09:21.078631 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f02e8-7bb9-41d2-b55e-76fe11da0871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:09:21.097969 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-5d0f02e8-7bb9-41d2-b55e-76fe11da0871 None None] MFA Rules not processed for user `3f9710b10a9a4746a57a29dfedf88866`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:09:21.099177 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-5d0f02e8-7bb9-41d2-b55e-76fe11da0871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:09:21.106250 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1224/2466] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:09:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:09:21.696488 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38f647-531d-4829-b029-85426220c770 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:09:21.697041 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38f647-531d-4829-b029-85426220c770 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:09:21.697165 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38f647-531d-4829-b029-85426220c770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:09:21.715744 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-fe38f647-531d-4829-b029-85426220c770 None None] MFA Rules not processed for user `d7e96891e45f427db01549f082d3f808`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:09:21.717112 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-fe38f647-531d-4829-b029-85426220c770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:09:21.724274 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1243/2467] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:09:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:09:22.092853 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f02e8-7bb9-41d2-b55e-76fe11da0871 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:09:22.103612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f02e8-7bb9-41d2-b55e-76fe11da0871 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:09:22.107291 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2474f75-67e2-4a6a-9337-dcd0c44d1529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:09:22.107787 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2474f75-67e2-4a6a-9337-dcd0c44d1529 service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:09:22.108069 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2474f75-67e2-4a6a-9337-dcd0c44d1529 service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:09:22.108340 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2474f75-67e2-4a6a-9337-dcd0c44d1529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:09:22.110085 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-b2474f75-67e2-4a6a-9337-dcd0c44d1529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:09:22.120403 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2474f75-67e2-4a6a-9337-dcd0c44d1529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:09:22.121865 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2474f75-67e2-4a6a-9337-dcd0c44d1529 service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:09:22.135871 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1225/2468] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:09:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:09:31.710257 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=14 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:09:32.126331 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=11 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:09:38.438958 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38f647-531d-4829-b029-85426220c770 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:09:38.453083 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38f647-531d-4829-b029-85426220c770 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:09:38.458616 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1abe9-832a-4cd4-851c-5d24737c0c19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:09:38.459214 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1abe9-832a-4cd4-851c-5d24737c0c19 service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:09:38.459496 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1abe9-832a-4cd4-851c-5d24737c0c19 service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:09:38.459768 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1abe9-832a-4cd4-851c-5d24737c0c19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:09:38.461517 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-95f1abe9-832a-4cd4-851c-5d24737c0c19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:09:38.474190 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1abe9-832a-4cd4-851c-5d24737c0c19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:09:38.475772 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1abe9-832a-4cd4-851c-5d24737c0c19 service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:09:38.486522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1244/2469] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:09:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:09:48.482106 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=6 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:09:54.751335 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2474f75-67e2-4a6a-9337-dcd0c44d1529 service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:09:54.752772 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-b2474f75-67e2-4a6a-9337-dcd0c44d1529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:09:54.768849 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2474f75-67e2-4a6a-9337-dcd0c44d1529 service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:09:54.773970 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70e25d-96ae-4dc1-9ca4-32fc229cd414 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6907dfd3254d3c97d07ca2fb648858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:09:54.774572 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70e25d-96ae-4dc1-9ca4-32fc229cd414 service placement] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:09:54.774854 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70e25d-96ae-4dc1-9ca4-32fc229cd414 service placement] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:09:54.775124 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70e25d-96ae-4dc1-9ca4-32fc229cd414 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:09:54.776860 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-cf70e25d-96ae-4dc1-9ca4-32fc229cd414 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:09:54.788985 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70e25d-96ae-4dc1-9ca4-32fc229cd414 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:09:54.790681 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70e25d-96ae-4dc1-9ca4-32fc229cd414 service placement] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:09:54.801979 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1226/2470] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:09:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:09:54.866037 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1abe9-832a-4cd4-851c-5d24737c0c19 service nova] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:09:54.868016 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-95f1abe9-832a-4cd4-851c-5d24737c0c19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:09:54.883550 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1abe9-832a-4cd4-851c-5d24737c0c19 service nova] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:09:54.888840 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e18b8e-9167-4016-b37b-ce65b25f3b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:09:54.889462 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e18b8e-9167-4016-b37b-ce65b25f3b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:09:54.889741 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e18b8e-9167-4016-b37b-ce65b25f3b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:09:54.890013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e18b8e-9167-4016-b37b-ce65b25f3b76 admin admin] PATH_INFO: `/v3/users/343a476eaf33493d9a30c8f564a1afa9` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:09:54.891119 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e18b8e-9167-4016-b37b-ce65b25f3b76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=343a476eaf33493d9a30c8f564a1afa9)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:09:54.893155 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e18b8e-9167-4016-b37b-ce65b25f3b76 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:09:55.072539 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-07e18b8e-9167-4016-b37b-ce65b25f3b76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '343a476eaf33493d9a30c8f564a1afa9'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:09:55.073218 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-07e18b8e-9167-4016-b37b-ce65b25f3b76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '343a476eaf33493d9a30c8f564a1afa9'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:09:55.073826 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-07e18b8e-9167-4016-b37b-ce65b25f3b76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '343a476eaf33493d9a30c8f564a1afa9'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:09:55.085904 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-07e18b8e-9167-4016-b37b-ce65b25f3b76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '343a476eaf33493d9a30c8f564a1afa9'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:09:55.161815 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-07e18b8e-9167-4016-b37b-ce65b25f3b76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '343a476eaf33493d9a30c8f564a1afa9'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:09:55.174805 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1245/2471] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:09:54 2022] DELETE /identity/v3/users/343a476eaf33493d9a30c8f564a1afa9 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:09:55.437934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70e25d-96ae-4dc1-9ca4-32fc229cd414 service placement] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:09:55.448746 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70e25d-96ae-4dc1-9ca4-32fc229cd414 service placement] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:09:55.508632 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0b01d-45cd-49d7-8bb0-6488cc77b2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:09:55.509285 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0b01d-45cd-49d7-8bb0-6488cc77b2c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:09:55.509614 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0b01d-45cd-49d7-8bb0-6488cc77b2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:09:55.509891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0b01d-45cd-49d7-8bb0-6488cc77b2c6 admin admin] PATH_INFO: `/v3/projects/6a7687e0df1c43a4ba2a77e851843cdd` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:09:55.511041 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0b01d-45cd-49d7-8bb0-6488cc77b2c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a7687e0df1c43a4ba2a77e851843cdd)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:09:55.513001 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0b01d-45cd-49d7-8bb0-6488cc77b2c6 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:09:55.595954 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-f7d0b01d-45cd-49d7-8bb0-6488cc77b2c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a7687e0df1c43a4ba2a77e851843cdd', 'request_id': 'req-f7d0b01d-45cd-49d7-8bb0-6488cc77b2c6'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:09:55.601472 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-f7d0b01d-45cd-49d7-8bb0-6488cc77b2c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a7687e0df1c43a4ba2a77e851843cdd', 'request_id': 'req-f7d0b01d-45cd-49d7-8bb0-6488cc77b2c6'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:09:55.608103 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-f7d0b01d-45cd-49d7-8bb0-6488cc77b2c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a7687e0df1c43a4ba2a77e851843cdd', 'request_id': 'req-f7d0b01d-45cd-49d7-8bb0-6488cc77b2c6'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:09:55.670106 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-f7d0b01d-45cd-49d7-8bb0-6488cc77b2c6 admin admin] The token cache is being invalidate because project 6a7687e0df1c43a4ba2a77e851843cdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:09:55.670387 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-f7d0b01d-45cd-49d7-8bb0-6488cc77b2c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:09:55.671029 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-f7d0b01d-45cd-49d7-8bb0-6488cc77b2c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:09:55.672514 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1227/2472] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:09:55 2022] DELETE /identity/v3/projects/6a7687e0df1c43a4ba2a77e851843cdd => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:09:55.677649 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4345d99-fa5d-4f64-a949-8ca8c2422776 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:09:55.677936 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4345d99-fa5d-4f64-a949-8ca8c2422776 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:09:55.678209 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4345d99-fa5d-4f64-a949-8ca8c2422776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:09:55.697728 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-a4345d99-fa5d-4f64-a949-8ca8c2422776 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:09:55.698841 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-a4345d99-fa5d-4f64-a949-8ca8c2422776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:09:55.758771 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1246/2473] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:09:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:09:55.767055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fce3cd-65aa-4235-ae8f-aed456005b75 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:09:55.767553 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fce3cd-65aa-4235-ae8f-aed456005b75 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:09:55.767654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fce3cd-65aa-4235-ae8f-aed456005b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:09:55.787789 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-78fce3cd-65aa-4235-ae8f-aed456005b75 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:09:55.789012 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-78fce3cd-65aa-4235-ae8f-aed456005b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:09:55.797100 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1228/2474] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:09:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:09:55.801245 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4345d99-fa5d-4f64-a949-8ca8c2422776 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:09:55.811593 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4345d99-fa5d-4f64-a949-8ca8c2422776 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:09:55.816196 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4d823-2b33-48ec-8551-b1cc720eaa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:09:55.816827 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4d823-2b33-48ec-8551-b1cc720eaa78 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:09:55.817106 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4d823-2b33-48ec-8551-b1cc720eaa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:09:55.817377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4d823-2b33-48ec-8551-b1cc720eaa78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:09:55.818019 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4d823-2b33-48ec-8551-b1cc720eaa78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:09:55.818318 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4d823-2b33-48ec-8551-b1cc720eaa78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:09:55.819905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4d823-2b33-48ec-8551-b1cc720eaa78 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:09:55.832346 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1247/2475] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:09:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:09:55.836401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fce3cd-65aa-4235-ae8f-aed456005b75 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:09:55.845973 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fce3cd-65aa-4235-ae8f-aed456005b75 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:09:55.850612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f1001-1a0f-4ef2-8f47-f71734e789d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:09:55.851197 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f1001-1a0f-4ef2-8f47-f71734e789d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:09:55.851470 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f1001-1a0f-4ef2-8f47-f71734e789d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:09:55.851738 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f1001-1a0f-4ef2-8f47-f71734e789d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:09:55.852358 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f1001-1a0f-4ef2-8f47-f71734e789d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:09:55.854265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f1001-1a0f-4ef2-8f47-f71734e789d0 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:09:55.925424 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1229/2476] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:09:55 2022] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:09:55.929495 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4d823-2b33-48ec-8551-b1cc720eaa78 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:09:55.940409 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4d823-2b33-48ec-8551-b1cc720eaa78 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:09:55.995881 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf5dc1-4e93-4d5c-ad47-492a7b520386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:09:55.996484 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf5dc1-4e93-4d5c-ad47-492a7b520386 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:09:55.996797 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf5dc1-4e93-4d5c-ad47-492a7b520386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:09:55.997071 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf5dc1-4e93-4d5c-ad47-492a7b520386 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:09:55.998408 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf5dc1-4e93-4d5c-ad47-492a7b520386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:09:56.000309 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf5dc1-4e93-4d5c-ad47-492a7b520386 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:09:56.008312 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:09:56.076082 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1248/2477] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:09:55 2022] POST /identity/v3/users => generated 287 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:09:56.081701 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f1001-1a0f-4ef2-8f47-f71734e789d0 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:09:56.093014 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f1001-1a0f-4ef2-8f47-f71734e789d0 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:09:56.097810 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993ee6c-e8df-4f4e-b338-ab5d383d5ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:09:56.098440 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993ee6c-e8df-4f4e-b338-ab5d383d5ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:09:56.098721 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993ee6c-e8df-4f4e-b338-ab5d383d5ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:09:56.098995 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993ee6c-e8df-4f4e-b338-ab5d383d5ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:09:56.099638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993ee6c-e8df-4f4e-b338-ab5d383d5ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:09:56.101354 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993ee6c-e8df-4f4e-b338-ab5d383d5ea9 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:09:56.112258 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1230/2478] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:09:56.116536 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf5dc1-4e93-4d5c-ad47-492a7b520386 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:09:56.126993 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf5dc1-4e93-4d5c-ad47-492a7b520386 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:09:56.132284 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a409dcb-c264-4921-8923-6f9a921abde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:09:56.132905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a409dcb-c264-4921-8923-6f9a921abde8 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:09:56.133185 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a409dcb-c264-4921-8923-6f9a921abde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:09:56.133456 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a409dcb-c264-4921-8923-6f9a921abde8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:09:56.134096 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a409dcb-c264-4921-8923-6f9a921abde8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:09:56.135680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a409dcb-c264-4921-8923-6f9a921abde8 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:09:56.147395 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1249/2479] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:09:56.151429 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993ee6c-e8df-4f4e-b338-ab5d383d5ea9 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:09:56.162250 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993ee6c-e8df-4f4e-b338-ab5d383d5ea9 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:09:56.166893 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3274a8-8fcc-4a9b-aef4-402adfe7345b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:09:56.167543 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3274a8-8fcc-4a9b-aef4-402adfe7345b admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:09:56.167813 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3274a8-8fcc-4a9b-aef4-402adfe7345b admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:09:56.168083 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3274a8-8fcc-4a9b-aef4-402adfe7345b admin admin] PATH_INFO: `/v3/projects/f54ecd682f3a4ae7ae4f21ffb96e769c/users/82daa6f49e504b089901028a8fa48752/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:09:56.183255 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3274a8-8fcc-4a9b-aef4-402adfe7345b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f54ecd682f3a4ae7ae4f21ffb96e769c, user_id=82daa6f49e504b089901028a8fa48752, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:09:56.186392 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3274a8-8fcc-4a9b-aef4-402adfe7345b admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:09:56.242172 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1231/2480] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:09:56 2022] PUT /identity/v3/projects/f54ecd682f3a4ae7ae4f21ffb96e769c/users/82daa6f49e504b089901028a8fa48752/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:09:56.252548 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47340071-c26e-48ef-9121-9d46bafbd1d9 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:09:56.252548 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47340071-c26e-48ef-9121-9d46bafbd1d9 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:09:56.252548 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47340071-c26e-48ef-9121-9d46bafbd1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:09:56.268502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-47340071-c26e-48ef-9121-9d46bafbd1d9 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:09:56.269800 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-47340071-c26e-48ef-9121-9d46bafbd1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:09:56.334375 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1250/2481] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:09:56.344544 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3274a8-8fcc-4a9b-aef4-402adfe7345b admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:09:56.346274 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-fc3274a8-8fcc-4a9b-aef4-402adfe7345b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:09:56.361467 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:09:56.406733 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3274a8-8fcc-4a9b-aef4-402adfe7345b admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:09:56.411136 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bdfc4-85f1-4e5c-aa8b-f6bdcc1a6eda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:09:56.411771 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bdfc4-85f1-4e5c-aa8b-f6bdcc1a6eda service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:09:56.412047 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bdfc4-85f1-4e5c-aa8b-f6bdcc1a6eda service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:09:56.412391 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bdfc4-85f1-4e5c-aa8b-f6bdcc1a6eda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:09:56.422165 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83bdfc4-85f1-4e5c-aa8b-f6bdcc1a6eda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:09:56.423620 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83bdfc4-85f1-4e5c-aa8b-f6bdcc1a6eda service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:09:56.432973 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1232/2482] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:09:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:10:01.643576 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e7a61-139a-4220-8ace-1e3aa1310008 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:01.644154 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e7a61-139a-4220-8ace-1e3aa1310008 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:01.644154 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e7a61-139a-4220-8ace-1e3aa1310008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:01.675210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-1d1e7a61-139a-4220-8ace-1e3aa1310008 None None] MFA Rules not processed for user `82daa6f49e504b089901028a8fa48752`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:10:01.676427 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-1d1e7a61-139a-4220-8ace-1e3aa1310008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:01.744409 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1251/2483] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:10:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:10:01.749641 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bdfc4-85f1-4e5c-aa8b-f6bdcc1a6eda service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:01.759442 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bdfc4-85f1-4e5c-aa8b-f6bdcc1a6eda service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:01.764880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3f9c4-462d-49c0-a4cb-def0a2134a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:01.765475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3f9c4-462d-49c0-a4cb-def0a2134a5a admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:01.765756 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3f9c4-462d-49c0-a4cb-def0a2134a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:01.766031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3f9c4-462d-49c0-a4cb-def0a2134a5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:01.766660 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3f9c4-462d-49c0-a4cb-def0a2134a5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:01.768654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3f9c4-462d-49c0-a4cb-def0a2134a5a admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:01.843334 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1233/2484] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:10:01 2022] POST /identity/v3/projects => generated 371 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:10:01.847373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e7a61-139a-4220-8ace-1e3aa1310008 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:01.858658 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e7a61-139a-4220-8ace-1e3aa1310008 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:01.921731 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d2022-94b6-45a9-a4af-4308d7322005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:01.922351 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d2022-94b6-45a9-a4af-4308d7322005 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:01.922632 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d2022-94b6-45a9-a4af-4308d7322005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:01.922905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d2022-94b6-45a9-a4af-4308d7322005 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:01.923538 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d2022-94b6-45a9-a4af-4308d7322005 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:01.925566 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d2022-94b6-45a9-a4af-4308d7322005 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:02.020111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:02.026145 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1252/2485] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:10:01 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:10:02.030501 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3f9c4-462d-49c0-a4cb-def0a2134a5a admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:02.041353 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3f9c4-462d-49c0-a4cb-def0a2134a5a admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:02.046771 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327c0fc-e32e-4e91-9728-68578ae1d97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:02.047394 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327c0fc-e32e-4e91-9728-68578ae1d97a admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:02.047675 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327c0fc-e32e-4e91-9728-68578ae1d97a admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:02.047949 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327c0fc-e32e-4e91-9728-68578ae1d97a admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:02.048593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f327c0fc-e32e-4e91-9728-68578ae1d97a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:02.050399 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f327c0fc-e32e-4e91-9728-68578ae1d97a admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:02.063095 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1234/2486] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:10:02.067321 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d2022-94b6-45a9-a4af-4308d7322005 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:02.077739 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d2022-94b6-45a9-a4af-4308d7322005 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:02.082704 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe356959-d1a8-40e3-8f3d-6d69f3f9665b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:02.083392 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe356959-d1a8-40e3-8f3d-6d69f3f9665b admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:02.083655 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe356959-d1a8-40e3-8f3d-6d69f3f9665b admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:02.083929 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe356959-d1a8-40e3-8f3d-6d69f3f9665b admin admin] PATH_INFO: `/v3/projects/f07b61e25bd84ad08ca31d61437ccff9/users/e7e7902297c24fecb54fbd52b4f741f2/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:02.099549 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe356959-d1a8-40e3-8f3d-6d69f3f9665b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f07b61e25bd84ad08ca31d61437ccff9, user_id=e7e7902297c24fecb54fbd52b4f741f2, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:02.102378 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe356959-d1a8-40e3-8f3d-6d69f3f9665b admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:02.161533 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1253/2487] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:10:02 2022] PUT /identity/v3/projects/f07b61e25bd84ad08ca31d61437ccff9/users/e7e7902297c24fecb54fbd52b4f741f2/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:10:02.162060 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327c0fc-e32e-4e91-9728-68578ae1d97a admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:02.182765 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327c0fc-e32e-4e91-9728-68578ae1d97a admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:02.256497 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3e18c-0964-4e41-b21d-5473efe6c5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:02.257526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3e18c-0964-4e41-b21d-5473efe6c5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:02.262178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3e18c-0964-4e41-b21d-5473efe6c5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:02.262178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3e18c-0964-4e41-b21d-5473efe6c5b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:02.262178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e3e18c-0964-4e41-b21d-5473efe6c5b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:02.262178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e3e18c-0964-4e41-b21d-5473efe6c5b1 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:02.271011 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1235/2488] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:10:02.275130 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe356959-d1a8-40e3-8f3d-6d69f3f9665b admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:02.289537 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe356959-d1a8-40e3-8f3d-6d69f3f9665b admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:02.294398 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6313e2-33ac-45ed-a6d3-a75c1d36b5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:02.295658 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6313e2-33ac-45ed-a6d3-a75c1d36b5d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:02.295935 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6313e2-33ac-45ed-a6d3-a75c1d36b5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:02.296341 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6313e2-33ac-45ed-a6d3-a75c1d36b5d2 admin admin] PATH_INFO: `/v3/projects/f07b61e25bd84ad08ca31d61437ccff9/users/e7e7902297c24fecb54fbd52b4f741f2/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:02.298331 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6313e2-33ac-45ed-a6d3-a75c1d36b5d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f07b61e25bd84ad08ca31d61437ccff9, user_id=e7e7902297c24fecb54fbd52b4f741f2, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:02.301028 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6313e2-33ac-45ed-a6d3-a75c1d36b5d2 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:02.312452 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1254/2489] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:10:02 2022] PUT /identity/v3/projects/f07b61e25bd84ad08ca31d61437ccff9/users/e7e7902297c24fecb54fbd52b4f741f2/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:10:07.885192 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e3eee-ebe3-436e-b1ba-14daa85b994b None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:07.885686 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e3eee-ebe3-436e-b1ba-14daa85b994b None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:07.885787 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e3eee-ebe3-436e-b1ba-14daa85b994b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:07.921971 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-d25e3eee-ebe3-436e-b1ba-14daa85b994b None None] MFA Rules not processed for user `e7e7902297c24fecb54fbd52b4f741f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:10:07.923327 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-d25e3eee-ebe3-436e-b1ba-14daa85b994b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:07.999435 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1236/2490] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:10:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:10:08.016050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6313e2-33ac-45ed-a6d3-a75c1d36b5d2 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:08.017858 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-fb6313e2-33ac-45ed-a6d3-a75c1d36b5d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:08.097604 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6313e2-33ac-45ed-a6d3-a75c1d36b5d2 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:08.103252 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daec9c6-8bfc-4356-ad5c-f81d095ca76b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:08.103864 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daec9c6-8bfc-4356-ad5c-f81d095ca76b service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:08.104140 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daec9c6-8bfc-4356-ad5c-f81d095ca76b service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:08.104406 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daec9c6-8bfc-4356-ad5c-f81d095ca76b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:08.161049 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daec9c6-8bfc-4356-ad5c-f81d095ca76b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:08.162576 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daec9c6-8bfc-4356-ad5c-f81d095ca76b service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:08.173032 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1255/2491] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:10:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:10:11.250799 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdeccc-c0ba-4bca-afcb-cc9683f1a518 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:11.251323 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdeccc-c0ba-4bca-afcb-cc9683f1a518 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:11.251423 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdeccc-c0ba-4bca-afcb-cc9683f1a518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:11.259981 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:11.272035 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-b5fdeccc-c0ba-4bca-afcb-cc9683f1a518 None None] MFA Rules not processed for user `82daa6f49e504b089901028a8fa48752`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:10:11.273289 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-b5fdeccc-c0ba-4bca-afcb-cc9683f1a518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:11.286226 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1237/2492] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:10:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:10:18.167544 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=72,keystone:INSERT=2 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:21.430885 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:23.258429 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daec9c6-8bfc-4356-ad5c-f81d095ca76b service nova] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:23.272718 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daec9c6-8bfc-4356-ad5c-f81d095ca76b service nova] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:23.280847 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ceb92-71c6-46f4-b95a-f43815844089 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:23.280847 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ceb92-71c6-46f4-b95a-f43815844089 service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:23.280847 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ceb92-71c6-46f4-b95a-f43815844089 service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:23.280847 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ceb92-71c6-46f4-b95a-f43815844089 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:23.282285 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-3e3ceb92-71c6-46f4-b95a-f43815844089 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:23.346254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ceb92-71c6-46f4-b95a-f43815844089 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:23.348908 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ceb92-71c6-46f4-b95a-f43815844089 service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:23.360297 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1256/2493] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:10:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:10:33.354578 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=28 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:33.438260 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fdeccc-c0ba-4bca-afcb-cc9683f1a518 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:33.495127 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fdeccc-c0ba-4bca-afcb-cc9683f1a518 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:33.498762 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f84f9c-3743-496b-a1f7-f26350816743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:33.499367 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f84f9c-3743-496b-a1f7-f26350816743 service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:33.499719 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f84f9c-3743-496b-a1f7-f26350816743 service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:33.499991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f84f9c-3743-496b-a1f7-f26350816743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:33.502099 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-17f84f9c-3743-496b-a1f7-f26350816743 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:33.581644 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f84f9c-3743-496b-a1f7-f26350816743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:33.584267 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f84f9c-3743-496b-a1f7-f26350816743 service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:33.596550 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1238/2494] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:10:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:10:34.763497 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fab5a-b98b-472a-82b2-afc6d79ec4c3 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:34.763997 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fab5a-b98b-472a-82b2-afc6d79ec4c3 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:34.764098 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fab5a-b98b-472a-82b2-afc6d79ec4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:34.783785 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-0b9fab5a-b98b-472a-82b2-afc6d79ec4c3 None None] MFA Rules not processed for user `eaf3821dd57a4d8f9ca6385c202bb0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:10:34.785047 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-0b9fab5a-b98b-472a-82b2-afc6d79ec4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:34.841572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1257/2495] 10.222.0.64 () {58 vars in 967 bytes} [Wed Aug 24 16:10:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:10:35.020706 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f84f9c-3743-496b-a1f7-f26350816743 service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:35.023672 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-17f84f9c-3743-496b-a1f7-f26350816743 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:35.104003 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f84f9c-3743-496b-a1f7-f26350816743 service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:35.109086 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0168d-bf76-445b-be0a-14505ec6eb5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a0a84e4c4e47fc930881109fc07039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:35.109690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0168d-bf76-445b-be0a-14505ec6eb5d service swift] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:35.109965 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0168d-bf76-445b-be0a-14505ec6eb5d service swift] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:35.110232 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0168d-bf76-445b-be0a-14505ec6eb5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:35.119619 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0168d-bf76-445b-be0a-14505ec6eb5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:35.121354 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0168d-bf76-445b-be0a-14505ec6eb5d service swift] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:35.130666 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1239/2496] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 24 16:10:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:10:36.563434 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fab5a-b98b-472a-82b2-afc6d79ec4c3 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:36.564897 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-0b9fab5a-b98b-472a-82b2-afc6d79ec4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:36.580805 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fab5a-b98b-472a-82b2-afc6d79ec4c3 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:36.587979 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5adcec4-1df2-4711-bc57-a835ea6f0d39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:36.588836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adcec4-1df2-4711-bc57-a835ea6f0d39 service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:36.589117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adcec4-1df2-4711-bc57-a835ea6f0d39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:36.589535 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adcec4-1df2-4711-bc57-a835ea6f0d39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:36.591892 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-f5adcec4-1df2-4711-bc57-a835ea6f0d39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:36.606575 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5adcec4-1df2-4711-bc57-a835ea6f0d39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:36.609213 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5adcec4-1df2-4711-bc57-a835ea6f0d39 service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:36.620568 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1258/2497] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:10:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:10:37.963597 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0168d-bf76-445b-be0a-14505ec6eb5d service swift] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:37.965584 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-88a0168d-bf76-445b-be0a-14505ec6eb5d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:38.037801 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:38.070839 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0168d-bf76-445b-be0a-14505ec6eb5d service swift] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:38.076258 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3569a81-3bee-4f33-acfa-c807840f1663 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6907dfd3254d3c97d07ca2fb648858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:38.077228 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3569a81-3bee-4f33-acfa-c807840f1663 service placement] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:38.077665 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3569a81-3bee-4f33-acfa-c807840f1663 service placement] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:38.078092 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3569a81-3bee-4f33-acfa-c807840f1663 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:38.080096 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-a3569a81-3bee-4f33-acfa-c807840f1663 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:38.094773 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3569a81-3bee-4f33-acfa-c807840f1663 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:38.097585 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3569a81-3bee-4f33-acfa-c807840f1663 service placement] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:38.116227 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1240/2498] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:10:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:10:38.189774 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5adcec4-1df2-4711-bc57-a835ea6f0d39 service neutron] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:38.193052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-f5adcec4-1df2-4711-bc57-a835ea6f0d39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:38.209966 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5adcec4-1df2-4711-bc57-a835ea6f0d39 service neutron] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:38.219696 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b207722-722e-4f08-907b-d5700ba931e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:38.220549 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b207722-722e-4f08-907b-d5700ba931e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:38.220968 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b207722-722e-4f08-907b-d5700ba931e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:38.222222 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b207722-722e-4f08-907b-d5700ba931e8 admin admin] PATH_INFO: `/v3/users/c640f4b512f748669f75f297f5bf8df9` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:38.224210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b207722-722e-4f08-907b-d5700ba931e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c640f4b512f748669f75f297f5bf8df9)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:38.227439 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b207722-722e-4f08-907b-d5700ba931e8 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:38.467514 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-2b207722-722e-4f08-907b-d5700ba931e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c640f4b512f748669f75f297f5bf8df9'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:38.469512 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-2b207722-722e-4f08-907b-d5700ba931e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c640f4b512f748669f75f297f5bf8df9'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:38.470379 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-2b207722-722e-4f08-907b-d5700ba931e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c640f4b512f748669f75f297f5bf8df9'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:38.491369 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-2b207722-722e-4f08-907b-d5700ba931e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c640f4b512f748669f75f297f5bf8df9'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:38.563552 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-2b207722-722e-4f08-907b-d5700ba931e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c640f4b512f748669f75f297f5bf8df9'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:38.578168 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1259/2499] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:10:38 2022] DELETE /identity/v3/users/c640f4b512f748669f75f297f5bf8df9 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:10:38.830735 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3569a81-3bee-4f33-acfa-c807840f1663 service placement] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:38.843332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3569a81-3bee-4f33-acfa-c807840f1663 service placement] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:38.915428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ee7c1-85cd-4571-a57b-06dee7f52ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:38.916358 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ee7c1-85cd-4571-a57b-06dee7f52ed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:38.916827 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ee7c1-85cd-4571-a57b-06dee7f52ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:38.922855 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ee7c1-85cd-4571-a57b-06dee7f52ed9 admin admin] PATH_INFO: `/v3/projects/ccb0872e78994c10b8fa4fdf1a04490c` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:38.922855 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98ee7c1-85cd-4571-a57b-06dee7f52ed9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccb0872e78994c10b8fa4fdf1a04490c)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:38.922855 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98ee7c1-85cd-4571-a57b-06dee7f52ed9 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:39.074023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-f98ee7c1-85cd-4571-a57b-06dee7f52ed9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccb0872e78994c10b8fa4fdf1a04490c', 'request_id': 'req-f98ee7c1-85cd-4571-a57b-06dee7f52ed9'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:39.097483 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-f98ee7c1-85cd-4571-a57b-06dee7f52ed9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccb0872e78994c10b8fa4fdf1a04490c', 'request_id': 'req-f98ee7c1-85cd-4571-a57b-06dee7f52ed9'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:39.105178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-f98ee7c1-85cd-4571-a57b-06dee7f52ed9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccb0872e78994c10b8fa4fdf1a04490c', 'request_id': 'req-f98ee7c1-85cd-4571-a57b-06dee7f52ed9'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:39.197795 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-f98ee7c1-85cd-4571-a57b-06dee7f52ed9 admin admin] The token cache is being invalidate because project ccb0872e78994c10b8fa4fdf1a04490c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:10:39.198071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-f98ee7c1-85cd-4571-a57b-06dee7f52ed9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:39.199010 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-f98ee7c1-85cd-4571-a57b-06dee7f52ed9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:39.202249 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1241/2500] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:10:38 2022] DELETE /identity/v3/projects/ccb0872e78994c10b8fa4fdf1a04490c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:10:39.207010 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99735c-4a38-4309-b2a8-e0383cce7646 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:39.208211 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99735c-4a38-4309-b2a8-e0383cce7646 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:39.208211 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99735c-4a38-4309-b2a8-e0383cce7646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:39.238031 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-fa99735c-4a38-4309-b2a8-e0383cce7646 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:10:39.240283 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-fa99735c-4a38-4309-b2a8-e0383cce7646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:39.338630 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1260/2501] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:10:39.340016 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877180b3-9db1-4d7b-8fc9-51f51cdc02b0 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:39.340308 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877180b3-9db1-4d7b-8fc9-51f51cdc02b0 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:39.340587 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877180b3-9db1-4d7b-8fc9-51f51cdc02b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:39.372750 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-877180b3-9db1-4d7b-8fc9-51f51cdc02b0 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:10:39.374107 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-877180b3-9db1-4d7b-8fc9-51f51cdc02b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:39.388712 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1242/2502] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:10:39.389398 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99735c-4a38-4309-b2a8-e0383cce7646 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:39.397517 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:39.405179 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99735c-4a38-4309-b2a8-e0383cce7646 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:39.407196 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd10fec-b9f9-48e6-93b9-971f63300737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:39.407934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd10fec-b9f9-48e6-93b9-971f63300737 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:39.408336 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd10fec-b9f9-48e6-93b9-971f63300737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:39.408739 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd10fec-b9f9-48e6-93b9-971f63300737 admin admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:39.409763 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd10fec-b9f9-48e6-93b9-971f63300737 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:10:39.410170 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd10fec-b9f9-48e6-93b9-971f63300737 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:39.412096 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd10fec-b9f9-48e6-93b9-971f63300737 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:39.427636 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1261/2503] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:10:39.432389 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877180b3-9db1-4d7b-8fc9-51f51cdc02b0 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:39.443672 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877180b3-9db1-4d7b-8fc9-51f51cdc02b0 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:39.457055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b000b0-8621-46c5-8c1d-e315f59659e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:39.457881 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b000b0-8621-46c5-8c1d-e315f59659e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:39.458010 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b000b0-8621-46c5-8c1d-e315f59659e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:39.458292 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b000b0-8621-46c5-8c1d-e315f59659e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:39.458951 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b000b0-8621-46c5-8c1d-e315f59659e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:39.460943 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b000b0-8621-46c5-8c1d-e315f59659e1 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:39.593101 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1243/2504] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:10:39 2022] POST /identity/v3/projects => generated 381 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:10:39.597328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd10fec-b9f9-48e6-93b9-971f63300737 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:39.610254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd10fec-b9f9-48e6-93b9-971f63300737 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:39.686836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7e08d-04b2-4cfa-8828-3d4cda4efac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:39.687668 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7e08d-04b2-4cfa-8828-3d4cda4efac0 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:39.687942 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7e08d-04b2-4cfa-8828-3d4cda4efac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:39.688350 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7e08d-04b2-4cfa-8828-3d4cda4efac0 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:39.689016 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7e08d-04b2-4cfa-8828-3d4cda4efac0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:39.690995 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7e08d-04b2-4cfa-8828-3d4cda4efac0 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:39.824700 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1262/2505] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:10:39 2022] POST /identity/v3/users => generated 291 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:10:39.825898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b000b0-8621-46c5-8c1d-e315f59659e1 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:39.836483 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b000b0-8621-46c5-8c1d-e315f59659e1 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:39.841189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2024c81-42d2-4140-8731-0ae016d0f7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:39.841951 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2024c81-42d2-4140-8731-0ae016d0f7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:39.842293 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2024c81-42d2-4140-8731-0ae016d0f7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:39.842631 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2024c81-42d2-4140-8731-0ae016d0f7a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:39.843416 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2024c81-42d2-4140-8731-0ae016d0f7a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:39.845090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2024c81-42d2-4140-8731-0ae016d0f7a0 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:39.857319 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1244/2506] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:10:39.861161 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7e08d-04b2-4cfa-8828-3d4cda4efac0 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:39.872611 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7e08d-04b2-4cfa-8828-3d4cda4efac0 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:39.877548 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b58b56-26c2-4c47-b7b3-140a0ff15760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:39.878229 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b58b56-26c2-4c47-b7b3-140a0ff15760 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:39.884210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b58b56-26c2-4c47-b7b3-140a0ff15760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:39.884210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b58b56-26c2-4c47-b7b3-140a0ff15760 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:39.884210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b58b56-26c2-4c47-b7b3-140a0ff15760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:39.884210 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b58b56-26c2-4c47-b7b3-140a0ff15760 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:39.892830 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1263/2507] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:10:39.897512 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2024c81-42d2-4140-8731-0ae016d0f7a0 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:39.907864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2024c81-42d2-4140-8731-0ae016d0f7a0 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:39.913726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65d144-d27a-4dae-8fd8-271d3de5ce87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:39.918580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65d144-d27a-4dae-8fd8-271d3de5ce87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:39.918580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65d144-d27a-4dae-8fd8-271d3de5ce87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:39.918580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65d144-d27a-4dae-8fd8-271d3de5ce87 admin admin] PATH_INFO: `/v3/projects/dcbd5a34f8984265a60907a7672cce93/users/bfa0b101250d4c4e83cfdbf02d845fca/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:39.930833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65d144-d27a-4dae-8fd8-271d3de5ce87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcbd5a34f8984265a60907a7672cce93, user_id=bfa0b101250d4c4e83cfdbf02d845fca, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:39.933866 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65d144-d27a-4dae-8fd8-271d3de5ce87 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:39.937364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:40.060818 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1245/2508] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:10:39 2022] PUT /identity/v3/projects/dcbd5a34f8984265a60907a7672cce93/users/bfa0b101250d4c4e83cfdbf02d845fca/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:10:40.072453 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b2be4-37c7-4e23-8ea0-35b75baa3651 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:40.073924 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b2be4-37c7-4e23-8ea0-35b75baa3651 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:40.074205 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b2be4-37c7-4e23-8ea0-35b75baa3651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:40.113541 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-674b2be4-37c7-4e23-8ea0-35b75baa3651 None None] MFA Rules not processed for user `bfa0b101250d4c4e83cfdbf02d845fca`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:10:40.113541 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-674b2be4-37c7-4e23-8ea0-35b75baa3651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:40.183981 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1264/2509] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:10:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:10:40.188369 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65d144-d27a-4dae-8fd8-271d3de5ce87 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:40.262120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65d144-d27a-4dae-8fd8-271d3de5ce87 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:40.267441 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1bf07-1e0f-49fd-b078-dc467b552c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:40.268055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1bf07-1e0f-49fd-b078-dc467b552c49 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:40.268338 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1bf07-1e0f-49fd-b078-dc467b552c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:40.268614 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1bf07-1e0f-49fd-b078-dc467b552c49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:40.269328 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1bf07-1e0f-49fd-b078-dc467b552c49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:40.271931 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1bf07-1e0f-49fd-b078-dc467b552c49 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:40.423458 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1246/2510] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:10:40 2022] POST /identity/v3/projects => generated 379 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:10:40.428203 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b2be4-37c7-4e23-8ea0-35b75baa3651 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:40.442886 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b2be4-37c7-4e23-8ea0-35b75baa3651 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:40.531778 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c871e-bbd8-4580-85bd-e566adc1c120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:40.532427 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c871e-bbd8-4580-85bd-e566adc1c120 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:40.532744 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c871e-bbd8-4580-85bd-e566adc1c120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:40.533023 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c871e-bbd8-4580-85bd-e566adc1c120 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:40.534061 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c871e-bbd8-4580-85bd-e566adc1c120 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:40.536308 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c871e-bbd8-4580-85bd-e566adc1c120 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:40.545597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:40.624427 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1265/2511] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:10:40 2022] POST /identity/v3/users => generated 296 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:10:40.628851 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1bf07-1e0f-49fd-b078-dc467b552c49 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:40.645472 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1bf07-1e0f-49fd-b078-dc467b552c49 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:40.660732 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368f0dd-b9ea-4985-a3a3-2f0e8a6d0e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:40.663431 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368f0dd-b9ea-4985-a3a3-2f0e8a6d0e81 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:40.663711 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368f0dd-b9ea-4985-a3a3-2f0e8a6d0e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:40.664392 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368f0dd-b9ea-4985-a3a3-2f0e8a6d0e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:40.667244 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368f0dd-b9ea-4985-a3a3-2f0e8a6d0e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:40.668998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368f0dd-b9ea-4985-a3a3-2f0e8a6d0e81 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:40.683544 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1247/2512] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:10:40.688814 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c871e-bbd8-4580-85bd-e566adc1c120 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:40.715896 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c871e-bbd8-4580-85bd-e566adc1c120 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:40.724294 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e7e8c-0705-4f81-b2e5-99c659767208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:40.725593 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e7e8c-0705-4f81-b2e5-99c659767208 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:40.726047 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e7e8c-0705-4f81-b2e5-99c659767208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:40.726426 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e7e8c-0705-4f81-b2e5-99c659767208 admin admin] PATH_INFO: `/v3/projects/9f6e44b302a54d9ea0d7ed024989f5ec/users/4a5b265b35174fffafc5358a6b7a574f/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:40.746321 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e7e8c-0705-4f81-b2e5-99c659767208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f6e44b302a54d9ea0d7ed024989f5ec, user_id=4a5b265b35174fffafc5358a6b7a574f, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:40.749688 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e7e8c-0705-4f81-b2e5-99c659767208 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:40.862600 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1266/2513] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:10:40 2022] PUT /identity/v3/projects/9f6e44b302a54d9ea0d7ed024989f5ec/users/4a5b265b35174fffafc5358a6b7a574f/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:10:40.867223 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368f0dd-b9ea-4985-a3a3-2f0e8a6d0e81 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:40.877365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368f0dd-b9ea-4985-a3a3-2f0e8a6d0e81 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:40.966001 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f8f0d-7654-4c6e-9ce0-e808e48026c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:40.966812 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f8f0d-7654-4c6e-9ce0-e808e48026c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:40.967226 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f8f0d-7654-4c6e-9ce0-e808e48026c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:40.967593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f8f0d-7654-4c6e-9ce0-e808e48026c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:40.968338 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f8f0d-7654-4c6e-9ce0-e808e48026c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:40.970319 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f8f0d-7654-4c6e-9ce0-e808e48026c7 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:40.993004 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1248/2514] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:10:40.996809 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e7e8c-0705-4f81-b2e5-99c659767208 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:41.013343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e7e8c-0705-4f81-b2e5-99c659767208 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:41.022351 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06acbc2-894d-4feb-9471-d96392de8629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:41.023132 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06acbc2-894d-4feb-9471-d96392de8629 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:41.023654 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06acbc2-894d-4feb-9471-d96392de8629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:41.024003 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06acbc2-894d-4feb-9471-d96392de8629 admin admin] PATH_INFO: `/v3/projects/9f6e44b302a54d9ea0d7ed024989f5ec/users/4a5b265b35174fffafc5358a6b7a574f/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:41.031415 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06acbc2-894d-4feb-9471-d96392de8629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f6e44b302a54d9ea0d7ed024989f5ec, user_id=4a5b265b35174fffafc5358a6b7a574f, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:41.040902 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06acbc2-894d-4feb-9471-d96392de8629 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:41.083172 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1267/2515] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:10:40 2022] PUT /identity/v3/projects/9f6e44b302a54d9ea0d7ed024989f5ec/users/4a5b265b35174fffafc5358a6b7a574f/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:10:41.094372 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020590d-d391-4533-ace9-269cee00aa08 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:41.095037 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020590d-d391-4533-ace9-269cee00aa08 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:41.095344 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020590d-d391-4533-ace9-269cee00aa08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:41.130934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-9020590d-d391-4533-ace9-269cee00aa08 None None] MFA Rules not processed for user `4a5b265b35174fffafc5358a6b7a574f`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:10:41.132406 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-9020590d-d391-4533-ace9-269cee00aa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:41.196665 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:41.216653 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1249/2516] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:10:41 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:10:41.230426 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06acbc2-894d-4feb-9471-d96392de8629 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:41.236046 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-e06acbc2-894d-4feb-9471-d96392de8629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:41.308069 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06acbc2-894d-4feb-9471-d96392de8629 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:41.312102 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c75e3-3d02-4ee3-8ef2-8058ea631971 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:41.316477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c75e3-3d02-4ee3-8ef2-8058ea631971 service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:41.316477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c75e3-3d02-4ee3-8ef2-8058ea631971 service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:41.316477 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c75e3-3d02-4ee3-8ef2-8058ea631971 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:41.324118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c75e3-3d02-4ee3-8ef2-8058ea631971 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:41.325689 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c75e3-3d02-4ee3-8ef2-8058ea631971 service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:41.349419 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1268/2517] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:10:41 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:10:41.560405 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020590d-d391-4533-ace9-269cee00aa08 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:41.570607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020590d-d391-4533-ace9-269cee00aa08 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:41.574260 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bf8e4-0b79-49b4-ba48-b96b276511fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:41.574860 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bf8e4-0b79-49b4-ba48-b96b276511fb service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:41.575130 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bf8e4-0b79-49b4-ba48-b96b276511fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:41.575401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bf8e4-0b79-49b4-ba48-b96b276511fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:41.650816 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507bf8e4-0b79-49b4-ba48-b96b276511fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:41.653314 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507bf8e4-0b79-49b4-ba48-b96b276511fb service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:41.664014 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1250/2518] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:10:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:10:46.344714 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c75e3-3d02-4ee3-8ef2-8058ea631971 service cinder] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:46.346378 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-369c75e3-3d02-4ee3-8ef2-8058ea631971 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:46.418904 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c75e3-3d02-4ee3-8ef2-8058ea631971 service cinder] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:46.423525 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51933b4c-12fb-459c-be91-6d2e19726cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:46.425811 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51933b4c-12fb-459c-be91-6d2e19726cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:46.425811 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51933b4c-12fb-459c-be91-6d2e19726cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:46.425811 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51933b4c-12fb-459c-be91-6d2e19726cca admin admin] PATH_INFO: `/v3/users/069ca20cb895423f9fba63dd63c1cf3d` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:46.426070 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51933b4c-12fb-459c-be91-6d2e19726cca admin admin] RBAC: Authorizing `identity:delete_user(user_id=069ca20cb895423f9fba63dd63c1cf3d)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:46.428092 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51933b4c-12fb-459c-be91-6d2e19726cca admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:46.628756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-51933b4c-12fb-459c-be91-6d2e19726cca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '069ca20cb895423f9fba63dd63c1cf3d'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:46.630200 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-51933b4c-12fb-459c-be91-6d2e19726cca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '069ca20cb895423f9fba63dd63c1cf3d'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:46.630881 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-51933b4c-12fb-459c-be91-6d2e19726cca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '069ca20cb895423f9fba63dd63c1cf3d'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:46.638839 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:INSERT=5,keystone:SELECT=87,keystone:DELETE=8 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:46.644309 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-51933b4c-12fb-459c-be91-6d2e19726cca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '069ca20cb895423f9fba63dd63c1cf3d'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:46.746001 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-51933b4c-12fb-459c-be91-6d2e19726cca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '069ca20cb895423f9fba63dd63c1cf3d'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:46.760702 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1269/2519] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:10:46 2022] DELETE /identity/v3/users/069ca20cb895423f9fba63dd63c1cf3d => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:10:47.049389 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bf8e4-0b79-49b4-ba48-b96b276511fb service cinder] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:47.058495 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bf8e4-0b79-49b4-ba48-b96b276511fb service cinder] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:47.136073 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80046df6-e4e6-4d1e-9ca5-e552809616ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:47.141311 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80046df6-e4e6-4d1e-9ca5-e552809616ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:47.141311 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80046df6-e4e6-4d1e-9ca5-e552809616ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:47.141311 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80046df6-e4e6-4d1e-9ca5-e552809616ce admin admin] PATH_INFO: `/v3/projects/f3786b4cc5124bbeb4e8e52af023b1f7` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:47.141311 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80046df6-e4e6-4d1e-9ca5-e552809616ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3786b4cc5124bbeb4e8e52af023b1f7)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:47.141311 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80046df6-e4e6-4d1e-9ca5-e552809616ce admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:47.249077 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-80046df6-e4e6-4d1e-9ca5-e552809616ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3786b4cc5124bbeb4e8e52af023b1f7', 'request_id': 'req-80046df6-e4e6-4d1e-9ca5-e552809616ce'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:47.255096 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-80046df6-e4e6-4d1e-9ca5-e552809616ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3786b4cc5124bbeb4e8e52af023b1f7', 'request_id': 'req-80046df6-e4e6-4d1e-9ca5-e552809616ce'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:47.261410 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-80046df6-e4e6-4d1e-9ca5-e552809616ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3786b4cc5124bbeb4e8e52af023b1f7', 'request_id': 'req-80046df6-e4e6-4d1e-9ca5-e552809616ce'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:47.357468 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-80046df6-e4e6-4d1e-9ca5-e552809616ce admin admin] The token cache is being invalidate because project f3786b4cc5124bbeb4e8e52af023b1f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:10:47.357842 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-80046df6-e4e6-4d1e-9ca5-e552809616ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:47.358547 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-80046df6-e4e6-4d1e-9ca5-e552809616ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:47.360443 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1251/2520] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:10:47 2022] DELETE /identity/v3/projects/f3786b4cc5124bbeb4e8e52af023b1f7 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:10:47.365305 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51933b4c-12fb-459c-be91-6d2e19726cca admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:47.368065 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-51933b4c-12fb-459c-be91-6d2e19726cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:47.381912 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51933b4c-12fb-459c-be91-6d2e19726cca admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:47.440419 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab31e9f-1a54-4d4b-bc32-ec868fa1ba83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:47.441082 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab31e9f-1a54-4d4b-bc32-ec868fa1ba83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:47.441363 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab31e9f-1a54-4d4b-bc32-ec868fa1ba83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:47.441740 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab31e9f-1a54-4d4b-bc32-ec868fa1ba83 admin admin] PATH_INFO: `/v3/users/e43c7c61d4b84de48e434683fc90434c` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:47.442872 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab31e9f-1a54-4d4b-bc32-ec868fa1ba83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e43c7c61d4b84de48e434683fc90434c)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:47.444841 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab31e9f-1a54-4d4b-bc32-ec868fa1ba83 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:47.629111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-dab31e9f-1a54-4d4b-bc32-ec868fa1ba83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e43c7c61d4b84de48e434683fc90434c'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:47.629904 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-dab31e9f-1a54-4d4b-bc32-ec868fa1ba83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e43c7c61d4b84de48e434683fc90434c'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:47.633756 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-dab31e9f-1a54-4d4b-bc32-ec868fa1ba83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e43c7c61d4b84de48e434683fc90434c'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:47.644473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-dab31e9f-1a54-4d4b-bc32-ec868fa1ba83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e43c7c61d4b84de48e434683fc90434c'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:47.717680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-dab31e9f-1a54-4d4b-bc32-ec868fa1ba83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e43c7c61d4b84de48e434683fc90434c'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:47.730806 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1270/2521] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:10:47 2022] DELETE /identity/v3/users/e43c7c61d4b84de48e434683fc90434c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:10:48.000024 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80046df6-e4e6-4d1e-9ca5-e552809616ce admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:48.001470 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-80046df6-e4e6-4d1e-9ca5-e552809616ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:48.015350 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80046df6-e4e6-4d1e-9ca5-e552809616ce admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:48.033681 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:48.074747 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed4325-de9f-4ac5-826d-3b278bc95ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:48.075428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed4325-de9f-4ac5-826d-3b278bc95ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:48.075650 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed4325-de9f-4ac5-826d-3b278bc95ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:48.075926 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed4325-de9f-4ac5-826d-3b278bc95ecf admin admin] PATH_INFO: `/v3/projects/7e61429d004744a5a1674fdeb08d4781` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:48.077150 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed4325-de9f-4ac5-826d-3b278bc95ecf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e61429d004744a5a1674fdeb08d4781)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:48.079184 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed4325-de9f-4ac5-826d-3b278bc95ecf admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:48.178437 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-e8ed4325-de9f-4ac5-826d-3b278bc95ecf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e61429d004744a5a1674fdeb08d4781', 'request_id': 'req-e8ed4325-de9f-4ac5-826d-3b278bc95ecf'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:48.186787 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-e8ed4325-de9f-4ac5-826d-3b278bc95ecf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e61429d004744a5a1674fdeb08d4781', 'request_id': 'req-e8ed4325-de9f-4ac5-826d-3b278bc95ecf'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:48.192898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-e8ed4325-de9f-4ac5-826d-3b278bc95ecf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e61429d004744a5a1674fdeb08d4781', 'request_id': 'req-e8ed4325-de9f-4ac5-826d-3b278bc95ecf'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:48.255681 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-e8ed4325-de9f-4ac5-826d-3b278bc95ecf admin admin] The token cache is being invalidate because project 7e61429d004744a5a1674fdeb08d4781 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:10:48.256064 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-e8ed4325-de9f-4ac5-826d-3b278bc95ecf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:48.256789 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-e8ed4325-de9f-4ac5-826d-3b278bc95ecf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:48.258346 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1252/2522] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:10:47 2022] DELETE /identity/v3/projects/7e61429d004744a5a1674fdeb08d4781 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:10:50.423142 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab31e9f-1a54-4d4b-bc32-ec868fa1ba83 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:50.424673 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-dab31e9f-1a54-4d4b-bc32-ec868fa1ba83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:50.438466 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab31e9f-1a54-4d4b-bc32-ec868fa1ba83 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:50.486103 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:50.495207 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4d116-4aaa-4482-93f3-3be7fa8ac5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:50.495835 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4d116-4aaa-4482-93f3-3be7fa8ac5e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:50.496142 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4d116-4aaa-4482-93f3-3be7fa8ac5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:50.496415 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4d116-4aaa-4482-93f3-3be7fa8ac5e5 admin admin] PATH_INFO: `/v3/users/bfa0b101250d4c4e83cfdbf02d845fca` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:50.497579 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4d116-4aaa-4482-93f3-3be7fa8ac5e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfa0b101250d4c4e83cfdbf02d845fca)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:50.499452 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4d116-4aaa-4482-93f3-3be7fa8ac5e5 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:50.665396 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-06d4d116-4aaa-4482-93f3-3be7fa8ac5e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfa0b101250d4c4e83cfdbf02d845fca'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:50.666065 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-06d4d116-4aaa-4482-93f3-3be7fa8ac5e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfa0b101250d4c4e83cfdbf02d845fca'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:50.666687 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-06d4d116-4aaa-4482-93f3-3be7fa8ac5e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfa0b101250d4c4e83cfdbf02d845fca'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:50.678960 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-06d4d116-4aaa-4482-93f3-3be7fa8ac5e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfa0b101250d4c4e83cfdbf02d845fca'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:50.740465 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-06d4d116-4aaa-4482-93f3-3be7fa8ac5e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfa0b101250d4c4e83cfdbf02d845fca'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:50.753470 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1271/2523] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:10:50 2022] DELETE /identity/v3/users/bfa0b101250d4c4e83cfdbf02d845fca => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:10:50.758758 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56f626-b5b0-476c-9902-499d85187836 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:50.759208 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56f626-b5b0-476c-9902-499d85187836 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:50.759301 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56f626-b5b0-476c-9902-499d85187836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:50.778813 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-5b56f626-b5b0-476c-9902-499d85187836 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:10:50.780008 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-5b56f626-b5b0-476c-9902-499d85187836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:50.839219 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1253/2524] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:10:50.848997 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4d116-4aaa-4482-93f3-3be7fa8ac5e5 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:50.850370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-06d4d116-4aaa-4482-93f3-3be7fa8ac5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:50.913288 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4d116-4aaa-4482-93f3-3be7fa8ac5e5 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:50.913288 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22ffad-d66a-456a-9b14-d620c5525b00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:50.913802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22ffad-d66a-456a-9b14-d620c5525b00 service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:50.914085 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22ffad-d66a-456a-9b14-d620c5525b00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:50.914360 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22ffad-d66a-456a-9b14-d620c5525b00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:50.924051 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22ffad-d66a-456a-9b14-d620c5525b00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:50.925540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22ffad-d66a-456a-9b14-d620c5525b00 service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:50.935217 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1272/2525] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:10:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:10:51.384386 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56f626-b5b0-476c-9902-499d85187836 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:51.385911 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-5b56f626-b5b0-476c-9902-499d85187836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:51.397930 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56f626-b5b0-476c-9902-499d85187836 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:51.402536 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16e50f-9495-4ed4-8c0f-1e878bb747c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:51.403189 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16e50f-9495-4ed4-8c0f-1e878bb747c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:51.403439 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16e50f-9495-4ed4-8c0f-1e878bb747c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:51.408757 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16e50f-9495-4ed4-8c0f-1e878bb747c9 admin admin] PATH_INFO: `/v3/projects/dcbd5a34f8984265a60907a7672cce93` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:51.408757 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d16e50f-9495-4ed4-8c0f-1e878bb747c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcbd5a34f8984265a60907a7672cce93)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:51.408757 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d16e50f-9495-4ed4-8c0f-1e878bb747c9 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:51.522513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:51.525387 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-4d16e50f-9495-4ed4-8c0f-1e878bb747c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcbd5a34f8984265a60907a7672cce93', 'request_id': 'req-4d16e50f-9495-4ed4-8c0f-1e878bb747c9'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:51.531014 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-4d16e50f-9495-4ed4-8c0f-1e878bb747c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcbd5a34f8984265a60907a7672cce93', 'request_id': 'req-4d16e50f-9495-4ed4-8c0f-1e878bb747c9'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:51.538855 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-4d16e50f-9495-4ed4-8c0f-1e878bb747c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcbd5a34f8984265a60907a7672cce93', 'request_id': 'req-4d16e50f-9495-4ed4-8c0f-1e878bb747c9'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:51.621045 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-4d16e50f-9495-4ed4-8c0f-1e878bb747c9 admin admin] The token cache is being invalidate because project dcbd5a34f8984265a60907a7672cce93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:10:51.621337 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-4d16e50f-9495-4ed4-8c0f-1e878bb747c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:51.621955 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-4d16e50f-9495-4ed4-8c0f-1e878bb747c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:51.623435 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1254/2526] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:10:51 2022] DELETE /identity/v3/projects/dcbd5a34f8984265a60907a7672cce93 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:10:51.627423 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22ffad-d66a-456a-9b14-d620c5525b00 service neutron] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:51.637997 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22ffad-d66a-456a-9b14-d620c5525b00 service neutron] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:51.695319 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d576a-5e94-422e-9774-d33d4478cab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:51.695954 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d576a-5e94-422e-9774-d33d4478cab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:51.696235 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d576a-5e94-422e-9774-d33d4478cab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:51.696509 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d576a-5e94-422e-9774-d33d4478cab4 admin admin] PATH_INFO: `/v3/users/4a5b265b35174fffafc5358a6b7a574f` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:51.697682 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d576a-5e94-422e-9774-d33d4478cab4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a5b265b35174fffafc5358a6b7a574f)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:51.699590 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d576a-5e94-422e-9774-d33d4478cab4 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:51.716049 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:51.920455 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-749d576a-5e94-422e-9774-d33d4478cab4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a5b265b35174fffafc5358a6b7a574f'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:51.921223 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-749d576a-5e94-422e-9774-d33d4478cab4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a5b265b35174fffafc5358a6b7a574f'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:51.921839 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-749d576a-5e94-422e-9774-d33d4478cab4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a5b265b35174fffafc5358a6b7a574f'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:51.934460 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-749d576a-5e94-422e-9774-d33d4478cab4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a5b265b35174fffafc5358a6b7a574f'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:52.009024 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-749d576a-5e94-422e-9774-d33d4478cab4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a5b265b35174fffafc5358a6b7a574f'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:52.021665 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1273/2527] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:10:51 2022] DELETE /identity/v3/users/4a5b265b35174fffafc5358a6b7a574f => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:10:52.451281 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16e50f-9495-4ed4-8c0f-1e878bb747c9 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:52.452734 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-4d16e50f-9495-4ed4-8c0f-1e878bb747c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:52.533622 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16e50f-9495-4ed4-8c0f-1e878bb747c9 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:52.589336 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879418dc-0cf8-4584-aed1-81f3a50485a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:52.589959 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879418dc-0cf8-4584-aed1-81f3a50485a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:52.594332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879418dc-0cf8-4584-aed1-81f3a50485a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:52.594639 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879418dc-0cf8-4584-aed1-81f3a50485a1 admin admin] PATH_INFO: `/v3/projects/9f6e44b302a54d9ea0d7ed024989f5ec` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:52.595899 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879418dc-0cf8-4584-aed1-81f3a50485a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f6e44b302a54d9ea0d7ed024989f5ec)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:52.597829 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879418dc-0cf8-4584-aed1-81f3a50485a1 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:52.701364 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-879418dc-0cf8-4584-aed1-81f3a50485a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f6e44b302a54d9ea0d7ed024989f5ec', 'request_id': 'req-879418dc-0cf8-4584-aed1-81f3a50485a1'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:52.706680 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-879418dc-0cf8-4584-aed1-81f3a50485a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f6e44b302a54d9ea0d7ed024989f5ec', 'request_id': 'req-879418dc-0cf8-4584-aed1-81f3a50485a1'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:52.713539 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-879418dc-0cf8-4584-aed1-81f3a50485a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f6e44b302a54d9ea0d7ed024989f5ec', 'request_id': 'req-879418dc-0cf8-4584-aed1-81f3a50485a1'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:52.825693 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-879418dc-0cf8-4584-aed1-81f3a50485a1 admin admin] The token cache is being invalidate because project 9f6e44b302a54d9ea0d7ed024989f5ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:10:52.825983 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-879418dc-0cf8-4584-aed1-81f3a50485a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:52.826595 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-879418dc-0cf8-4584-aed1-81f3a50485a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:52.828106 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1255/2528] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:10:52 2022] DELETE /identity/v3/projects/9f6e44b302a54d9ea0d7ed024989f5ec => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:10:52.834544 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb167c8-43ed-49a2-845e-f8fed0ad0d50 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:52.835023 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb167c8-43ed-49a2-845e-f8fed0ad0d50 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:52.846739 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb167c8-43ed-49a2-845e-f8fed0ad0d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:52.895646 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-7eb167c8-43ed-49a2-845e-f8fed0ad0d50 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:10:52.897249 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-7eb167c8-43ed-49a2-845e-f8fed0ad0d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:52.964092 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1274/2529] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:10:52.971599 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915eb21-5dfd-47d7-8aa6-e0981631fe1c None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:52.971896 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915eb21-5dfd-47d7-8aa6-e0981631fe1c None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:52.972169 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915eb21-5dfd-47d7-8aa6-e0981631fe1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:52.980988 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:52.995522 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-0915eb21-5dfd-47d7-8aa6-e0981631fe1c None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:10:52.996892 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-0915eb21-5dfd-47d7-8aa6-e0981631fe1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:53.016266 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1256/2530] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:10:53.017862 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb167c8-43ed-49a2-845e-f8fed0ad0d50 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:53.029095 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb167c8-43ed-49a2-845e-f8fed0ad0d50 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:53.035889 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2a092-6360-4da3-ba53-f23e654c7464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:53.036790 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2a092-6360-4da3-ba53-f23e654c7464 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:53.037077 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2a092-6360-4da3-ba53-f23e654c7464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:53.037354 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2a092-6360-4da3-ba53-f23e654c7464 admin admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:53.038022 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2a092-6360-4da3-ba53-f23e654c7464 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:10:53.038326 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2a092-6360-4da3-ba53-f23e654c7464 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:53.039959 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2a092-6360-4da3-ba53-f23e654c7464 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:53.052842 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1275/2531] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:10:53.057312 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915eb21-5dfd-47d7-8aa6-e0981631fe1c None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:53.066814 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915eb21-5dfd-47d7-8aa6-e0981631fe1c None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:53.072277 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1cef1-0695-4c59-8a27-74f8c61163ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:53.072905 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1cef1-0695-4c59-8a27-74f8c61163ac admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:53.073179 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1cef1-0695-4c59-8a27-74f8c61163ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:53.073442 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1cef1-0695-4c59-8a27-74f8c61163ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:53.074059 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1cef1-0695-4c59-8a27-74f8c61163ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:53.076202 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1cef1-0695-4c59-8a27-74f8c61163ac admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:53.194214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1257/2532] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:10:53 2022] POST /identity/v3/projects => generated 387 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:10:53.198643 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2a092-6360-4da3-ba53-f23e654c7464 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:53.209497 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2a092-6360-4da3-ba53-f23e654c7464 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:53.258272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:53.268719 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8ac8d-6bad-480c-8d5a-cd4920fd0e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:53.271669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8ac8d-6bad-480c-8d5a-cd4920fd0e49 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:53.271669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8ac8d-6bad-480c-8d5a-cd4920fd0e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:53.271669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8ac8d-6bad-480c-8d5a-cd4920fd0e49 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:53.271669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc8ac8d-6bad-480c-8d5a-cd4920fd0e49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:53.273312 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc8ac8d-6bad-480c-8d5a-cd4920fd0e49 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:53.384767 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1276/2533] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:10:53 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:10:53.386539 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1cef1-0695-4c59-8a27-74f8c61163ac admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:53.397609 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1cef1-0695-4c59-8a27-74f8c61163ac admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:53.402337 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b9a6c-053f-457f-87ed-5cc4b40cfc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:53.403861 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b9a6c-053f-457f-87ed-5cc4b40cfc73 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:53.403861 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b9a6c-053f-457f-87ed-5cc4b40cfc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:53.403861 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b9a6c-053f-457f-87ed-5cc4b40cfc73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:53.404212 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b9a6c-053f-457f-87ed-5cc4b40cfc73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:53.405704 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b9a6c-053f-457f-87ed-5cc4b40cfc73 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:53.416078 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1258/2534] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:10:53.420162 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8ac8d-6bad-480c-8d5a-cd4920fd0e49 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:53.431108 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8ac8d-6bad-480c-8d5a-cd4920fd0e49 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:53.435932 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942b21b-3fab-4e6b-b893-0529812c9fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:53.436529 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942b21b-3fab-4e6b-b893-0529812c9fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:53.436841 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942b21b-3fab-4e6b-b893-0529812c9fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:53.437118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942b21b-3fab-4e6b-b893-0529812c9fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:53.437763 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1942b21b-3fab-4e6b-b893-0529812c9fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:53.439366 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1942b21b-3fab-4e6b-b893-0529812c9fb1 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:53.452317 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1277/2535] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:10:53.456825 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b9a6c-053f-457f-87ed-5cc4b40cfc73 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:53.467009 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b9a6c-053f-457f-87ed-5cc4b40cfc73 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:53.471794 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53668e-85ce-4500-9254-fdbbb11ebe5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:53.472482 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53668e-85ce-4500-9254-fdbbb11ebe5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:53.472773 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53668e-85ce-4500-9254-fdbbb11ebe5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:53.473046 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53668e-85ce-4500-9254-fdbbb11ebe5b admin admin] PATH_INFO: `/v3/projects/21e36ed56e4d4e9697665d7cb3b98e9f/users/22f010763a2f4e9cb42d640ecc6c98ea/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:53.487603 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53668e-85ce-4500-9254-fdbbb11ebe5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=21e36ed56e4d4e9697665d7cb3b98e9f, user_id=22f010763a2f4e9cb42d640ecc6c98ea, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:53.490906 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53668e-85ce-4500-9254-fdbbb11ebe5b admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:53.586673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1259/2536] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:10:53 2022] PUT /identity/v3/projects/21e36ed56e4d4e9697665d7cb3b98e9f/users/22f010763a2f4e9cb42d640ecc6c98ea/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:10:53.596928 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad60637-4789-46e5-83e6-25b59fc7c925 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:53.597215 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad60637-4789-46e5-83e6-25b59fc7c925 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:53.597491 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad60637-4789-46e5-83e6-25b59fc7c925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:53.625092 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-dad60637-4789-46e5-83e6-25b59fc7c925 None None] MFA Rules not processed for user `22f010763a2f4e9cb42d640ecc6c98ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:10:53.626306 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-dad60637-4789-46e5-83e6-25b59fc7c925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:53.689732 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1278/2537] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:10:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:10:53.695001 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53668e-85ce-4500-9254-fdbbb11ebe5b admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:53.756523 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53668e-85ce-4500-9254-fdbbb11ebe5b admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:53.761452 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30b0f1-45ab-4fd9-abb6-bdaf12d6c3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:53.762045 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30b0f1-45ab-4fd9-abb6-bdaf12d6c3a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:53.762322 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30b0f1-45ab-4fd9-abb6-bdaf12d6c3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:53.762591 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30b0f1-45ab-4fd9-abb6-bdaf12d6c3a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:53.763214 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e30b0f1-45ab-4fd9-abb6-bdaf12d6c3a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:53.765146 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e30b0f1-45ab-4fd9-abb6-bdaf12d6c3a6 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:53.879496 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1260/2538] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:10:53 2022] POST /identity/v3/projects => generated 387 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:10:53.884115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad60637-4789-46e5-83e6-25b59fc7c925 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:53.895215 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad60637-4789-46e5-83e6-25b59fc7c925 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:53.951440 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3b802-79de-4c8a-9fe2-4d0d4c3a0246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:53.952042 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3b802-79de-4c8a-9fe2-4d0d4c3a0246 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:53.952319 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3b802-79de-4c8a-9fe2-4d0d4c3a0246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:53.952589 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3b802-79de-4c8a-9fe2-4d0d4c3a0246 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:53.953220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3b802-79de-4c8a-9fe2-4d0d4c3a0246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:53.955123 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3b802-79de-4c8a-9fe2-4d0d4c3a0246 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:54.058887 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1279/2539] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:10:53 2022] POST /identity/v3/users => generated 300 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:10:54.060016 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30b0f1-45ab-4fd9-abb6-bdaf12d6c3a6 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:54.070951 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30b0f1-45ab-4fd9-abb6-bdaf12d6c3a6 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:54.075692 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d7c98-a09c-4c1b-b242-801051ca7f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:54.076340 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d7c98-a09c-4c1b-b242-801051ca7f6f admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:54.076584 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d7c98-a09c-4c1b-b242-801051ca7f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:54.076891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d7c98-a09c-4c1b-b242-801051ca7f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:54.077534 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d7c98-a09c-4c1b-b242-801051ca7f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:54.079134 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d7c98-a09c-4c1b-b242-801051ca7f6f admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:54.090698 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1261/2540] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:10:54.095057 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3b802-79de-4c8a-9fe2-4d0d4c3a0246 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:54.106037 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3b802-79de-4c8a-9fe2-4d0d4c3a0246 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:54.110892 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e98f6-2518-4007-8d7a-793afabe459b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:54.111617 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e98f6-2518-4007-8d7a-793afabe459b admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:54.111901 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e98f6-2518-4007-8d7a-793afabe459b admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:54.112178 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e98f6-2518-4007-8d7a-793afabe459b admin admin] PATH_INFO: `/v3/projects/f799e25ee2bd4d0eb769185a2fc894c5/users/ed07e24437ed4c6793978c8ae0deb382/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:54.128324 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e98f6-2518-4007-8d7a-793afabe459b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f799e25ee2bd4d0eb769185a2fc894c5, user_id=ed07e24437ed4c6793978c8ae0deb382, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:54.131484 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e98f6-2518-4007-8d7a-793afabe459b admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:54.193689 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1280/2541] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:10:54 2022] PUT /identity/v3/projects/f799e25ee2bd4d0eb769185a2fc894c5/users/ed07e24437ed4c6793978c8ae0deb382/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:10:54.197779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d7c98-a09c-4c1b-b242-801051ca7f6f admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:54.208488 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d7c98-a09c-4c1b-b242-801051ca7f6f admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:54.267403 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94968c-9146-47f3-b27f-ec0663c8324b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:54.268016 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94968c-9146-47f3-b27f-ec0663c8324b admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:54.268299 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94968c-9146-47f3-b27f-ec0663c8324b admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:54.268575 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94968c-9146-47f3-b27f-ec0663c8324b admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:54.269252 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94968c-9146-47f3-b27f-ec0663c8324b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:54.271534 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94968c-9146-47f3-b27f-ec0663c8324b admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:54.282282 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1262/2542] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:10:54.286984 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e98f6-2518-4007-8d7a-793afabe459b admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:54.298153 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e98f6-2518-4007-8d7a-793afabe459b admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:54.307675 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04785842-e6c3-496a-82b2-52d0b28a1bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:54.310092 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04785842-e6c3-496a-82b2-52d0b28a1bd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:54.310092 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04785842-e6c3-496a-82b2-52d0b28a1bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:54.310092 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04785842-e6c3-496a-82b2-52d0b28a1bd1 admin admin] PATH_INFO: `/v3/projects/f799e25ee2bd4d0eb769185a2fc894c5/users/ed07e24437ed4c6793978c8ae0deb382/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:54.311166 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04785842-e6c3-496a-82b2-52d0b28a1bd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f799e25ee2bd4d0eb769185a2fc894c5, user_id=ed07e24437ed4c6793978c8ae0deb382, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:54.313925 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04785842-e6c3-496a-82b2-52d0b28a1bd1 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:54.325853 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1281/2543] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:10:54 2022] PUT /identity/v3/projects/f799e25ee2bd4d0eb769185a2fc894c5/users/ed07e24437ed4c6793978c8ae0deb382/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:10:54.338045 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991adfd-3fec-4699-8726-3b1957cab24f None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:54.342697 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991adfd-3fec-4699-8726-3b1957cab24f None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:54.342697 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991adfd-3fec-4699-8726-3b1957cab24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:54.358612 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:54.368086 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-b991adfd-3fec-4699-8726-3b1957cab24f None None] MFA Rules not processed for user `ed07e24437ed4c6793978c8ae0deb382`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:10:54.369355 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-b991adfd-3fec-4699-8726-3b1957cab24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:54.398654 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04785842-e6c3-496a-82b2-52d0b28a1bd1 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:54.400368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-04785842-e6c3-496a-82b2-52d0b28a1bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:54.417277 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:54.443254 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1263/2544] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:10:54 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:10:54.455788 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991adfd-3fec-4699-8726-3b1957cab24f None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:54.457170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-b991adfd-3fec-4699-8726-3b1957cab24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:54.478997 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04785842-e6c3-496a-82b2-52d0b28a1bd1 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:54.483100 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af02ba-85f9-4fac-9c28-d32321eb5894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:54.483704 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af02ba-85f9-4fac-9c28-d32321eb5894 service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:54.483982 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af02ba-85f9-4fac-9c28-d32321eb5894 service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:54.484250 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af02ba-85f9-4fac-9c28-d32321eb5894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:54.486070 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-12af02ba-85f9-4fac-9c28-d32321eb5894 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:54.515805 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991adfd-3fec-4699-8726-3b1957cab24f None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:54.519575 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8634c-668b-4e04-83be-66c87bd97c55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:54.520869 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8634c-668b-4e04-83be-66c87bd97c55 service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:54.521352 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8634c-668b-4e04-83be-66c87bd97c55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:54.521726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8634c-668b-4e04-83be-66c87bd97c55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:54.531042 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8634c-668b-4e04-83be-66c87bd97c55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:54.532458 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8634c-668b-4e04-83be-66c87bd97c55 service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:54.542601 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1264/2545] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:10:54 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:10:54.551908 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af02ba-85f9-4fac-9c28-d32321eb5894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:54.553542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af02ba-85f9-4fac-9c28-d32321eb5894 service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:54.563160 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1282/2546] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:10:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:10:54.571889 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8634c-668b-4e04-83be-66c87bd97c55 service cinder] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:54.637569 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8634c-668b-4e04-83be-66c87bd97c55 service cinder] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:54.642483 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a946b36-2260-4c23-a364-82d2180b73a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:54.643171 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a946b36-2260-4c23-a364-82d2180b73a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:54.643454 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a946b36-2260-4c23-a364-82d2180b73a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:54.643730 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a946b36-2260-4c23-a364-82d2180b73a9 admin admin] PATH_INFO: `/v3/users/22f010763a2f4e9cb42d640ecc6c98ea` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:54.644902 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a946b36-2260-4c23-a364-82d2180b73a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22f010763a2f4e9cb42d640ecc6c98ea)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:54.647566 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a946b36-2260-4c23-a364-82d2180b73a9 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:54.898163 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:54.904085 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0a946b36-2260-4c23-a364-82d2180b73a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22f010763a2f4e9cb42d640ecc6c98ea'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:54.904788 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0a946b36-2260-4c23-a364-82d2180b73a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22f010763a2f4e9cb42d640ecc6c98ea'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:54.905447 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0a946b36-2260-4c23-a364-82d2180b73a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22f010763a2f4e9cb42d640ecc6c98ea'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:54.969382 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0a946b36-2260-4c23-a364-82d2180b73a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22f010763a2f4e9cb42d640ecc6c98ea'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:54.977045 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0a946b36-2260-4c23-a364-82d2180b73a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22f010763a2f4e9cb42d640ecc6c98ea'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:54.996148 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1265/2547] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:10:54 2022] DELETE /identity/v3/users/22f010763a2f4e9cb42d640ecc6c98ea => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:10:55.000727 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7746a6a-79e1-432d-a2e1-2ac16591ddf4 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:55.001231 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7746a6a-79e1-432d-a2e1-2ac16591ddf4 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:55.001403 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7746a6a-79e1-432d-a2e1-2ac16591ddf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:55.022472 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-b7746a6a-79e1-432d-a2e1-2ac16591ddf4 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:10:55.023957 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-b7746a6a-79e1-432d-a2e1-2ac16591ddf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:55.086868 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1283/2548] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:10:55.096637 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a946b36-2260-4c23-a364-82d2180b73a9 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:55.098129 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-0a946b36-2260-4c23-a364-82d2180b73a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:55.158693 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a946b36-2260-4c23-a364-82d2180b73a9 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:55.162276 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5264713-dd9d-4b27-948e-cff5d55d0c22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:55.162876 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5264713-dd9d-4b27-948e-cff5d55d0c22 service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:55.163157 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5264713-dd9d-4b27-948e-cff5d55d0c22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:55.163428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5264713-dd9d-4b27-948e-cff5d55d0c22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:55.172337 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5264713-dd9d-4b27-948e-cff5d55d0c22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:55.173834 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5264713-dd9d-4b27-948e-cff5d55d0c22 service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:55.184044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1266/2549] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:10:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:10:56.028557 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7746a6a-79e1-432d-a2e1-2ac16591ddf4 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:56.030117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-b7746a6a-79e1-432d-a2e1-2ac16591ddf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:56.042937 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7746a6a-79e1-432d-a2e1-2ac16591ddf4 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:56.048790 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599b939-93ba-42c0-a0cb-a348bec0b048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:56.049443 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599b939-93ba-42c0-a0cb-a348bec0b048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:56.049727 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599b939-93ba-42c0-a0cb-a348bec0b048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:56.050004 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599b939-93ba-42c0-a0cb-a348bec0b048 admin admin] PATH_INFO: `/v3/projects/21e36ed56e4d4e9697665d7cb3b98e9f` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:56.051150 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d599b939-93ba-42c0-a0cb-a348bec0b048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21e36ed56e4d4e9697665d7cb3b98e9f)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:56.053122 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d599b939-93ba-42c0-a0cb-a348bec0b048 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:56.164823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:56.170476 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d599b939-93ba-42c0-a0cb-a348bec0b048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21e36ed56e4d4e9697665d7cb3b98e9f', 'request_id': 'req-d599b939-93ba-42c0-a0cb-a348bec0b048'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:56.250118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d599b939-93ba-42c0-a0cb-a348bec0b048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21e36ed56e4d4e9697665d7cb3b98e9f', 'request_id': 'req-d599b939-93ba-42c0-a0cb-a348bec0b048'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:56.257962 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d599b939-93ba-42c0-a0cb-a348bec0b048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21e36ed56e4d4e9697665d7cb3b98e9f', 'request_id': 'req-d599b939-93ba-42c0-a0cb-a348bec0b048'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:56.268614 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d599b939-93ba-42c0-a0cb-a348bec0b048 admin admin] The token cache is being invalidate because project 21e36ed56e4d4e9697665d7cb3b98e9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:10:56.268935 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d599b939-93ba-42c0-a0cb-a348bec0b048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:56.269579 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d599b939-93ba-42c0-a0cb-a348bec0b048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:56.271761 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1284/2550] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:10:56 2022] DELETE /identity/v3/projects/21e36ed56e4d4e9697665d7cb3b98e9f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:10:56.275785 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5264713-dd9d-4b27-948e-cff5d55d0c22 service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:56.285618 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5264713-dd9d-4b27-948e-cff5d55d0c22 service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:56.345273 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d692f7-6ef1-4aa1-9e80-5ea70522ce67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:56.345908 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d692f7-6ef1-4aa1-9e80-5ea70522ce67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:56.346312 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d692f7-6ef1-4aa1-9e80-5ea70522ce67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:56.346597 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d692f7-6ef1-4aa1-9e80-5ea70522ce67 admin admin] PATH_INFO: `/v3/users/ed07e24437ed4c6793978c8ae0deb382` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:56.347733 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d692f7-6ef1-4aa1-9e80-5ea70522ce67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed07e24437ed4c6793978c8ae0deb382)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:56.350449 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d692f7-6ef1-4aa1-9e80-5ea70522ce67 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:56.573560 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c5d692f7-6ef1-4aa1-9e80-5ea70522ce67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed07e24437ed4c6793978c8ae0deb382'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:56.574233 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c5d692f7-6ef1-4aa1-9e80-5ea70522ce67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed07e24437ed4c6793978c8ae0deb382'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:56.574846 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c5d692f7-6ef1-4aa1-9e80-5ea70522ce67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed07e24437ed4c6793978c8ae0deb382'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:56.644506 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c5d692f7-6ef1-4aa1-9e80-5ea70522ce67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed07e24437ed4c6793978c8ae0deb382'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:56.651212 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:56.653484 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c5d692f7-6ef1-4aa1-9e80-5ea70522ce67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed07e24437ed4c6793978c8ae0deb382'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:56.672140 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1267/2551] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:10:56 2022] DELETE /identity/v3/users/ed07e24437ed4c6793978c8ae0deb382 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:10:57.206141 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599b939-93ba-42c0-a0cb-a348bec0b048 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:57.212128 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-d599b939-93ba-42c0-a0cb-a348bec0b048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:57.224258 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599b939-93ba-42c0-a0cb-a348bec0b048 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:57.302042 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1d82f-aa93-4c4b-b4e9-fdeacb1fa960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:57.302718 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1d82f-aa93-4c4b-b4e9-fdeacb1fa960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:57.303000 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1d82f-aa93-4c4b-b4e9-fdeacb1fa960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:57.303275 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1d82f-aa93-4c4b-b4e9-fdeacb1fa960 admin admin] PATH_INFO: `/v3/projects/f799e25ee2bd4d0eb769185a2fc894c5` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:57.304455 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1d82f-aa93-4c4b-b4e9-fdeacb1fa960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f799e25ee2bd4d0eb769185a2fc894c5)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:57.306420 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1d82f-aa93-4c4b-b4e9-fdeacb1fa960 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:57.425503 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-13c1d82f-aa93-4c4b-b4e9-fdeacb1fa960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f799e25ee2bd4d0eb769185a2fc894c5', 'request_id': 'req-13c1d82f-aa93-4c4b-b4e9-fdeacb1fa960'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:57.493860 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-13c1d82f-aa93-4c4b-b4e9-fdeacb1fa960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f799e25ee2bd4d0eb769185a2fc894c5', 'request_id': 'req-13c1d82f-aa93-4c4b-b4e9-fdeacb1fa960'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:57.501771 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-13c1d82f-aa93-4c4b-b4e9-fdeacb1fa960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f799e25ee2bd4d0eb769185a2fc894c5', 'request_id': 'req-13c1d82f-aa93-4c4b-b4e9-fdeacb1fa960'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:57.516433 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-13c1d82f-aa93-4c4b-b4e9-fdeacb1fa960 admin admin] The token cache is being invalidate because project f799e25ee2bd4d0eb769185a2fc894c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:10:57.516682 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-13c1d82f-aa93-4c4b-b4e9-fdeacb1fa960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:57.520704 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-13c1d82f-aa93-4c4b-b4e9-fdeacb1fa960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:10:57.520704 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1285/2552] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:10:57 2022] DELETE /identity/v3/projects/f799e25ee2bd4d0eb769185a2fc894c5 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:10:57.523962 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e4488-d912-4711-a223-4a624d1d06b1 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:57.524494 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e4488-d912-4711-a223-4a624d1d06b1 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:57.524613 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e4488-d912-4711-a223-4a624d1d06b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:57.546036 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-f03e4488-d912-4711-a223-4a624d1d06b1 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:10:57.547314 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-f03e4488-d912-4711-a223-4a624d1d06b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:57.610152 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1268/2553] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:10:57.619305 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5822953-7c86-4601-9de3-7efecc461992 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:57.619630 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5822953-7c86-4601-9de3-7efecc461992 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:57.619902 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5822953-7c86-4601-9de3-7efecc461992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:57.642281 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-f5822953-7c86-4601-9de3-7efecc461992 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:10:57.643522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-f5822953-7c86-4601-9de3-7efecc461992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:57.651746 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1286/2554] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:10:57.661574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e4488-d912-4711-a223-4a624d1d06b1 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:57.671462 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e4488-d912-4711-a223-4a624d1d06b1 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:57.677652 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c1ba8-d574-412b-a94b-6b3204caf8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:57.678294 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c1ba8-d574-412b-a94b-6b3204caf8ef admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:57.678585 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c1ba8-d574-412b-a94b-6b3204caf8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:57.681313 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c1ba8-d574-412b-a94b-6b3204caf8ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:57.681313 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504c1ba8-d574-412b-a94b-6b3204caf8ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:10:57.681313 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504c1ba8-d574-412b-a94b-6b3204caf8ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:57.681579 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504c1ba8-d574-412b-a94b-6b3204caf8ef admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:57.697154 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1269/2555] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:10:57.698291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5822953-7c86-4601-9de3-7efecc461992 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:57.708161 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5822953-7c86-4601-9de3-7efecc461992 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:57.713078 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f3c18-41c8-4c93-9675-721f0a13ddf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:57.713715 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f3c18-41c8-4c93-9675-721f0a13ddf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:57.713994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f3c18-41c8-4c93-9675-721f0a13ddf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:57.714265 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f3c18-41c8-4c93-9675-721f0a13ddf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:57.715019 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f3c18-41c8-4c93-9675-721f0a13ddf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:57.717186 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f3c18-41c8-4c93-9675-721f0a13ddf3 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:57.806859 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1287/2556] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:10:57 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:10:57.811032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c1ba8-d574-412b-a94b-6b3204caf8ef admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:57.821794 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c1ba8-d574-412b-a94b-6b3204caf8ef admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:57.894828 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939d934-6dbc-4a52-a618-6dc0622a062a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:57.896168 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939d934-6dbc-4a52-a618-6dc0622a062a admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:57.896448 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939d934-6dbc-4a52-a618-6dc0622a062a admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:57.896762 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939d934-6dbc-4a52-a618-6dc0622a062a admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:57.897400 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939d934-6dbc-4a52-a618-6dc0622a062a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:57.900010 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939d934-6dbc-4a52-a618-6dc0622a062a admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:57.995845 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1270/2557] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:10:57 2022] POST /identity/v3/users => generated 291 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:10:57.997403 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f3c18-41c8-4c93-9675-721f0a13ddf3 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:58.007834 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f3c18-41c8-4c93-9675-721f0a13ddf3 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:58.012806 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a105952-8096-4d70-8ae2-430c3d6d763d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:58.013420 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a105952-8096-4d70-8ae2-430c3d6d763d admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:58.013702 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a105952-8096-4d70-8ae2-430c3d6d763d admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:58.015425 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a105952-8096-4d70-8ae2-430c3d6d763d admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:58.016086 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a105952-8096-4d70-8ae2-430c3d6d763d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:58.017706 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a105952-8096-4d70-8ae2-430c3d6d763d admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:58.028996 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1288/2558] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:10:58.033056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939d934-6dbc-4a52-a618-6dc0622a062a admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:58.044376 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939d934-6dbc-4a52-a618-6dc0622a062a admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:58.048984 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ac83a-a22e-4bab-b2da-7d9b3ca672cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:58.049584 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ac83a-a22e-4bab-b2da-7d9b3ca672cd admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:58.049958 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ac83a-a22e-4bab-b2da-7d9b3ca672cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:58.050239 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ac83a-a22e-4bab-b2da-7d9b3ca672cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:58.050876 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ac83a-a22e-4bab-b2da-7d9b3ca672cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:58.052697 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ac83a-a22e-4bab-b2da-7d9b3ca672cd admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:58.063765 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1271/2559] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:10:58.068055 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a105952-8096-4d70-8ae2-430c3d6d763d admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:58.079013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a105952-8096-4d70-8ae2-430c3d6d763d admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:58.084602 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc935edb-c127-4ff4-92e9-08164e3979d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:58.085422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc935edb-c127-4ff4-92e9-08164e3979d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:58.085775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc935edb-c127-4ff4-92e9-08164e3979d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:58.086147 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc935edb-c127-4ff4-92e9-08164e3979d8 admin admin] PATH_INFO: `/v3/projects/c5465039fc664712a31fd621abd33470/users/7c79a282b6f542d5a8c9a34baf2da5ac/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:58.102988 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc935edb-c127-4ff4-92e9-08164e3979d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5465039fc664712a31fd621abd33470, user_id=7c79a282b6f542d5a8c9a34baf2da5ac, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:58.105711 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc935edb-c127-4ff4-92e9-08164e3979d8 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:58.108787 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:58.252639 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1289/2560] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:10:58 2022] PUT /identity/v3/projects/c5465039fc664712a31fd621abd33470/users/7c79a282b6f542d5a8c9a34baf2da5ac/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:10:58.265497 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adc46b-80e3-4c22-bd38-024e13208ec0 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:58.265780 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adc46b-80e3-4c22-bd38-024e13208ec0 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:58.266158 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adc46b-80e3-4c22-bd38-024e13208ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:58.297058 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-b2adc46b-80e3-4c22-bd38-024e13208ec0 None None] MFA Rules not processed for user `7c79a282b6f542d5a8c9a34baf2da5ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:10:58.298263 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-b2adc46b-80e3-4c22-bd38-024e13208ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:58.331869 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:58.363442 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1272/2561] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:10:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:10:58.368827 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc935edb-c127-4ff4-92e9-08164e3979d8 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:58.432128 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc935edb-c127-4ff4-92e9-08164e3979d8 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:58.436845 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb0724-520b-45ac-9b45-17cbc4120c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:58.437443 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb0724-520b-45ac-9b45-17cbc4120c4e admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:58.437726 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb0724-520b-45ac-9b45-17cbc4120c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:58.437995 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb0724-520b-45ac-9b45-17cbc4120c4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:58.438623 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb0724-520b-45ac-9b45-17cbc4120c4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:58.440510 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb0724-520b-45ac-9b45-17cbc4120c4e admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:58.513412 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1290/2562] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:10:58 2022] POST /identity/v3/projects => generated 379 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:10:58.517536 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adc46b-80e3-4c22-bd38-024e13208ec0 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:58.528549 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adc46b-80e3-4c22-bd38-024e13208ec0 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:58.586728 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e2930-9b8e-4676-be69-961c48846905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:58.587255 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e2930-9b8e-4676-be69-961c48846905 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:58.587533 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e2930-9b8e-4676-be69-961c48846905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:58.587804 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e2930-9b8e-4676-be69-961c48846905 admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:58.588420 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e2930-9b8e-4676-be69-961c48846905 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:58.590367 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e2930-9b8e-4676-be69-961c48846905 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:58.689230 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1273/2563] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:10:58 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:10:58.693672 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb0724-520b-45ac-9b45-17cbc4120c4e admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:58.704363 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb0724-520b-45ac-9b45-17cbc4120c4e admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:58.709753 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b7a4e-cbcd-483c-8601-b7932c0b39ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:58.710359 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b7a4e-cbcd-483c-8601-b7932c0b39ea admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:58.710666 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b7a4e-cbcd-483c-8601-b7932c0b39ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:58.710971 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b7a4e-cbcd-483c-8601-b7932c0b39ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:58.711621 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b7a4e-cbcd-483c-8601-b7932c0b39ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:58.713334 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b7a4e-cbcd-483c-8601-b7932c0b39ea admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:58.725799 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1291/2564] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:10:58.730670 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e2930-9b8e-4676-be69-961c48846905 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:58.742041 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e2930-9b8e-4676-be69-961c48846905 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:58.747303 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3463d9-842b-4422-9b94-ca3a0a049b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:58.747818 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3463d9-842b-4422-9b94-ca3a0a049b62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:58.748101 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3463d9-842b-4422-9b94-ca3a0a049b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:58.748443 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3463d9-842b-4422-9b94-ca3a0a049b62 admin admin] PATH_INFO: `/v3/projects/027b156ffc384f0b8026f89c87e958fb/users/9da50572210e4a539e22eb66f54e22d2/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:58.766323 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3463d9-842b-4422-9b94-ca3a0a049b62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=027b156ffc384f0b8026f89c87e958fb, user_id=9da50572210e4a539e22eb66f54e22d2, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:58.769085 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3463d9-842b-4422-9b94-ca3a0a049b62 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:58.906737 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1274/2565] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:10:58 2022] PUT /identity/v3/projects/027b156ffc384f0b8026f89c87e958fb/users/9da50572210e4a539e22eb66f54e22d2/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:10:58.911386 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b7a4e-cbcd-483c-8601-b7932c0b39ea admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:58.921765 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b7a4e-cbcd-483c-8601-b7932c0b39ea admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:58.980977 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46aced5-bb84-4133-bb7c-9a03229a0149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:58.981580 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46aced5-bb84-4133-bb7c-9a03229a0149 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:58.981859 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46aced5-bb84-4133-bb7c-9a03229a0149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:58.982129 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46aced5-bb84-4133-bb7c-9a03229a0149 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:58.982797 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46aced5-bb84-4133-bb7c-9a03229a0149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:58.984375 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46aced5-bb84-4133-bb7c-9a03229a0149 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:58.994367 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1292/2566] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:10:58.998645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3463d9-842b-4422-9b94-ca3a0a049b62 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:59.016654 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3463d9-842b-4422-9b94-ca3a0a049b62 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:59.022190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d52263-ce46-4a93-b8f8-0bae05b7e020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:59.022895 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d52263-ce46-4a93-b8f8-0bae05b7e020 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:59.023177 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d52263-ce46-4a93-b8f8-0bae05b7e020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:59.023455 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d52263-ce46-4a93-b8f8-0bae05b7e020 admin admin] PATH_INFO: `/v3/projects/027b156ffc384f0b8026f89c87e958fb/users/9da50572210e4a539e22eb66f54e22d2/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:59.025397 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d52263-ce46-4a93-b8f8-0bae05b7e020 admin admin] RBAC: Authorizing `identity:create_grant(project_id=027b156ffc384f0b8026f89c87e958fb, user_id=9da50572210e4a539e22eb66f54e22d2, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:59.028014 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d52263-ce46-4a93-b8f8-0bae05b7e020 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:59.038788 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1275/2567] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:10:58 2022] PUT /identity/v3/projects/027b156ffc384f0b8026f89c87e958fb/users/9da50572210e4a539e22eb66f54e22d2/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:10:59.049252 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff531421-6a45-4ca1-b1ae-855a386df1ed None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:59.049646 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff531421-6a45-4ca1-b1ae-855a386df1ed None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:59.049925 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff531421-6a45-4ca1-b1ae-855a386df1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:59.078259 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-ff531421-6a45-4ca1-b1ae-855a386df1ed None None] MFA Rules not processed for user `9da50572210e4a539e22eb66f54e22d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:10:59.083440 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-ff531421-6a45-4ca1-b1ae-855a386df1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:59.131274 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:59.149839 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1293/2568] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:10:59 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:10:59.163241 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d52263-ce46-4a93-b8f8-0bae05b7e020 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:10:59.168720 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e7d52263-ce46-4a93-b8f8-0bae05b7e020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:10:59.224340 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d52263-ce46-4a93-b8f8-0bae05b7e020 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:10:59.228051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91765198-e5bc-496c-9f32-ad49bff14b5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:10:59.228666 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91765198-e5bc-496c-9f32-ad49bff14b5b service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:10:59.228950 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91765198-e5bc-496c-9f32-ad49bff14b5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:10:59.229224 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91765198-e5bc-496c-9f32-ad49bff14b5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:10:59.238475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91765198-e5bc-496c-9f32-ad49bff14b5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:10:59.240120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91765198-e5bc-496c-9f32-ad49bff14b5b service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:10:59.249494 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1276/2569] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:10:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:11:00.119873 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff531421-6a45-4ca1-b1ae-855a386df1ed None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:00.129131 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff531421-6a45-4ca1-b1ae-855a386df1ed None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:00.134096 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37ff62-44fd-4f92-ab05-48bd66efcf12 tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9da50572210e4a539e22eb66f54e22d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027b156ffc384f0b8026f89c87e958fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:00.134693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37ff62-44fd-4f92-ab05-48bd66efcf12 tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:00.134973 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37ff62-44fd-4f92-ab05-48bd66efcf12 tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:00.135249 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37ff62-44fd-4f92-ab05-48bd66efcf12 tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:00.135926 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b37ff62-44fd-4f92-ab05-48bd66efcf12 tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:11:00.136231 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b37ff62-44fd-4f92-ab05-48bd66efcf12 tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:00.137929 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b37ff62-44fd-4f92-ab05-48bd66efcf12 tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:00.150076 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1294/2570] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:11:00.154093 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91765198-e5bc-496c-9f32-ad49bff14b5b service cinder] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:00.163899 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91765198-e5bc-496c-9f32-ad49bff14b5b service cinder] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:00.168703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18711d1-b319-47a2-9cbe-94e476df180c tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9da50572210e4a539e22eb66f54e22d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027b156ffc384f0b8026f89c87e958fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:00.169344 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18711d1-b319-47a2-9cbe-94e476df180c tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:00.169630 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18711d1-b319-47a2-9cbe-94e476df180c tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:00.169907 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18711d1-b319-47a2-9cbe-94e476df180c tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:00.170537 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18711d1-b319-47a2-9cbe-94e476df180c tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:00.172500 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18711d1-b319-47a2-9cbe-94e476df180c tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:00.245310 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1277/2571] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:11:00 2022] POST /identity/v3/projects => generated 355 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:11:00.249571 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37ff62-44fd-4f92-ab05-48bd66efcf12 tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:00.260690 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37ff62-44fd-4f92-ab05-48bd66efcf12 tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:00.323603 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9addb60-5cbc-4458-a186-509374a1378c tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9da50572210e4a539e22eb66f54e22d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027b156ffc384f0b8026f89c87e958fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:00.326534 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9addb60-5cbc-4458-a186-509374a1378c tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:00.326534 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9addb60-5cbc-4458-a186-509374a1378c tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:00.326534 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9addb60-5cbc-4458-a186-509374a1378c tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:00.326534 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9addb60-5cbc-4458-a186-509374a1378c tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:11:00.326534 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9addb60-5cbc-4458-a186-509374a1378c tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:00.327304 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9addb60-5cbc-4458-a186-509374a1378c tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:00.340289 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1295/2572] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:11:00.382249 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18711d1-b319-47a2-9cbe-94e476df180c tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:00.393313 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18711d1-b319-47a2-9cbe-94e476df180c tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:00.399217 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4ed34-e1db-4456-b8fb-d2abeb72e7e6 tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9da50572210e4a539e22eb66f54e22d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027b156ffc384f0b8026f89c87e958fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:00.400401 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4ed34-e1db-4456-b8fb-d2abeb72e7e6 tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:00.400729 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4ed34-e1db-4456-b8fb-d2abeb72e7e6 tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:00.401002 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4ed34-e1db-4456-b8fb-d2abeb72e7e6 tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] PATH_INFO: `/v3/projects/a46518bec3354a06984d19aeb8a5ec78` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:00.402600 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4ed34-e1db-4456-b8fb-d2abeb72e7e6 tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a46518bec3354a06984d19aeb8a5ec78)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:00.404452 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4ed34-e1db-4456-b8fb-d2abeb72e7e6 tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:00.405963 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:00.506941 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0ea4ed34-e1db-4456-b8fb-d2abeb72e7e6 tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a46518bec3354a06984d19aeb8a5ec78', 'request_id': 'req-0ea4ed34-e1db-4456-b8fb-d2abeb72e7e6'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:00.512696 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0ea4ed34-e1db-4456-b8fb-d2abeb72e7e6 tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a46518bec3354a06984d19aeb8a5ec78', 'request_id': 'req-0ea4ed34-e1db-4456-b8fb-d2abeb72e7e6'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:00.519317 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0ea4ed34-e1db-4456-b8fb-d2abeb72e7e6 tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a46518bec3354a06984d19aeb8a5ec78', 'request_id': 'req-0ea4ed34-e1db-4456-b8fb-d2abeb72e7e6'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:00.620064 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0ea4ed34-e1db-4456-b8fb-d2abeb72e7e6 tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] The token cache is being invalidate because project a46518bec3354a06984d19aeb8a5ec78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:11:00.620258 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0ea4ed34-e1db-4456-b8fb-d2abeb72e7e6 tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:00.620926 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0ea4ed34-e1db-4456-b8fb-d2abeb72e7e6 tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:00.622417 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1278/2573] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:11:00 2022] DELETE /identity/v3/projects/a46518bec3354a06984d19aeb8a5ec78 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:11:01.246855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9addb60-5cbc-4458-a186-509374a1378c tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:01.248715 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-c9addb60-5cbc-4458-a186-509374a1378c tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:01.315525 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9addb60-5cbc-4458-a186-509374a1378c tempest-VolumeQuotaClassesTest-582034473 tempest-VolumeQuotaClassesTest-582034473-project-admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:01.373126 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c640898-cd98-46ad-b940-8154e6630c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:01.373675 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c640898-cd98-46ad-b940-8154e6630c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:01.373951 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c640898-cd98-46ad-b940-8154e6630c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:01.374220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c640898-cd98-46ad-b940-8154e6630c52 admin admin] PATH_INFO: `/v3/users/7c79a282b6f542d5a8c9a34baf2da5ac` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:01.375328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c640898-cd98-46ad-b940-8154e6630c52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c79a282b6f542d5a8c9a34baf2da5ac)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:01.377272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c640898-cd98-46ad-b940-8154e6630c52 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:01.400282 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:01.554995 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-3c640898-cd98-46ad-b940-8154e6630c52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c79a282b6f542d5a8c9a34baf2da5ac'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:01.555660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-3c640898-cd98-46ad-b940-8154e6630c52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c79a282b6f542d5a8c9a34baf2da5ac'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:01.556276 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-3c640898-cd98-46ad-b940-8154e6630c52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c79a282b6f542d5a8c9a34baf2da5ac'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:01.569127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-3c640898-cd98-46ad-b940-8154e6630c52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c79a282b6f542d5a8c9a34baf2da5ac'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:01.654942 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-3c640898-cd98-46ad-b940-8154e6630c52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c79a282b6f542d5a8c9a34baf2da5ac'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:01.667862 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1296/2574] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:11:01 2022] DELETE /identity/v3/users/7c79a282b6f542d5a8c9a34baf2da5ac => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:11:01.672435 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0df584-2bb8-4092-91e9-42255dfe34e0 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:01.672962 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0df584-2bb8-4092-91e9-42255dfe34e0 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:01.673070 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0df584-2bb8-4092-91e9-42255dfe34e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:01.693607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-7d0df584-2bb8-4092-91e9-42255dfe34e0 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:11:01.694792 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-7d0df584-2bb8-4092-91e9-42255dfe34e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:01.752344 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1279/2575] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:11:01.762838 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c640898-cd98-46ad-b940-8154e6630c52 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:01.764224 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-3c640898-cd98-46ad-b940-8154e6630c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:01.821501 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c640898-cd98-46ad-b940-8154e6630c52 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:01.830686 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03e508-8c77-4597-a4e1-6876c0d7bb34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:01.831307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03e508-8c77-4597-a4e1-6876c0d7bb34 service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:01.831589 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03e508-8c77-4597-a4e1-6876c0d7bb34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:01.831860 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03e508-8c77-4597-a4e1-6876c0d7bb34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:01.841860 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03e508-8c77-4597-a4e1-6876c0d7bb34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:01.843292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03e508-8c77-4597-a4e1-6876c0d7bb34 service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:01.853196 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1297/2576] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:11:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:11:02.240053 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0df584-2bb8-4092-91e9-42255dfe34e0 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:02.241539 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-7d0df584-2bb8-4092-91e9-42255dfe34e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:02.258165 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0df584-2bb8-4092-91e9-42255dfe34e0 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:02.264337 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c1638-3ca0-41af-b8e0-b02730d8c560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:02.265066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c1638-3ca0-41af-b8e0-b02730d8c560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:02.265238 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c1638-3ca0-41af-b8e0-b02730d8c560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:02.265526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c1638-3ca0-41af-b8e0-b02730d8c560 admin admin] PATH_INFO: `/v3/projects/c5465039fc664712a31fd621abd33470` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:02.266797 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c1638-3ca0-41af-b8e0-b02730d8c560 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5465039fc664712a31fd621abd33470)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:02.268651 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c1638-3ca0-41af-b8e0-b02730d8c560 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:02.366380 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c77c1638-3ca0-41af-b8e0-b02730d8c560 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5465039fc664712a31fd621abd33470', 'request_id': 'req-c77c1638-3ca0-41af-b8e0-b02730d8c560'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:02.372032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c77c1638-3ca0-41af-b8e0-b02730d8c560 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5465039fc664712a31fd621abd33470', 'request_id': 'req-c77c1638-3ca0-41af-b8e0-b02730d8c560'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:02.378443 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c77c1638-3ca0-41af-b8e0-b02730d8c560 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5465039fc664712a31fd621abd33470', 'request_id': 'req-c77c1638-3ca0-41af-b8e0-b02730d8c560'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:02.461397 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c77c1638-3ca0-41af-b8e0-b02730d8c560 admin admin] The token cache is being invalidate because project c5465039fc664712a31fd621abd33470 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:11:02.461689 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c77c1638-3ca0-41af-b8e0-b02730d8c560 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:02.462289 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c77c1638-3ca0-41af-b8e0-b02730d8c560 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:02.463768 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1280/2577] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:11:02 2022] DELETE /identity/v3/projects/c5465039fc664712a31fd621abd33470 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:11:02.467924 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03e508-8c77-4597-a4e1-6876c0d7bb34 service neutron] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:02.478219 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03e508-8c77-4597-a4e1-6876c0d7bb34 service neutron] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:02.532802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63625e62-89a6-4f26-af0d-a1a6d78401f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:02.533362 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63625e62-89a6-4f26-af0d-a1a6d78401f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:02.533643 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63625e62-89a6-4f26-af0d-a1a6d78401f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:02.533914 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63625e62-89a6-4f26-af0d-a1a6d78401f3 admin admin] PATH_INFO: `/v3/users/9da50572210e4a539e22eb66f54e22d2` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:02.535021 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63625e62-89a6-4f26-af0d-a1a6d78401f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9da50572210e4a539e22eb66f54e22d2)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:02.537569 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63625e62-89a6-4f26-af0d-a1a6d78401f3 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:02.701949 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:02.704455 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-63625e62-89a6-4f26-af0d-a1a6d78401f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9da50572210e4a539e22eb66f54e22d2'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:02.705220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-63625e62-89a6-4f26-af0d-a1a6d78401f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9da50572210e4a539e22eb66f54e22d2'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:02.705825 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-63625e62-89a6-4f26-af0d-a1a6d78401f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9da50572210e4a539e22eb66f54e22d2'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:02.718178 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-63625e62-89a6-4f26-af0d-a1a6d78401f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9da50572210e4a539e22eb66f54e22d2'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:02.786741 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-63625e62-89a6-4f26-af0d-a1a6d78401f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9da50572210e4a539e22eb66f54e22d2'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:02.799265 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1298/2578] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:11:02 2022] DELETE /identity/v3/users/9da50572210e4a539e22eb66f54e22d2 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:11:03.198064 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c1638-3ca0-41af-b8e0-b02730d8c560 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:03.198064 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-c77c1638-3ca0-41af-b8e0-b02730d8c560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:03.211177 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c1638-3ca0-41af-b8e0-b02730d8c560 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:03.223237 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:03.275003 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7de09-00ed-4809-ab28-444ea79cafb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:03.275645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7de09-00ed-4809-ab28-444ea79cafb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:03.275929 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7de09-00ed-4809-ab28-444ea79cafb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:03.276240 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7de09-00ed-4809-ab28-444ea79cafb0 admin admin] PATH_INFO: `/v3/projects/027b156ffc384f0b8026f89c87e958fb` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:03.277450 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e7de09-00ed-4809-ab28-444ea79cafb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=027b156ffc384f0b8026f89c87e958fb)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:03.279362 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e7de09-00ed-4809-ab28-444ea79cafb0 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:03.405621 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-36e7de09-00ed-4809-ab28-444ea79cafb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '027b156ffc384f0b8026f89c87e958fb', 'request_id': 'req-36e7de09-00ed-4809-ab28-444ea79cafb0'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:03.411237 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-36e7de09-00ed-4809-ab28-444ea79cafb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '027b156ffc384f0b8026f89c87e958fb', 'request_id': 'req-36e7de09-00ed-4809-ab28-444ea79cafb0'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:03.417993 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-36e7de09-00ed-4809-ab28-444ea79cafb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '027b156ffc384f0b8026f89c87e958fb', 'request_id': 'req-36e7de09-00ed-4809-ab28-444ea79cafb0'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:03.500867 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-36e7de09-00ed-4809-ab28-444ea79cafb0 admin admin] The token cache is being invalidate because project 027b156ffc384f0b8026f89c87e958fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:11:03.501263 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-36e7de09-00ed-4809-ab28-444ea79cafb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:03.501896 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-36e7de09-00ed-4809-ab28-444ea79cafb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:03.503429 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1281/2579] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:11:03 2022] DELETE /identity/v3/projects/027b156ffc384f0b8026f89c87e958fb => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:11:03.509091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7cd47-0aa0-4607-8b68-388bfb9318b6 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:03.509600 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7cd47-0aa0-4607-8b68-388bfb9318b6 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:03.509700 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7cd47-0aa0-4607-8b68-388bfb9318b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:03.529893 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-0fb7cd47-0aa0-4607-8b68-388bfb9318b6 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:11:03.531111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-0fb7cd47-0aa0-4607-8b68-388bfb9318b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:03.591887 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1299/2580] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:11:03.600450 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9a116-d1fc-4300-9d17-65c69ed9c333 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:03.600778 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9a116-d1fc-4300-9d17-65c69ed9c333 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:03.601045 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9a116-d1fc-4300-9d17-65c69ed9c333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:03.621175 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-9cd9a116-d1fc-4300-9d17-65c69ed9c333 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:11:03.622358 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-9cd9a116-d1fc-4300-9d17-65c69ed9c333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:03.630651 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1282/2581] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:11:03.635160 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7cd47-0aa0-4607-8b68-388bfb9318b6 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:03.645190 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7cd47-0aa0-4607-8b68-388bfb9318b6 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:03.651663 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb08b72-b8d7-45a1-943d-bb7a2602240d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:03.652286 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb08b72-b8d7-45a1-943d-bb7a2602240d admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:03.652567 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb08b72-b8d7-45a1-943d-bb7a2602240d admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:03.652889 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb08b72-b8d7-45a1-943d-bb7a2602240d admin admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:03.653572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb08b72-b8d7-45a1-943d-bb7a2602240d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:11:03.653884 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb08b72-b8d7-45a1-943d-bb7a2602240d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:03.655493 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb08b72-b8d7-45a1-943d-bb7a2602240d admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:03.668176 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1300/2582] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:11:03.672485 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9a116-d1fc-4300-9d17-65c69ed9c333 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:03.682701 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9a116-d1fc-4300-9d17-65c69ed9c333 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:03.687272 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93607d7c-b2ca-45dc-84bd-708d4ce6986a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:03.687871 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93607d7c-b2ca-45dc-84bd-708d4ce6986a admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:03.688137 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93607d7c-b2ca-45dc-84bd-708d4ce6986a admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:03.688407 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93607d7c-b2ca-45dc-84bd-708d4ce6986a admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:03.689119 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93607d7c-b2ca-45dc-84bd-708d4ce6986a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:03.690998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93607d7c-b2ca-45dc-84bd-708d4ce6986a admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:03.800177 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1283/2583] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:11:03 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:11:03.805148 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb08b72-b8d7-45a1-943d-bb7a2602240d admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:03.815410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb08b72-b8d7-45a1-943d-bb7a2602240d admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:03.875972 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2475a13-cbb1-46f6-8f35-21dbd29910a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:03.876700 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2475a13-cbb1-46f6-8f35-21dbd29910a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:03.876986 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2475a13-cbb1-46f6-8f35-21dbd29910a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:03.877254 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2475a13-cbb1-46f6-8f35-21dbd29910a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:03.877872 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2475a13-cbb1-46f6-8f35-21dbd29910a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:03.879802 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2475a13-cbb1-46f6-8f35-21dbd29910a1 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:03.965291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1301/2584] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:11:03 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:11:03.969375 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93607d7c-b2ca-45dc-84bd-708d4ce6986a admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:03.981351 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93607d7c-b2ca-45dc-84bd-708d4ce6986a admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:03.985965 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea9d9b-be2b-4acc-bf09-efed4a74f752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:03.986563 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea9d9b-be2b-4acc-bf09-efed4a74f752 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:03.986841 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea9d9b-be2b-4acc-bf09-efed4a74f752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:03.987141 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea9d9b-be2b-4acc-bf09-efed4a74f752 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:03.987755 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea9d9b-be2b-4acc-bf09-efed4a74f752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:03.989437 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea9d9b-be2b-4acc-bf09-efed4a74f752 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:03.999552 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1284/2585] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:11:04.003589 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2475a13-cbb1-46f6-8f35-21dbd29910a1 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:04.014378 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2475a13-cbb1-46f6-8f35-21dbd29910a1 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:04.020232 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af04e2b-c46e-4786-a9e1-c12beb29f3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:04.021739 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af04e2b-c46e-4786-a9e1-c12beb29f3bf admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:04.022025 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af04e2b-c46e-4786-a9e1-c12beb29f3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:04.022298 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af04e2b-c46e-4786-a9e1-c12beb29f3bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:04.022942 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af04e2b-c46e-4786-a9e1-c12beb29f3bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:04.024574 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af04e2b-c46e-4786-a9e1-c12beb29f3bf admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:04.035324 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1302/2586] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:11:04.040358 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea9d9b-be2b-4acc-bf09-efed4a74f752 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:04.050689 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea9d9b-be2b-4acc-bf09-efed4a74f752 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:04.055536 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5deb3dc-5e91-4d77-97cf-bc7e9107e994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:04.056175 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5deb3dc-5e91-4d77-97cf-bc7e9107e994 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:04.056451 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5deb3dc-5e91-4d77-97cf-bc7e9107e994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:04.056759 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5deb3dc-5e91-4d77-97cf-bc7e9107e994 admin admin] PATH_INFO: `/v3/projects/34d4d144f07649b3ae9d9cbe2100eb4b/users/a17a3650ac014142b73e17e4aa218e34/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:04.071296 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5deb3dc-5e91-4d77-97cf-bc7e9107e994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34d4d144f07649b3ae9d9cbe2100eb4b, user_id=a17a3650ac014142b73e17e4aa218e34, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:04.074142 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5deb3dc-5e91-4d77-97cf-bc7e9107e994 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:04.129851 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1285/2587] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:11:04 2022] PUT /identity/v3/projects/34d4d144f07649b3ae9d9cbe2100eb4b/users/a17a3650ac014142b73e17e4aa218e34/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:11:04.142127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33df19-2a97-4905-a598-8d17738e1c4e None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:04.142410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33df19-2a97-4905-a598-8d17738e1c4e None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:04.142680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33df19-2a97-4905-a598-8d17738e1c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:04.176171 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-fd33df19-2a97-4905-a598-8d17738e1c4e None None] MFA Rules not processed for user `a17a3650ac014142b73e17e4aa218e34`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:11:04.177718 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-fd33df19-2a97-4905-a598-8d17738e1c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:04.190404 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:04.242882 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1303/2588] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:11:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:11:04.253844 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5deb3dc-5e91-4d77-97cf-bc7e9107e994 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:04.302811 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:04.322661 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5deb3dc-5e91-4d77-97cf-bc7e9107e994 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:04.327804 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c017835-d1b1-4560-89f4-18b82949622b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:04.328476 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c017835-d1b1-4560-89f4-18b82949622b admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:04.328794 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c017835-d1b1-4560-89f4-18b82949622b admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:04.329077 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c017835-d1b1-4560-89f4-18b82949622b admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:04.329698 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c017835-d1b1-4560-89f4-18b82949622b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:04.331606 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c017835-d1b1-4560-89f4-18b82949622b admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:04.429524 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1286/2589] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:11:04 2022] POST /identity/v3/projects => generated 381 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:11:04.434362 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33df19-2a97-4905-a598-8d17738e1c4e None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:04.449483 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33df19-2a97-4905-a598-8d17738e1c4e None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:04.509671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e570b-b0bc-4914-8e20-1c5a4225d9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:04.510355 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e570b-b0bc-4914-8e20-1c5a4225d9da admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:04.510465 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e570b-b0bc-4914-8e20-1c5a4225d9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:04.510727 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e570b-b0bc-4914-8e20-1c5a4225d9da admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:04.511357 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e570b-b0bc-4914-8e20-1c5a4225d9da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:04.513320 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e570b-b0bc-4914-8e20-1c5a4225d9da admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:04.585258 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1304/2590] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:11:04 2022] POST /identity/v3/users => generated 297 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:11:04.589600 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c017835-d1b1-4560-89f4-18b82949622b admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:04.603091 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c017835-d1b1-4560-89f4-18b82949622b admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:04.609148 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad38a9-6a95-4902-9773-8112c0864472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:04.610173 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad38a9-6a95-4902-9773-8112c0864472 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:04.610571 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad38a9-6a95-4902-9773-8112c0864472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:04.610841 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad38a9-6a95-4902-9773-8112c0864472 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:04.611509 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad38a9-6a95-4902-9773-8112c0864472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:04.613121 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad38a9-6a95-4902-9773-8112c0864472 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:04.626345 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1287/2591] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:11:04.630721 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e570b-b0bc-4914-8e20-1c5a4225d9da admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:04.642403 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e570b-b0bc-4914-8e20-1c5a4225d9da admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:04.648962 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e967efd-3fb2-4f5e-821f-e5d5c3e8cd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:04.649624 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e967efd-3fb2-4f5e-821f-e5d5c3e8cd3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:04.649907 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e967efd-3fb2-4f5e-821f-e5d5c3e8cd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:04.650188 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e967efd-3fb2-4f5e-821f-e5d5c3e8cd3d admin admin] PATH_INFO: `/v3/projects/0fd53cd7908c48358bdba52ab852edb8/users/2f328ee43ead47c597c86aa481b2f84b/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:04.667268 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e967efd-3fb2-4f5e-821f-e5d5c3e8cd3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd53cd7908c48358bdba52ab852edb8, user_id=2f328ee43ead47c597c86aa481b2f84b, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:04.669984 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e967efd-3fb2-4f5e-821f-e5d5c3e8cd3d admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:04.742265 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1305/2592] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:11:04 2022] PUT /identity/v3/projects/0fd53cd7908c48358bdba52ab852edb8/users/2f328ee43ead47c597c86aa481b2f84b/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:11:04.746849 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad38a9-6a95-4902-9773-8112c0864472 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:04.758443 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad38a9-6a95-4902-9773-8112c0864472 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:04.819461 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756ce50-8e3d-438a-966d-d6c89f032e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:04.819980 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756ce50-8e3d-438a-966d-d6c89f032e29 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:04.820255 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756ce50-8e3d-438a-966d-d6c89f032e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:04.820527 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756ce50-8e3d-438a-966d-d6c89f032e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:04.821196 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756ce50-8e3d-438a-966d-d6c89f032e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:04.822788 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756ce50-8e3d-438a-966d-d6c89f032e29 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:04.833777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1288/2593] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:11:04.838509 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e967efd-3fb2-4f5e-821f-e5d5c3e8cd3d admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:04.850111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e967efd-3fb2-4f5e-821f-e5d5c3e8cd3d admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:04.854877 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c77739-6faa-4eab-8782-b8534359873f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:04.855538 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c77739-6faa-4eab-8782-b8534359873f admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:04.855819 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c77739-6faa-4eab-8782-b8534359873f admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:04.856094 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c77739-6faa-4eab-8782-b8534359873f admin admin] PATH_INFO: `/v3/projects/0fd53cd7908c48358bdba52ab852edb8/users/2f328ee43ead47c597c86aa481b2f84b/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:04.858111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c77739-6faa-4eab-8782-b8534359873f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd53cd7908c48358bdba52ab852edb8, user_id=2f328ee43ead47c597c86aa481b2f84b, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:04.860752 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c77739-6faa-4eab-8782-b8534359873f admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:04.872535 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1306/2594] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:11:04 2022] PUT /identity/v3/projects/0fd53cd7908c48358bdba52ab852edb8/users/2f328ee43ead47c597c86aa481b2f84b/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:11:04.887771 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecee98-42e9-42b3-a002-074dadf8e12c None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:04.888055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecee98-42e9-42b3-a002-074dadf8e12c None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:04.888322 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecee98-42e9-42b3-a002-074dadf8e12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:04.918929 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-28ecee98-42e9-42b3-a002-074dadf8e12c None None] MFA Rules not processed for user `2f328ee43ead47c597c86aa481b2f84b`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:11:04.920145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-28ecee98-42e9-42b3-a002-074dadf8e12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:04.993821 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1289/2595] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:11:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:11:05.005798 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c77739-6faa-4eab-8782-b8534359873f admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:05.007855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-96c77739-6faa-4eab-8782-b8534359873f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:05.073625 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c77739-6faa-4eab-8782-b8534359873f admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:05.077648 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161f080-1b9f-44dd-8597-a0ca76a61298 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:05.078271 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161f080-1b9f-44dd-8597-a0ca76a61298 service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:05.078581 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161f080-1b9f-44dd-8597-a0ca76a61298 service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:05.079302 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161f080-1b9f-44dd-8597-a0ca76a61298 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:05.102764 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:05.143587 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6161f080-1b9f-44dd-8597-a0ca76a61298 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:05.145106 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6161f080-1b9f-44dd-8597-a0ca76a61298 service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:05.155424 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1307/2596] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:11:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:11:10.169306 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ecee98-42e9-42b3-a002-074dadf8e12c None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:10.170781 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-28ecee98-42e9-42b3-a002-074dadf8e12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:10.182791 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ecee98-42e9-42b3-a002-074dadf8e12c None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:10.186547 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a7a6c-a263-4335-9711-c038a1f857e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:10.187150 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a7a6c-a263-4335-9711-c038a1f857e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:10.187607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a7a6c-a263-4335-9711-c038a1f857e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:10.187757 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a7a6c-a263-4335-9711-c038a1f857e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:10.197520 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a7a6c-a263-4335-9711-c038a1f857e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:10.198929 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a7a6c-a263-4335-9711-c038a1f857e0 service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:10.208286 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1290/2597] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:11:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:11:15.170052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=17 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:15.864081 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161f080-1b9f-44dd-8597-a0ca76a61298 service cinder] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:15.926398 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161f080-1b9f-44dd-8597-a0ca76a61298 service cinder] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:15.930991 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d56ed-d666-4c77-a79d-5be80b7014eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:15.932148 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d56ed-d666-4c77-a79d-5be80b7014eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:15.932490 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d56ed-d666-4c77-a79d-5be80b7014eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:15.932835 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d56ed-d666-4c77-a79d-5be80b7014eb admin admin] PATH_INFO: `/v3/users/a17a3650ac014142b73e17e4aa218e34` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:15.933951 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d56ed-d666-4c77-a79d-5be80b7014eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a17a3650ac014142b73e17e4aa218e34)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:15.935869 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d56ed-d666-4c77-a79d-5be80b7014eb admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:16.143615 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-c14d56ed-d666-4c77-a79d-5be80b7014eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a17a3650ac014142b73e17e4aa218e34'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:16.144178 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-c14d56ed-d666-4c77-a79d-5be80b7014eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a17a3650ac014142b73e17e4aa218e34'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:16.144817 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-c14d56ed-d666-4c77-a79d-5be80b7014eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a17a3650ac014142b73e17e4aa218e34'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:16.156563 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-c14d56ed-d666-4c77-a79d-5be80b7014eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a17a3650ac014142b73e17e4aa218e34'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:16.192645 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-c14d56ed-d666-4c77-a79d-5be80b7014eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a17a3650ac014142b73e17e4aa218e34'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:16.205811 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1308/2598] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:11:15 2022] DELETE /identity/v3/users/a17a3650ac014142b73e17e4aa218e34 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:11:16.210452 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4352f-3428-4db9-b3c2-2704add045d9 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:16.210921 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4352f-3428-4db9-b3c2-2704add045d9 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:16.211070 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4352f-3428-4db9-b3c2-2704add045d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:16.230720 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-3bc4352f-3428-4db9-b3c2-2704add045d9 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:11:16.231950 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-3bc4352f-3428-4db9-b3c2-2704add045d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:16.249161 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:16.290738 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1291/2599] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:11:16.301586 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d56ed-d666-4c77-a79d-5be80b7014eb admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:16.303242 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-c14d56ed-d666-4c77-a79d-5be80b7014eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:16.383255 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d56ed-d666-4c77-a79d-5be80b7014eb admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:16.387343 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e23915-f1ce-4e10-a499-1b3bc66d504f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:16.387948 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e23915-f1ce-4e10-a499-1b3bc66d504f service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:16.388231 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e23915-f1ce-4e10-a499-1b3bc66d504f service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:16.388507 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e23915-f1ce-4e10-a499-1b3bc66d504f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:16.397600 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e23915-f1ce-4e10-a499-1b3bc66d504f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:16.398976 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e23915-f1ce-4e10-a499-1b3bc66d504f service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:16.408493 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1309/2600] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:11:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:11:16.771107 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4352f-3428-4db9-b3c2-2704add045d9 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:16.772714 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-3bc4352f-3428-4db9-b3c2-2704add045d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:16.785231 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4352f-3428-4db9-b3c2-2704add045d9 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:16.789923 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69bffe-6b14-43f0-80d7-e5ce93727508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:16.790560 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69bffe-6b14-43f0-80d7-e5ce93727508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:16.790836 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69bffe-6b14-43f0-80d7-e5ce93727508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:16.791108 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69bffe-6b14-43f0-80d7-e5ce93727508 admin admin] PATH_INFO: `/v3/projects/34d4d144f07649b3ae9d9cbe2100eb4b` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:16.792918 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69bffe-6b14-43f0-80d7-e5ce93727508 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34d4d144f07649b3ae9d9cbe2100eb4b)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:16.794833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69bffe-6b14-43f0-80d7-e5ce93727508 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:16.878808 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-4d69bffe-6b14-43f0-80d7-e5ce93727508 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34d4d144f07649b3ae9d9cbe2100eb4b', 'request_id': 'req-4d69bffe-6b14-43f0-80d7-e5ce93727508'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:16.884458 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-4d69bffe-6b14-43f0-80d7-e5ce93727508 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34d4d144f07649b3ae9d9cbe2100eb4b', 'request_id': 'req-4d69bffe-6b14-43f0-80d7-e5ce93727508'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:16.890611 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-4d69bffe-6b14-43f0-80d7-e5ce93727508 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34d4d144f07649b3ae9d9cbe2100eb4b', 'request_id': 'req-4d69bffe-6b14-43f0-80d7-e5ce93727508'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:16.946319 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-4d69bffe-6b14-43f0-80d7-e5ce93727508 admin admin] The token cache is being invalidate because project 34d4d144f07649b3ae9d9cbe2100eb4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:11:16.946539 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-4d69bffe-6b14-43f0-80d7-e5ce93727508 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:16.947192 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-4d69bffe-6b14-43f0-80d7-e5ce93727508 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:16.948739 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1292/2601] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:11:16 2022] DELETE /identity/v3/projects/34d4d144f07649b3ae9d9cbe2100eb4b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:11:16.952833 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e23915-f1ce-4e10-a499-1b3bc66d504f service neutron] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:16.957946 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:16.963349 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e23915-f1ce-4e10-a499-1b3bc66d504f service neutron] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:17.020672 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9cd7d2-7a89-4808-b469-c827fbc4f7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:17.021372 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cd7d2-7a89-4808-b469-c827fbc4f7b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:17.021653 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cd7d2-7a89-4808-b469-c827fbc4f7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:17.021929 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cd7d2-7a89-4808-b469-c827fbc4f7b4 admin admin] PATH_INFO: `/v3/users/2f328ee43ead47c597c86aa481b2f84b` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:17.023120 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9cd7d2-7a89-4808-b469-c827fbc4f7b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f328ee43ead47c597c86aa481b2f84b)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:17.025154 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9cd7d2-7a89-4808-b469-c827fbc4f7b4 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:17.211567 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-0f9cd7d2-7a89-4808-b469-c827fbc4f7b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f328ee43ead47c597c86aa481b2f84b'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:17.212238 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-0f9cd7d2-7a89-4808-b469-c827fbc4f7b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f328ee43ead47c597c86aa481b2f84b'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:17.212847 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-0f9cd7d2-7a89-4808-b469-c827fbc4f7b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f328ee43ead47c597c86aa481b2f84b'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:17.225494 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-0f9cd7d2-7a89-4808-b469-c827fbc4f7b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f328ee43ead47c597c86aa481b2f84b'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:17.283893 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-0f9cd7d2-7a89-4808-b469-c827fbc4f7b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f328ee43ead47c597c86aa481b2f84b'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:17.297947 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1310/2602] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:11:16 2022] DELETE /identity/v3/users/2f328ee43ead47c597c86aa481b2f84b => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:11:17.680300 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69bffe-6b14-43f0-80d7-e5ce93727508 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:17.681794 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-4d69bffe-6b14-43f0-80d7-e5ce93727508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:17.695271 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69bffe-6b14-43f0-80d7-e5ce93727508 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:17.754172 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7adba1-6acc-4666-9023-9d1d55dfab9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:17.754382 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7adba1-6acc-4666-9023-9d1d55dfab9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:17.754657 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7adba1-6acc-4666-9023-9d1d55dfab9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:17.754924 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7adba1-6acc-4666-9023-9d1d55dfab9e admin admin] PATH_INFO: `/v3/projects/0fd53cd7908c48358bdba52ab852edb8` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:17.756054 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7adba1-6acc-4666-9023-9d1d55dfab9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fd53cd7908c48358bdba52ab852edb8)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:17.757968 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7adba1-6acc-4666-9023-9d1d55dfab9e admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:17.872202 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:17.873543 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-2b7adba1-6acc-4666-9023-9d1d55dfab9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd53cd7908c48358bdba52ab852edb8', 'request_id': 'req-2b7adba1-6acc-4666-9023-9d1d55dfab9e'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:17.879050 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-2b7adba1-6acc-4666-9023-9d1d55dfab9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd53cd7908c48358bdba52ab852edb8', 'request_id': 'req-2b7adba1-6acc-4666-9023-9d1d55dfab9e'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:17.885929 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-2b7adba1-6acc-4666-9023-9d1d55dfab9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd53cd7908c48358bdba52ab852edb8', 'request_id': 'req-2b7adba1-6acc-4666-9023-9d1d55dfab9e'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:17.952583 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-2b7adba1-6acc-4666-9023-9d1d55dfab9e admin admin] The token cache is being invalidate because project 0fd53cd7908c48358bdba52ab852edb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:11:17.953093 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-2b7adba1-6acc-4666-9023-9d1d55dfab9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:17.953874 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-2b7adba1-6acc-4666-9023-9d1d55dfab9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:17.955662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1293/2603] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:11:17 2022] DELETE /identity/v3/projects/0fd53cd7908c48358bdba52ab852edb8 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:11:17.961834 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507f3f5-e39f-4ed1-80ad-8b48ed0cdb3e None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:17.962148 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507f3f5-e39f-4ed1-80ad-8b48ed0cdb3e None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:17.962424 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507f3f5-e39f-4ed1-80ad-8b48ed0cdb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:17.982762 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-4507f3f5-e39f-4ed1-80ad-8b48ed0cdb3e None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:11:17.983972 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-4507f3f5-e39f-4ed1-80ad-8b48ed0cdb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:18.043346 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1311/2604] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:11:18.051731 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febaae94-38e7-482a-a9e5-55c22321191d None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:18.052022 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febaae94-38e7-482a-a9e5-55c22321191d None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:18.052298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febaae94-38e7-482a-a9e5-55c22321191d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:18.072017 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-febaae94-38e7-482a-a9e5-55c22321191d None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:11:18.073796 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-febaae94-38e7-482a-a9e5-55c22321191d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:18.081556 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1294/2605] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:11:18.085784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507f3f5-e39f-4ed1-80ad-8b48ed0cdb3e None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:18.095689 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507f3f5-e39f-4ed1-80ad-8b48ed0cdb3e None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:18.100291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d81b6e-eef6-4f9d-9d30-f3c926c605b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:18.100932 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d81b6e-eef6-4f9d-9d30-f3c926c605b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:18.101219 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d81b6e-eef6-4f9d-9d30-f3c926c605b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:18.101493 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d81b6e-eef6-4f9d-9d30-f3c926c605b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:18.102169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d81b6e-eef6-4f9d-9d30-f3c926c605b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:11:18.102473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d81b6e-eef6-4f9d-9d30-f3c926c605b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:18.104073 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d81b6e-eef6-4f9d-9d30-f3c926c605b3 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:18.115844 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1312/2606] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:11:18.120780 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febaae94-38e7-482a-a9e5-55c22321191d None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:18.129858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febaae94-38e7-482a-a9e5-55c22321191d None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:18.134819 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a1487-5354-4298-90d8-45134f6a7bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:18.136075 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a1487-5354-4298-90d8-45134f6a7bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:18.136378 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a1487-5354-4298-90d8-45134f6a7bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:18.136679 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a1487-5354-4298-90d8-45134f6a7bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:18.137298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a1487-5354-4298-90d8-45134f6a7bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:18.139192 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a1487-5354-4298-90d8-45134f6a7bc9 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:18.246437 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1295/2607] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:11:18 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:11:18.250589 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d81b6e-eef6-4f9d-9d30-f3c926c605b3 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:18.261613 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d81b6e-eef6-4f9d-9d30-f3c926c605b3 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:18.266269 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:18.318827 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736d6f5-02ea-4a6b-807f-de5f3e198149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:18.322307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736d6f5-02ea-4a6b-807f-de5f3e198149 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:18.322307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736d6f5-02ea-4a6b-807f-de5f3e198149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:18.322307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736d6f5-02ea-4a6b-807f-de5f3e198149 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:18.322307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b736d6f5-02ea-4a6b-807f-de5f3e198149 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:18.323261 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b736d6f5-02ea-4a6b-807f-de5f3e198149 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:18.415324 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1313/2608] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:11:18 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:11:18.422641 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a1487-5354-4298-90d8-45134f6a7bc9 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:18.434034 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a1487-5354-4298-90d8-45134f6a7bc9 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:18.438944 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5405bc17-66a8-4a37-b9d8-5ec86cf20516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:18.439574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405bc17-66a8-4a37-b9d8-5ec86cf20516 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:18.439857 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405bc17-66a8-4a37-b9d8-5ec86cf20516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:18.440130 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405bc17-66a8-4a37-b9d8-5ec86cf20516 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:18.440813 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5405bc17-66a8-4a37-b9d8-5ec86cf20516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:18.442414 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5405bc17-66a8-4a37-b9d8-5ec86cf20516 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:18.453343 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1296/2609] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:11:18.457437 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736d6f5-02ea-4a6b-807f-de5f3e198149 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:18.467673 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736d6f5-02ea-4a6b-807f-de5f3e198149 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:18.472556 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55815d-4e6f-4525-b2f2-bc8abe44ddab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:18.473614 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55815d-4e6f-4525-b2f2-bc8abe44ddab admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:18.473895 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55815d-4e6f-4525-b2f2-bc8abe44ddab admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:18.474170 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55815d-4e6f-4525-b2f2-bc8abe44ddab admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:18.474811 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55815d-4e6f-4525-b2f2-bc8abe44ddab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:18.476889 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55815d-4e6f-4525-b2f2-bc8abe44ddab admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:18.489038 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1314/2610] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:11:18.493261 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5405bc17-66a8-4a37-b9d8-5ec86cf20516 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:18.503747 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5405bc17-66a8-4a37-b9d8-5ec86cf20516 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:18.508374 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f12ea-fed2-4eab-8178-9faa22ce816f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:18.509307 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f12ea-fed2-4eab-8178-9faa22ce816f admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:18.509592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f12ea-fed2-4eab-8178-9faa22ce816f admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:18.509863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f12ea-fed2-4eab-8178-9faa22ce816f admin admin] PATH_INFO: `/v3/projects/0e11796890364f0ab9a1f13d4231f7c7/users/53eb5e4b2c95473ab766493bba980341/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:18.525893 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f12ea-fed2-4eab-8178-9faa22ce816f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e11796890364f0ab9a1f13d4231f7c7, user_id=53eb5e4b2c95473ab766493bba980341, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:18.528945 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f12ea-fed2-4eab-8178-9faa22ce816f admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:18.598070 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1297/2611] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:11:18 2022] PUT /identity/v3/projects/0e11796890364f0ab9a1f13d4231f7c7/users/53eb5e4b2c95473ab766493bba980341/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:11:18.609693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32ef2e-04e7-4b74-bbaf-1b6320cc68d5 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:18.609977 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32ef2e-04e7-4b74-bbaf-1b6320cc68d5 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:18.610246 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32ef2e-04e7-4b74-bbaf-1b6320cc68d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:18.638643 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-3e32ef2e-04e7-4b74-bbaf-1b6320cc68d5 None None] MFA Rules not processed for user `53eb5e4b2c95473ab766493bba980341`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:11:18.639861 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-3e32ef2e-04e7-4b74-bbaf-1b6320cc68d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:18.703999 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1315/2612] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:11:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:11:18.715789 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f12ea-fed2-4eab-8178-9faa22ce816f admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:18.717561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-767f12ea-fed2-4eab-8178-9faa22ce816f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:18.796601 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f12ea-fed2-4eab-8178-9faa22ce816f admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:18.800297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a215cb-0d8b-4d3f-9142-18c985dc2e35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:18.800941 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a215cb-0d8b-4d3f-9142-18c985dc2e35 service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:18.801221 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a215cb-0d8b-4d3f-9142-18c985dc2e35 service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:18.801490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a215cb-0d8b-4d3f-9142-18c985dc2e35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:18.809983 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a215cb-0d8b-4d3f-9142-18c985dc2e35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:18.811392 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a215cb-0d8b-4d3f-9142-18c985dc2e35 service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:18.820104 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1298/2613] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:11:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:11:25.162877 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32ef2e-04e7-4b74-bbaf-1b6320cc68d5 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:25.227908 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32ef2e-04e7-4b74-bbaf-1b6320cc68d5 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:25.232764 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006da8e-84aa-4606-85e3-d9b8073bd556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:25.233395 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006da8e-84aa-4606-85e3-d9b8073bd556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:25.233675 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006da8e-84aa-4606-85e3-d9b8073bd556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:25.233959 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006da8e-84aa-4606-85e3-d9b8073bd556 admin admin] PATH_INFO: `/v3/users/53eb5e4b2c95473ab766493bba980341` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:25.235057 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006da8e-84aa-4606-85e3-d9b8073bd556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53eb5e4b2c95473ab766493bba980341)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:25.237116 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006da8e-84aa-4606-85e3-d9b8073bd556 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:25.257858 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:25.497671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-b006da8e-84aa-4606-85e3-d9b8073bd556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53eb5e4b2c95473ab766493bba980341'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:25.498402 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-b006da8e-84aa-4606-85e3-d9b8073bd556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53eb5e4b2c95473ab766493bba980341'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:25.498999 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-b006da8e-84aa-4606-85e3-d9b8073bd556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53eb5e4b2c95473ab766493bba980341'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:25.510742 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-b006da8e-84aa-4606-85e3-d9b8073bd556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53eb5e4b2c95473ab766493bba980341'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:25.592579 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-b006da8e-84aa-4606-85e3-d9b8073bd556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53eb5e4b2c95473ab766493bba980341'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:25.605392 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1316/2614] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:11:25 2022] DELETE /identity/v3/users/53eb5e4b2c95473ab766493bba980341 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:11:25.610101 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a58ca5-8c67-427e-88f8-9478be79d2c3 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:25.610600 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a58ca5-8c67-427e-88f8-9478be79d2c3 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:25.610699 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a58ca5-8c67-427e-88f8-9478be79d2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:25.629798 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-57a58ca5-8c67-427e-88f8-9478be79d2c3 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:11:25.631038 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-57a58ca5-8c67-427e-88f8-9478be79d2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:25.678476 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:25.690473 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1299/2615] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:11:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:11:25.700356 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006da8e-84aa-4606-85e3-d9b8073bd556 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:25.702554 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-b006da8e-84aa-4606-85e3-d9b8073bd556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:25.760346 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006da8e-84aa-4606-85e3-d9b8073bd556 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:25.764444 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6fd64-c1f7-47ff-847b-d5d009ea0f55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:25.765082 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6fd64-c1f7-47ff-847b-d5d009ea0f55 service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:25.765360 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6fd64-c1f7-47ff-847b-d5d009ea0f55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:25.765630 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6fd64-c1f7-47ff-847b-d5d009ea0f55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:25.774537 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6fd64-c1f7-47ff-847b-d5d009ea0f55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:25.776263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6fd64-c1f7-47ff-847b-d5d009ea0f55 service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:25.786369 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1317/2616] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:11:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:11:26.177665 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a58ca5-8c67-427e-88f8-9478be79d2c3 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:26.179101 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-57a58ca5-8c67-427e-88f8-9478be79d2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:26.192126 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a58ca5-8c67-427e-88f8-9478be79d2c3 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:26.198244 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a32d8-9611-4be5-9d1d-2d408a3a9d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:26.198244 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a32d8-9611-4be5-9d1d-2d408a3a9d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:26.198244 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a32d8-9611-4be5-9d1d-2d408a3a9d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:26.198244 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a32d8-9611-4be5-9d1d-2d408a3a9d17 admin admin] PATH_INFO: `/v3/projects/0e11796890364f0ab9a1f13d4231f7c7` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:26.199224 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a32d8-9611-4be5-9d1d-2d408a3a9d17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e11796890364f0ab9a1f13d4231f7c7)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:26.201772 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a32d8-9611-4be5-9d1d-2d408a3a9d17 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:26.314547 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-fe4a32d8-9611-4be5-9d1d-2d408a3a9d17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e11796890364f0ab9a1f13d4231f7c7', 'request_id': 'req-fe4a32d8-9611-4be5-9d1d-2d408a3a9d17'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:26.319975 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-fe4a32d8-9611-4be5-9d1d-2d408a3a9d17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e11796890364f0ab9a1f13d4231f7c7', 'request_id': 'req-fe4a32d8-9611-4be5-9d1d-2d408a3a9d17'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:26.326178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-fe4a32d8-9611-4be5-9d1d-2d408a3a9d17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e11796890364f0ab9a1f13d4231f7c7', 'request_id': 'req-fe4a32d8-9611-4be5-9d1d-2d408a3a9d17'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:26.374767 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-fe4a32d8-9611-4be5-9d1d-2d408a3a9d17 admin admin] The token cache is being invalidate because project 0e11796890364f0ab9a1f13d4231f7c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:11:26.375062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-fe4a32d8-9611-4be5-9d1d-2d408a3a9d17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:26.375676 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-fe4a32d8-9611-4be5-9d1d-2d408a3a9d17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:26.377284 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1300/2617] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:11:26 2022] DELETE /identity/v3/projects/0e11796890364f0ab9a1f13d4231f7c7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:11:26.385831 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8170b-be8c-41a1-84d3-99b8282bdaa9 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:26.386316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8170b-be8c-41a1-84d3-99b8282bdaa9 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:26.386422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8170b-be8c-41a1-84d3-99b8282bdaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:26.406455 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-25b8170b-be8c-41a1-84d3-99b8282bdaa9 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:11:26.407666 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-25b8170b-be8c-41a1-84d3-99b8282bdaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:26.469874 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1318/2618] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:11:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:11:26.477726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00d551-ca86-43d4-a11b-2b0637b6034a None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:26.478014 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00d551-ca86-43d4-a11b-2b0637b6034a None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:26.478294 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00d551-ca86-43d4-a11b-2b0637b6034a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:26.498925 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-0d00d551-ca86-43d4-a11b-2b0637b6034a None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:11:26.500185 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-0d00d551-ca86-43d4-a11b-2b0637b6034a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:26.508022 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1301/2619] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:11:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:11:26.512774 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8170b-be8c-41a1-84d3-99b8282bdaa9 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:26.523284 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8170b-be8c-41a1-84d3-99b8282bdaa9 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:26.527860 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b7342-b895-4144-9534-040a7d5dc5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:26.530853 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b7342-b895-4144-9534-040a7d5dc5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:26.530853 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b7342-b895-4144-9534-040a7d5dc5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:26.530853 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b7342-b895-4144-9534-040a7d5dc5e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:26.530853 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b7342-b895-4144-9534-040a7d5dc5e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:11:26.530853 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b7342-b895-4144-9534-040a7d5dc5e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:26.532232 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b7342-b895-4144-9534-040a7d5dc5e3 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:26.543857 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1319/2620] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:11:26.548541 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00d551-ca86-43d4-a11b-2b0637b6034a None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:26.558030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00d551-ca86-43d4-a11b-2b0637b6034a None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:26.563377 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbab79d-70f7-4c32-b2c5-c9244ea90a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:26.564015 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbab79d-70f7-4c32-b2c5-c9244ea90a7d admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:26.564287 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbab79d-70f7-4c32-b2c5-c9244ea90a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:26.564555 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbab79d-70f7-4c32-b2c5-c9244ea90a7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:26.568495 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbab79d-70f7-4c32-b2c5-c9244ea90a7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:26.568495 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbab79d-70f7-4c32-b2c5-c9244ea90a7d admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:26.658921 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1302/2621] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:11:26 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:11:26.663125 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b7342-b895-4144-9534-040a7d5dc5e3 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:26.673333 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b7342-b895-4144-9534-040a7d5dc5e3 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:26.698361 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:26.731023 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633bf6a-ff20-40f6-bb2c-ff7006816f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:26.731648 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633bf6a-ff20-40f6-bb2c-ff7006816f9a admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:26.731976 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633bf6a-ff20-40f6-bb2c-ff7006816f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:26.732253 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633bf6a-ff20-40f6-bb2c-ff7006816f9a admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:26.732895 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633bf6a-ff20-40f6-bb2c-ff7006816f9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:26.734881 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633bf6a-ff20-40f6-bb2c-ff7006816f9a admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:26.809843 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1320/2622] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:11:26 2022] POST /identity/v3/users => generated 287 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:11:26.813884 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbab79d-70f7-4c32-b2c5-c9244ea90a7d admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:26.824040 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbab79d-70f7-4c32-b2c5-c9244ea90a7d admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:26.829262 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb941ce4-bd96-4dd4-bcbd-1ef5a745e754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:26.829852 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb941ce4-bd96-4dd4-bcbd-1ef5a745e754 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:26.830128 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb941ce4-bd96-4dd4-bcbd-1ef5a745e754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:26.830399 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb941ce4-bd96-4dd4-bcbd-1ef5a745e754 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:26.831032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb941ce4-bd96-4dd4-bcbd-1ef5a745e754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:26.832675 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb941ce4-bd96-4dd4-bcbd-1ef5a745e754 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:26.843178 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1303/2623] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:11:26.847093 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633bf6a-ff20-40f6-bb2c-ff7006816f9a admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:26.857052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633bf6a-ff20-40f6-bb2c-ff7006816f9a admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:26.861649 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22e996-ccb4-4e08-a6a9-3a41801ffcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:26.862236 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22e996-ccb4-4e08-a6a9-3a41801ffcf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:26.862516 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22e996-ccb4-4e08-a6a9-3a41801ffcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:26.862838 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22e996-ccb4-4e08-a6a9-3a41801ffcf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:26.863481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22e996-ccb4-4e08-a6a9-3a41801ffcf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:26.865118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22e996-ccb4-4e08-a6a9-3a41801ffcf7 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:26.875719 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1321/2624] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:11:26.879785 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb941ce4-bd96-4dd4-bcbd-1ef5a745e754 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:26.890756 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb941ce4-bd96-4dd4-bcbd-1ef5a745e754 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:26.895387 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbb121-2412-4975-9b0c-4462c8430225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:26.896022 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbb121-2412-4975-9b0c-4462c8430225 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:26.896298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbb121-2412-4975-9b0c-4462c8430225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:26.896567 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbb121-2412-4975-9b0c-4462c8430225 admin admin] PATH_INFO: `/v3/projects/d46e0562b1ac49ce8fcb6189f7707da1/users/fa6f91c701124ffb9ae581ef3b2fdc41/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:26.912068 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbb121-2412-4975-9b0c-4462c8430225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d46e0562b1ac49ce8fcb6189f7707da1, user_id=fa6f91c701124ffb9ae581ef3b2fdc41, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:26.914713 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbb121-2412-4975-9b0c-4462c8430225 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:26.998786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1304/2625] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:11:26 2022] PUT /identity/v3/projects/d46e0562b1ac49ce8fcb6189f7707da1/users/fa6f91c701124ffb9ae581ef3b2fdc41/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:11:27.065363 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7febc0-025b-4fb3-a4bd-dd56fa640069 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:27.065692 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7febc0-025b-4fb3-a4bd-dd56fa640069 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:27.066001 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7febc0-025b-4fb3-a4bd-dd56fa640069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:27.093826 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-9b7febc0-025b-4fb3-a4bd-dd56fa640069 None None] MFA Rules not processed for user `fa6f91c701124ffb9ae581ef3b2fdc41`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:11:27.095043 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-9b7febc0-025b-4fb3-a4bd-dd56fa640069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:27.160260 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1322/2626] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:11:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:11:27.171421 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbb121-2412-4975-9b0c-4462c8430225 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:27.173094 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-38fbb121-2412-4975-9b0c-4462c8430225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:27.230437 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbb121-2412-4975-9b0c-4462c8430225 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:27.234895 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d4982-cf51-47ef-bad5-8107309d6d20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:27.235500 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d4982-cf51-47ef-bad5-8107309d6d20 service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:27.235782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d4982-cf51-47ef-bad5-8107309d6d20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:27.239072 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d4982-cf51-47ef-bad5-8107309d6d20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:27.244706 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d4982-cf51-47ef-bad5-8107309d6d20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:27.246209 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d4982-cf51-47ef-bad5-8107309d6d20 service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:27.255250 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1305/2627] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:11:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:11:31.293092 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7febc0-025b-4fb3-a4bd-dd56fa640069 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:31.358201 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7febc0-025b-4fb3-a4bd-dd56fa640069 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:31.362972 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e656a06-4dde-4167-98bb-0b5b757f2950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:31.363628 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e656a06-4dde-4167-98bb-0b5b757f2950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:31.363905 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e656a06-4dde-4167-98bb-0b5b757f2950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:31.364176 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e656a06-4dde-4167-98bb-0b5b757f2950 admin admin] PATH_INFO: `/v3/users/fa6f91c701124ffb9ae581ef3b2fdc41` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:31.365307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e656a06-4dde-4167-98bb-0b5b757f2950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa6f91c701124ffb9ae581ef3b2fdc41)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:31.367271 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e656a06-4dde-4167-98bb-0b5b757f2950 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:31.530286 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:31.539476 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-8e656a06-4dde-4167-98bb-0b5b757f2950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa6f91c701124ffb9ae581ef3b2fdc41'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:31.540242 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-8e656a06-4dde-4167-98bb-0b5b757f2950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa6f91c701124ffb9ae581ef3b2fdc41'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:31.540945 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-8e656a06-4dde-4167-98bb-0b5b757f2950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa6f91c701124ffb9ae581ef3b2fdc41'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:31.553345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-8e656a06-4dde-4167-98bb-0b5b757f2950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa6f91c701124ffb9ae581ef3b2fdc41'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:31.632712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-8e656a06-4dde-4167-98bb-0b5b757f2950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa6f91c701124ffb9ae581ef3b2fdc41'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:31.646823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1323/2628] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:11:31 2022] DELETE /identity/v3/users/fa6f91c701124ffb9ae581ef3b2fdc41 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:11:31.652071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb0fe0-0bf3-484a-bb96-8f0d6ac6df9e None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:31.652592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb0fe0-0bf3-484a-bb96-8f0d6ac6df9e None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:31.652828 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb0fe0-0bf3-484a-bb96-8f0d6ac6df9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:31.672444 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-5ddb0fe0-0bf3-484a-bb96-8f0d6ac6df9e None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:11:31.673745 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-5ddb0fe0-0bf3-484a-bb96-8f0d6ac6df9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:31.685765 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:31.734368 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1306/2629] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:11:31.744141 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e656a06-4dde-4167-98bb-0b5b757f2950 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:31.745617 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-8e656a06-4dde-4167-98bb-0b5b757f2950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:31.804384 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e656a06-4dde-4167-98bb-0b5b757f2950 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:31.807963 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325efd3b-d107-4590-97ab-e978f4556d54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:31.808572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325efd3b-d107-4590-97ab-e978f4556d54 service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:31.808881 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325efd3b-d107-4590-97ab-e978f4556d54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:31.809153 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325efd3b-d107-4590-97ab-e978f4556d54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:31.818550 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325efd3b-d107-4590-97ab-e978f4556d54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:31.820116 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325efd3b-d107-4590-97ab-e978f4556d54 service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:31.829707 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1324/2630] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:11:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:11:32.280996 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb0fe0-0bf3-484a-bb96-8f0d6ac6df9e None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:32.282887 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-5ddb0fe0-0bf3-484a-bb96-8f0d6ac6df9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:32.306476 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb0fe0-0bf3-484a-bb96-8f0d6ac6df9e None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:32.311837 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26530240-aafe-473f-9461-fb1ddf6fb5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:32.312745 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26530240-aafe-473f-9461-fb1ddf6fb5bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:32.313026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26530240-aafe-473f-9461-fb1ddf6fb5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:32.313294 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26530240-aafe-473f-9461-fb1ddf6fb5bc admin admin] PATH_INFO: `/v3/projects/d46e0562b1ac49ce8fcb6189f7707da1` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:32.314539 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26530240-aafe-473f-9461-fb1ddf6fb5bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d46e0562b1ac49ce8fcb6189f7707da1)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:32.316425 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26530240-aafe-473f-9461-fb1ddf6fb5bc admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:32.406970 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-26530240-aafe-473f-9461-fb1ddf6fb5bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd46e0562b1ac49ce8fcb6189f7707da1', 'request_id': 'req-26530240-aafe-473f-9461-fb1ddf6fb5bc'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:32.412508 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-26530240-aafe-473f-9461-fb1ddf6fb5bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd46e0562b1ac49ce8fcb6189f7707da1', 'request_id': 'req-26530240-aafe-473f-9461-fb1ddf6fb5bc'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:32.429081 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-26530240-aafe-473f-9461-fb1ddf6fb5bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd46e0562b1ac49ce8fcb6189f7707da1', 'request_id': 'req-26530240-aafe-473f-9461-fb1ddf6fb5bc'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:32.478294 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-26530240-aafe-473f-9461-fb1ddf6fb5bc admin admin] The token cache is being invalidate because project d46e0562b1ac49ce8fcb6189f7707da1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:11:32.478584 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-26530240-aafe-473f-9461-fb1ddf6fb5bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:32.479213 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-26530240-aafe-473f-9461-fb1ddf6fb5bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:32.481011 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1307/2631] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:11:32 2022] DELETE /identity/v3/projects/d46e0562b1ac49ce8fcb6189f7707da1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:11:32.488895 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15994fc2-2202-4764-be9d-7b2e82d044e7 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:32.489428 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15994fc2-2202-4764-be9d-7b2e82d044e7 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:32.489428 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15994fc2-2202-4764-be9d-7b2e82d044e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:32.510763 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-15994fc2-2202-4764-be9d-7b2e82d044e7 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:11:32.512065 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-15994fc2-2202-4764-be9d-7b2e82d044e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:32.573910 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1325/2632] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:11:32.581642 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a5fe8-24f4-4fe6-ae2b-722b845b3e62 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:32.583778 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a5fe8-24f4-4fe6-ae2b-722b845b3e62 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:32.583778 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a5fe8-24f4-4fe6-ae2b-722b845b3e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:32.603079 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-938a5fe8-24f4-4fe6-ae2b-722b845b3e62 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:11:32.606770 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-938a5fe8-24f4-4fe6-ae2b-722b845b3e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:32.613026 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1308/2633] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:11:32.617347 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15994fc2-2202-4764-be9d-7b2e82d044e7 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:32.627781 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15994fc2-2202-4764-be9d-7b2e82d044e7 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:32.632751 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ce9c2-110b-4cd7-9346-fc6cdffa73a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:32.633381 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ce9c2-110b-4cd7-9346-fc6cdffa73a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:32.633659 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ce9c2-110b-4cd7-9346-fc6cdffa73a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:32.633936 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ce9c2-110b-4cd7-9346-fc6cdffa73a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:32.634894 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ce9c2-110b-4cd7-9346-fc6cdffa73a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:11:32.635193 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ce9c2-110b-4cd7-9346-fc6cdffa73a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:32.636815 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ce9c2-110b-4cd7-9346-fc6cdffa73a7 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:32.649667 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1326/2634] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:11:32.654200 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a5fe8-24f4-4fe6-ae2b-722b845b3e62 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:32.664035 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a5fe8-24f4-4fe6-ae2b-722b845b3e62 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:32.668878 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24dbb1-7904-43af-a1f3-2cd5ae99baf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:32.669479 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24dbb1-7904-43af-a1f3-2cd5ae99baf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:32.669790 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24dbb1-7904-43af-a1f3-2cd5ae99baf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:32.670067 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24dbb1-7904-43af-a1f3-2cd5ae99baf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:32.671231 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24dbb1-7904-43af-a1f3-2cd5ae99baf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:32.673343 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24dbb1-7904-43af-a1f3-2cd5ae99baf7 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:32.755446 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1309/2635] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:11:32 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:11:32.760128 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ce9c2-110b-4cd7-9346-fc6cdffa73a7 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:32.770476 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ce9c2-110b-4cd7-9346-fc6cdffa73a7 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:32.814034 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:32.829026 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a622625-1efc-44b7-be39-5492e31990fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:32.829572 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a622625-1efc-44b7-be39-5492e31990fb admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:32.829855 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a622625-1efc-44b7-be39-5492e31990fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:32.830129 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a622625-1efc-44b7-be39-5492e31990fb admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:32.830787 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a622625-1efc-44b7-be39-5492e31990fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:32.832746 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a622625-1efc-44b7-be39-5492e31990fb admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:32.913962 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1327/2636] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:11:32 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:11:32.919111 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24dbb1-7904-43af-a1f3-2cd5ae99baf7 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:32.930556 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24dbb1-7904-43af-a1f3-2cd5ae99baf7 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:32.935701 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac5121-e634-4449-9b35-7f8dd58ad365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:32.936360 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac5121-e634-4449-9b35-7f8dd58ad365 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:32.936663 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac5121-e634-4449-9b35-7f8dd58ad365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:32.936939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac5121-e634-4449-9b35-7f8dd58ad365 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:32.938326 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac5121-e634-4449-9b35-7f8dd58ad365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:32.940055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac5121-e634-4449-9b35-7f8dd58ad365 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:32.950957 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1310/2637] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:11:32.955399 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a622625-1efc-44b7-be39-5492e31990fb admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:32.965633 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a622625-1efc-44b7-be39-5492e31990fb admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:32.971164 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88301f6-8efa-4c9b-aab3-80252b9847dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:32.972912 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88301f6-8efa-4c9b-aab3-80252b9847dd admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:32.973189 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88301f6-8efa-4c9b-aab3-80252b9847dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:32.973474 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88301f6-8efa-4c9b-aab3-80252b9847dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:32.974124 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88301f6-8efa-4c9b-aab3-80252b9847dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:32.975739 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88301f6-8efa-4c9b-aab3-80252b9847dd admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:32.988519 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1328/2638] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:11:32.993050 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac5121-e634-4449-9b35-7f8dd58ad365 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:33.003689 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac5121-e634-4449-9b35-7f8dd58ad365 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:33.008566 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d45850-ccaf-42ee-88d2-c72d3b0dbfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:33.013892 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d45850-ccaf-42ee-88d2-c72d3b0dbfcb admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:33.013892 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d45850-ccaf-42ee-88d2-c72d3b0dbfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:33.013892 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d45850-ccaf-42ee-88d2-c72d3b0dbfcb admin admin] PATH_INFO: `/v3/projects/7ceb47dbce4a40d2871e39ad3026abc4/users/6ec86ec007514ea0a991e6760b89906d/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:33.026065 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d45850-ccaf-42ee-88d2-c72d3b0dbfcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ceb47dbce4a40d2871e39ad3026abc4, user_id=6ec86ec007514ea0a991e6760b89906d, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:33.028901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d45850-ccaf-42ee-88d2-c72d3b0dbfcb admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:33.124742 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1311/2639] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:11:32 2022] PUT /identity/v3/projects/7ceb47dbce4a40d2871e39ad3026abc4/users/6ec86ec007514ea0a991e6760b89906d/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:11:33.135263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbcb04-ca44-47ba-9c93-ed78fbfa53c3 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:33.135547 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbcb04-ca44-47ba-9c93-ed78fbfa53c3 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:33.135823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbcb04-ca44-47ba-9c93-ed78fbfa53c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:33.164842 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-9bcbcb04-ca44-47ba-9c93-ed78fbfa53c3 None None] MFA Rules not processed for user `6ec86ec007514ea0a991e6760b89906d`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:11:33.166056 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-9bcbcb04-ca44-47ba-9c93-ed78fbfa53c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:33.234592 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1329/2640] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:11:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:11:33.246114 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d45850-ccaf-42ee-88d2-c72d3b0dbfcb admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:33.248055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-15d45850-ccaf-42ee-88d2-c72d3b0dbfcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:33.304592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:33.320966 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d45850-ccaf-42ee-88d2-c72d3b0dbfcb admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:33.324784 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05cc2c-ff3c-4695-9aff-d4c96efa52a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:33.325388 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05cc2c-ff3c-4695-9aff-d4c96efa52a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:33.325663 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05cc2c-ff3c-4695-9aff-d4c96efa52a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:33.325939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05cc2c-ff3c-4695-9aff-d4c96efa52a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:33.335256 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05cc2c-ff3c-4695-9aff-d4c96efa52a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:33.338031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05cc2c-ff3c-4695-9aff-d4c96efa52a1 service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:33.352134 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1312/2641] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:11:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:11:33.379206 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbcb04-ca44-47ba-9c93-ed78fbfa53c3 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:33.443953 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbcb04-ca44-47ba-9c93-ed78fbfa53c3 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:33.448744 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ea4b0-5940-4442-b751-2f7d0805e4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:33.449408 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ea4b0-5940-4442-b751-2f7d0805e4d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:33.449693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ea4b0-5940-4442-b751-2f7d0805e4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:33.449965 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ea4b0-5940-4442-b751-2f7d0805e4d5 admin admin] PATH_INFO: `/v3/users/6ec86ec007514ea0a991e6760b89906d` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:33.451097 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ea4b0-5940-4442-b751-2f7d0805e4d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ec86ec007514ea0a991e6760b89906d)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:33.453660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ea4b0-5940-4442-b751-2f7d0805e4d5 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:33.601320 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-2b7ea4b0-5940-4442-b751-2f7d0805e4d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ec86ec007514ea0a991e6760b89906d'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:33.601973 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-2b7ea4b0-5940-4442-b751-2f7d0805e4d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ec86ec007514ea0a991e6760b89906d'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:33.602582 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-2b7ea4b0-5940-4442-b751-2f7d0805e4d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ec86ec007514ea0a991e6760b89906d'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:33.607953 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:33.615597 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-2b7ea4b0-5940-4442-b751-2f7d0805e4d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ec86ec007514ea0a991e6760b89906d'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:33.712794 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-2b7ea4b0-5940-4442-b751-2f7d0805e4d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ec86ec007514ea0a991e6760b89906d'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:33.725389 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1330/2642] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:11:33 2022] DELETE /identity/v3/users/6ec86ec007514ea0a991e6760b89906d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:11:33.730086 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746aafa-0d29-48be-8b47-7e91a11ac009 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:33.730575 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746aafa-0d29-48be-8b47-7e91a11ac009 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:33.730687 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746aafa-0d29-48be-8b47-7e91a11ac009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:33.750504 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-e746aafa-0d29-48be-8b47-7e91a11ac009 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:11:33.751937 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e746aafa-0d29-48be-8b47-7e91a11ac009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:33.811173 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1313/2643] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:11:33.821935 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ea4b0-5940-4442-b751-2f7d0805e4d5 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:33.823447 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-2b7ea4b0-5940-4442-b751-2f7d0805e4d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:33.881588 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ea4b0-5940-4442-b751-2f7d0805e4d5 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:33.885549 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99982f-1773-491a-add6-75fdb9ea6ace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:33.886209 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99982f-1773-491a-add6-75fdb9ea6ace service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:33.886486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99982f-1773-491a-add6-75fdb9ea6ace service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:33.886753 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99982f-1773-491a-add6-75fdb9ea6ace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:33.896702 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99982f-1773-491a-add6-75fdb9ea6ace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:33.898123 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99982f-1773-491a-add6-75fdb9ea6ace service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:33.907944 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1331/2644] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:11:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:11:34.298790 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746aafa-0d29-48be-8b47-7e91a11ac009 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:34.300230 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e746aafa-0d29-48be-8b47-7e91a11ac009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:34.314707 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746aafa-0d29-48be-8b47-7e91a11ac009 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:34.319936 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb230f24-63bc-4a54-a0fc-cb17d98534fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:34.320264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb230f24-63bc-4a54-a0fc-cb17d98534fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:34.320547 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb230f24-63bc-4a54-a0fc-cb17d98534fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:34.320857 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb230f24-63bc-4a54-a0fc-cb17d98534fd admin admin] PATH_INFO: `/v3/projects/7ceb47dbce4a40d2871e39ad3026abc4` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:34.322014 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb230f24-63bc-4a54-a0fc-cb17d98534fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ceb47dbce4a40d2871e39ad3026abc4)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:34.323993 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb230f24-63bc-4a54-a0fc-cb17d98534fd admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:34.434098 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-bb230f24-63bc-4a54-a0fc-cb17d98534fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ceb47dbce4a40d2871e39ad3026abc4', 'request_id': 'req-bb230f24-63bc-4a54-a0fc-cb17d98534fd'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:34.440435 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-bb230f24-63bc-4a54-a0fc-cb17d98534fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ceb47dbce4a40d2871e39ad3026abc4', 'request_id': 'req-bb230f24-63bc-4a54-a0fc-cb17d98534fd'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:34.447134 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-bb230f24-63bc-4a54-a0fc-cb17d98534fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ceb47dbce4a40d2871e39ad3026abc4', 'request_id': 'req-bb230f24-63bc-4a54-a0fc-cb17d98534fd'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:34.519789 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-bb230f24-63bc-4a54-a0fc-cb17d98534fd admin admin] The token cache is being invalidate because project 7ceb47dbce4a40d2871e39ad3026abc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:11:34.520151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-bb230f24-63bc-4a54-a0fc-cb17d98534fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:34.520810 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-bb230f24-63bc-4a54-a0fc-cb17d98534fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:11:34.522766 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1314/2645] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:11:34 2022] DELETE /identity/v3/projects/7ceb47dbce4a40d2871e39ad3026abc4 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:11:43.530891 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99982f-1773-491a-add6-75fdb9ea6ace service neutron] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:43.532444 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-6f99982f-1773-491a-add6-75fdb9ea6ace service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:43.635502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99982f-1773-491a-add6-75fdb9ea6ace service neutron] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:43.696248 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:43.706277 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3339778-a4e9-4104-8250-be279785e7df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6907dfd3254d3c97d07ca2fb648858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:43.706965 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3339778-a4e9-4104-8250-be279785e7df service placement] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:43.707246 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3339778-a4e9-4104-8250-be279785e7df service placement] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:43.707519 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3339778-a4e9-4104-8250-be279785e7df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:43.709306 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-e3339778-a4e9-4104-8250-be279785e7df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:43.720900 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3339778-a4e9-4104-8250-be279785e7df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:43.723058 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3339778-a4e9-4104-8250-be279785e7df service placement] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:43.734240 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1332/2646] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:11:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:11:44.515931 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=63,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:47.845955 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89e001-ef39-4ea4-b355-5003dee02561 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:47.846544 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89e001-ef39-4ea4-b355-5003dee02561 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:47.846544 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89e001-ef39-4ea4-b355-5003dee02561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:47.865775 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-5a89e001-ef39-4ea4-b355-5003dee02561 None None] MFA Rules not processed for user `d7e96891e45f427db01549f082d3f808`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:11:47.866973 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-5a89e001-ef39-4ea4-b355-5003dee02561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:47.921950 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1315/2647] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:11:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:11:53.810214 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=6 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:57.233762 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8aa52-2325-418c-8d14-e330440d11e5 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:57.234359 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8aa52-2325-418c-8d14-e330440d11e5 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:57.234359 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8aa52-2325-418c-8d14-e330440d11e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:57.266307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-7ca8aa52-2325-418c-8d14-e330440d11e5 None None] MFA Rules not processed for user `eaf3821dd57a4d8f9ca6385c202bb0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:11:57.268172 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-7ca8aa52-2325-418c-8d14-e330440d11e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:57.351608 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1333/2648] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 24 16:11:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:11:57.502441 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89e001-ef39-4ea4-b355-5003dee02561 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:11:57.503936 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-5a89e001-ef39-4ea4-b355-5003dee02561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:11:57.575998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89e001-ef39-4ea4-b355-5003dee02561 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:11:57.582147 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07568cbd-fe80-4baf-b92a-4eae58741728 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a0a84e4c4e47fc930881109fc07039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:11:57.582687 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07568cbd-fe80-4baf-b92a-4eae58741728 service swift] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:11:57.582961 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07568cbd-fe80-4baf-b92a-4eae58741728 service swift] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:11:57.583229 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07568cbd-fe80-4baf-b92a-4eae58741728 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:11:57.591303 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07568cbd-fe80-4baf-b92a-4eae58741728 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:11:57.592918 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07568cbd-fe80-4baf-b92a-4eae58741728 service swift] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:11:57.601094 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1316/2649] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 24 16:11:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 16:12:07.342135 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=32 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:12:07.597868 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=57 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:12:15.507657 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8aa52-2325-418c-8d14-e330440d11e5 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:12:15.509157 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-7ca8aa52-2325-418c-8d14-e330440d11e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:12:15.570340 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8aa52-2325-418c-8d14-e330440d11e5 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:12:15.574057 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ce0a7-cfe6-478d-90d4-e07947928d7f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21fda517a384dc5a6a9f36d68ac1a2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:12:15.574602 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ce0a7-cfe6-478d-90d4-e07947928d7f service glance] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:12:15.574885 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ce0a7-cfe6-478d-90d4-e07947928d7f service glance] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:12:15.575158 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ce0a7-cfe6-478d-90d4-e07947928d7f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:12:15.576959 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-d68ce0a7-cfe6-478d-90d4-e07947928d7f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:12:15.661559 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ce0a7-cfe6-478d-90d4-e07947928d7f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:12:15.667080 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ce0a7-cfe6-478d-90d4-e07947928d7f service glance] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:12:15.683643 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1334/2650] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:12:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:12:15.934783 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07568cbd-fe80-4baf-b92a-4eae58741728 service swift] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:12:15.936172 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-07568cbd-fe80-4baf-b92a-4eae58741728 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:12:15.992630 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07568cbd-fe80-4baf-b92a-4eae58741728 service swift] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:12:15.996210 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd84c2-9353-4c81-96f6-0baabb7b0906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:12:15.996836 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd84c2-9353-4c81-96f6-0baabb7b0906 service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:12:15.997120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd84c2-9353-4c81-96f6-0baabb7b0906 service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:12:15.997394 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd84c2-9353-4c81-96f6-0baabb7b0906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:12:15.999078 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-65cd84c2-9353-4c81-96f6-0baabb7b0906 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:12:16.008880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd84c2-9353-4c81-96f6-0baabb7b0906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:12:16.010574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd84c2-9353-4c81-96f6-0baabb7b0906 service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:12:16.018880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1317/2651] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:12:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:12:16.090935 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ce0a7-cfe6-478d-90d4-e07947928d7f service glance] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:12:16.101129 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ce0a7-cfe6-478d-90d4-e07947928d7f service glance] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:12:16.104692 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ded41-00d3-4c80-9a90-e9a3ddb478db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:12:16.105289 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ded41-00d3-4c80-9a90-e9a3ddb478db service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:12:16.105568 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ded41-00d3-4c80-9a90-e9a3ddb478db service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:12:16.105837 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ded41-00d3-4c80-9a90-e9a3ddb478db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:12:16.107539 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-b93ded41-00d3-4c80-9a90-e9a3ddb478db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:12:16.121001 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ded41-00d3-4c80-9a90-e9a3ddb478db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:12:16.122470 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ded41-00d3-4c80-9a90-e9a3ddb478db service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:12:16.133578 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1335/2652] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:12:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:12:18.416826 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eed44b-c933-466b-83f3-810dd61e879b None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:12:18.417298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eed44b-c933-466b-83f3-810dd61e879b None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:12:18.417399 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eed44b-c933-466b-83f3-810dd61e879b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:12:18.436700 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-e4eed44b-c933-466b-83f3-810dd61e879b None None] MFA Rules not processed for user `eaf3821dd57a4d8f9ca6385c202bb0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:12:18.437894 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e4eed44b-c933-466b-83f3-810dd61e879b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:12:18.445699 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1318/2653] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 24 16:12:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:12:18.457639 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ded41-00d3-4c80-9a90-e9a3ddb478db service neutron] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:12:18.468663 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ded41-00d3-4c80-9a90-e9a3ddb478db service neutron] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:12:18.474062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af997508-92d5-4951-9c26-8d5d6f7ec34a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a0a84e4c4e47fc930881109fc07039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:12:18.474646 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af997508-92d5-4951-9c26-8d5d6f7ec34a service swift] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:12:18.474924 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af997508-92d5-4951-9c26-8d5d6f7ec34a service swift] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:12:18.475190 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af997508-92d5-4951-9c26-8d5d6f7ec34a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:12:18.483112 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af997508-92d5-4951-9c26-8d5d6f7ec34a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:12:18.484690 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af997508-92d5-4951-9c26-8d5d6f7ec34a service swift] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:12:18.493192 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1336/2654] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 24 16:12:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:12:28.431566 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=29 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:12:28.490063 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=75 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:12:39.659851 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe2566-0802-4115-b739-591deccb80ce None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:12:39.660332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe2566-0802-4115-b739-591deccb80ce None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:12:39.660434 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe2566-0802-4115-b739-591deccb80ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:12:39.680969 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-9dfe2566-0802-4115-b739-591deccb80ce None None] MFA Rules not processed for user `eaf3821dd57a4d8f9ca6385c202bb0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:12:39.682165 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-9dfe2566-0802-4115-b739-591deccb80ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:12:39.689225 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1319/2655] 10.222.0.64 () {58 vars in 967 bytes} [Wed Aug 24 16:12:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:12:39.701619 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af997508-92d5-4951-9c26-8d5d6f7ec34a service swift] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:12:39.712601 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af997508-92d5-4951-9c26-8d5d6f7ec34a service swift] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:12:39.717798 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fad9b6-4fe7-4aea-9ac9-f4c02b07d668 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a0a84e4c4e47fc930881109fc07039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:12:39.718418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fad9b6-4fe7-4aea-9ac9-f4c02b07d668 service swift] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:12:39.718699 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fad9b6-4fe7-4aea-9ac9-f4c02b07d668 service swift] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:12:39.718972 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fad9b6-4fe7-4aea-9ac9-f4c02b07d668 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:12:39.727538 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fad9b6-4fe7-4aea-9ac9-f4c02b07d668 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:12:39.729146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fad9b6-4fe7-4aea-9ac9-f4c02b07d668 service swift] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:12:39.737679 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1337/2656] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 24 16:12:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:12:49.676168 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:12:49.733898 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=6 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:13:31.208979 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe2566-0802-4115-b739-591deccb80ce None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:31.210390 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-9dfe2566-0802-4115-b739-591deccb80ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:13:31.267661 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe2566-0802-4115-b739-591deccb80ce None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:31.271175 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074833c-3392-4ec9-abe1-c915c0821faf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:31.271770 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074833c-3392-4ec9-abe1-c915c0821faf service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:31.272050 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074833c-3392-4ec9-abe1-c915c0821faf service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:31.272315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074833c-3392-4ec9-abe1-c915c0821faf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:31.274071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-7074833c-3392-4ec9-abe1-c915c0821faf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:13:31.287810 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7074833c-3392-4ec9-abe1-c915c0821faf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:13:31.289273 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7074833c-3392-4ec9-abe1-c915c0821faf service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:13:31.301430 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1320/2657] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:13:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:13:34.283449 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fad9b6-4fe7-4aea-9ac9-f4c02b07d668 service swift] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:34.285081 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-54fad9b6-4fe7-4aea-9ac9-f4c02b07d668 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:13:34.297947 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fad9b6-4fe7-4aea-9ac9-f4c02b07d668 service swift] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:34.301603 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac050cf-30c1-41ad-8618-d294287a023d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:34.302290 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac050cf-30c1-41ad-8618-d294287a023d service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:34.303043 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac050cf-30c1-41ad-8618-d294287a023d service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:34.303043 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac050cf-30c1-41ad-8618-d294287a023d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:34.304580 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-2ac050cf-30c1-41ad-8618-d294287a023d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:13:34.318996 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac050cf-30c1-41ad-8618-d294287a023d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:13:34.320403 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac050cf-30c1-41ad-8618-d294287a023d service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:13:34.331656 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1338/2658] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:13:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:13:41.295340 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=26 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:13:44.326558 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=6 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:13:44.415646 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074833c-3392-4ec9-abe1-c915c0821faf service cinder] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:44.417134 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-7074833c-3392-4ec9-abe1-c915c0821faf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:13:44.429166 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074833c-3392-4ec9-abe1-c915c0821faf service cinder] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:44.432748 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc14073-a40c-4533-a98f-e58ea068395d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:44.433388 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc14073-a40c-4533-a98f-e58ea068395d service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:44.433671 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc14073-a40c-4533-a98f-e58ea068395d service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:44.434034 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc14073-a40c-4533-a98f-e58ea068395d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:44.435709 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-ffc14073-a40c-4533-a98f-e58ea068395d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:13:44.445077 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc14073-a40c-4533-a98f-e58ea068395d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:13:44.446491 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc14073-a40c-4533-a98f-e58ea068395d service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:13:44.454407 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1321/2659] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:13:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:13:46.652056 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac050cf-30c1-41ad-8618-d294287a023d service cinder] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:46.661521 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac050cf-30c1-41ad-8618-d294287a023d service cinder] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:46.665206 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df207b-75d4-444e-af14-08a5bba35139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:46.665789 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df207b-75d4-444e-af14-08a5bba35139 service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:46.666067 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df207b-75d4-444e-af14-08a5bba35139 service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:46.666338 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df207b-75d4-444e-af14-08a5bba35139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:46.668014 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-77df207b-75d4-444e-af14-08a5bba35139 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:13:46.730168 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df207b-75d4-444e-af14-08a5bba35139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:13:46.731655 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df207b-75d4-444e-af14-08a5bba35139 service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:13:46.741502 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1339/2660] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:13:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:13:49.439555 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31438240-7af4-445f-bf67-0d04aa96839f None None] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:49.439555 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31438240-7af4-445f-bf67-0d04aa96839f None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:49.439555 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31438240-7af4-445f-bf67-0d04aa96839f None None] PATH_INFO: `/` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:49.439555 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1322/2661] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 24 16:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:13:49.449355 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5b647-a818-4bc6-97d1-21b590dc2066 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:49.452508 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5b647-a818-4bc6-97d1-21b590dc2066 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:49.453148 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5b647-a818-4bc6-97d1-21b590dc2066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:49.517776 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-11a5b647-a818-4bc6-97d1-21b590dc2066 None None] MFA Rules not processed for user `80f7e6f1af76404096d4c717cbcf20f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:13:49.519367 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-11a5b647-a818-4bc6-97d1-21b590dc2066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:13:49.529108 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1340/2662] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 24 16:13:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:13:49.547033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31438240-7af4-445f-bf67-0d04aa96839f None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:49.561941 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31438240-7af4-445f-bf67-0d04aa96839f None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:49.565753 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68a8c9-95e9-40f0-a5a1-bf8ad1c7ccba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:49.566600 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68a8c9-95e9-40f0-a5a1-bf8ad1c7ccba service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:49.566882 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68a8c9-95e9-40f0-a5a1-bf8ad1c7ccba service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:49.567752 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68a8c9-95e9-40f0-a5a1-bf8ad1c7ccba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:49.578378 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68a8c9-95e9-40f0-a5a1-bf8ad1c7ccba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:13:49.579965 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68a8c9-95e9-40f0-a5a1-bf8ad1c7ccba service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:13:49.589604 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1323/2663] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:13:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:13:49.683544 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033e728-38fb-47af-ab77-d2677e958896 None None] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:49.683967 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033e728-38fb-47af-ab77-d2677e958896 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:49.688701 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033e728-38fb-47af-ab77-d2677e958896 None None] PATH_INFO: `/` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:49.688701 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1341/2664] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 24 16:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:13:49.690987 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76591d-7449-4bf3-b0bc-f1e414b6423f None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:49.691271 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76591d-7449-4bf3-b0bc-f1e414b6423f None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:49.691572 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76591d-7449-4bf3-b0bc-f1e414b6423f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:49.735104 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-8a76591d-7449-4bf3-b0bc-f1e414b6423f None None] MFA Rules not processed for user `e5f0d8fe42e74d68bfa9a0e365bab4b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:13:49.736355 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-8a76591d-7449-4bf3-b0bc-f1e414b6423f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:13:49.746244 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1324/2665] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 24 16:13:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:13:49.758199 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033e728-38fb-47af-ab77-d2677e958896 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:49.772359 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033e728-38fb-47af-ab77-d2677e958896 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:49.776433 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c829c6-3a76-4876-9330-2ce702f6a49e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:49.777238 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c829c6-3a76-4876-9330-2ce702f6a49e service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:49.777517 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c829c6-3a76-4876-9330-2ce702f6a49e service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:49.777786 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c829c6-3a76-4876-9330-2ce702f6a49e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:49.797268 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c829c6-3a76-4876-9330-2ce702f6a49e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:13:49.797787 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c829c6-3a76-4876-9330-2ce702f6a49e service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:13:49.812330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1342/2666] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:13:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:13:49.940445 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76591d-7449-4bf3-b0bc-f1e414b6423f None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:49.940445 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-8a76591d-7449-4bf3-b0bc-f1e414b6423f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:13:49.966144 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76591d-7449-4bf3-b0bc-f1e414b6423f None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:49.981143 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418ac46-9531-4e39-a561-6090ef2408c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6907dfd3254d3c97d07ca2fb648858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:49.982136 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418ac46-9531-4e39-a561-6090ef2408c5 service placement] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:49.982663 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418ac46-9531-4e39-a561-6090ef2408c5 service placement] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:49.983220 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418ac46-9531-4e39-a561-6090ef2408c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:49.987542 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-7418ac46-9531-4e39-a561-6090ef2408c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:13:50.001628 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7418ac46-9531-4e39-a561-6090ef2408c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:13:50.005593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7418ac46-9531-4e39-a561-6090ef2408c5 service placement] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:13:50.027072 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1325/2667] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:13:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:13:51.122078 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c829c6-3a76-4876-9330-2ce702f6a49e service neutron] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:51.123623 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-f8c829c6-3a76-4876-9330-2ce702f6a49e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:13:51.142459 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c829c6-3a76-4876-9330-2ce702f6a49e service neutron] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:51.149838 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eecb46-0d73-4a66-aa08-728f668ddcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:51.150675 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eecb46-0d73-4a66-aa08-728f668ddcdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:51.151134 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eecb46-0d73-4a66-aa08-728f668ddcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:51.151738 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eecb46-0d73-4a66-aa08-728f668ddcdc admin admin] PATH_INFO: `/v3/users/d7e96891e45f427db01549f082d3f808` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:51.168823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eecb46-0d73-4a66-aa08-728f668ddcdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7e96891e45f427db01549f082d3f808)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:13:51.170779 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eecb46-0d73-4a66-aa08-728f668ddcdc admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:13:51.357795 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-00eecb46-0d73-4a66-aa08-728f668ddcdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7e96891e45f427db01549f082d3f808'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:13:51.358521 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-00eecb46-0d73-4a66-aa08-728f668ddcdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7e96891e45f427db01549f082d3f808'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:13:51.359144 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-00eecb46-0d73-4a66-aa08-728f668ddcdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7e96891e45f427db01549f082d3f808'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:13:51.373548 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-00eecb46-0d73-4a66-aa08-728f668ddcdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7e96891e45f427db01549f082d3f808'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:13:51.445774 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-00eecb46-0d73-4a66-aa08-728f668ddcdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7e96891e45f427db01549f082d3f808'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:13:51.458638 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1343/2668] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:13:51 2022] DELETE /identity/v3/users/d7e96891e45f427db01549f082d3f808 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:13:51.892183 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418ac46-9531-4e39-a561-6090ef2408c5 service placement] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:51.918942 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418ac46-9531-4e39-a561-6090ef2408c5 service placement] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:52.017797 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af43823-751c-479a-bc98-a6c71a689bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:52.018427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af43823-751c-479a-bc98-a6c71a689bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:52.018722 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af43823-751c-479a-bc98-a6c71a689bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:52.018983 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af43823-751c-479a-bc98-a6c71a689bf4 admin admin] PATH_INFO: `/v3/projects/9619d886d5f543f6b2b673f91256da8c` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:52.030743 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af43823-751c-479a-bc98-a6c71a689bf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9619d886d5f543f6b2b673f91256da8c)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:13:52.032903 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af43823-751c-479a-bc98-a6c71a689bf4 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:13:52.183561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-5af43823-751c-479a-bc98-a6c71a689bf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9619d886d5f543f6b2b673f91256da8c', 'request_id': 'req-5af43823-751c-479a-bc98-a6c71a689bf4'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:13:52.189645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-5af43823-751c-479a-bc98-a6c71a689bf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9619d886d5f543f6b2b673f91256da8c', 'request_id': 'req-5af43823-751c-479a-bc98-a6c71a689bf4'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:13:52.196486 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-5af43823-751c-479a-bc98-a6c71a689bf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9619d886d5f543f6b2b673f91256da8c', 'request_id': 'req-5af43823-751c-479a-bc98-a6c71a689bf4'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:13:52.313811 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-5af43823-751c-479a-bc98-a6c71a689bf4 admin admin] The token cache is being invalidate because project 9619d886d5f543f6b2b673f91256da8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:13:52.314102 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-5af43823-751c-479a-bc98-a6c71a689bf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:13:52.314730 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-5af43823-751c-479a-bc98-a6c71a689bf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:13:52.316210 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1326/2669] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:13:51 2022] DELETE /identity/v3/projects/9619d886d5f543f6b2b673f91256da8c => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:13:52.322031 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31778986-f9ab-41d3-a948-5edf4d3adcd2 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:52.322528 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31778986-f9ab-41d3-a948-5edf4d3adcd2 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:52.322644 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31778986-f9ab-41d3-a948-5edf4d3adcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:52.342827 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-31778986-f9ab-41d3-a948-5edf4d3adcd2 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:13:52.344028 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-31778986-f9ab-41d3-a948-5edf4d3adcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:13:52.372783 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:13:52.418821 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1344/2670] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:13:52.426629 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132e8f8-013d-4c36-bce9-f7c2023614c7 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:52.426923 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132e8f8-013d-4c36-bce9-f7c2023614c7 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:52.427297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132e8f8-013d-4c36-bce9-f7c2023614c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:52.453381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-5132e8f8-013d-4c36-bce9-f7c2023614c7 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:13:52.454605 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-5132e8f8-013d-4c36-bce9-f7c2023614c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:13:52.469231 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1327/2671] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:13:52.473995 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31778986-f9ab-41d3-a948-5edf4d3adcd2 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:52.485279 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31778986-f9ab-41d3-a948-5edf4d3adcd2 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:52.491524 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec033396-61ef-456d-a917-758c51e503d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:52.492133 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec033396-61ef-456d-a917-758c51e503d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:52.492589 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec033396-61ef-456d-a917-758c51e503d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:52.493084 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec033396-61ef-456d-a917-758c51e503d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:52.493744 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec033396-61ef-456d-a917-758c51e503d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:13:52.494273 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec033396-61ef-456d-a917-758c51e503d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:13:52.496180 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec033396-61ef-456d-a917-758c51e503d9 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:13:52.512115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1345/2672] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:13:52.516516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132e8f8-013d-4c36-bce9-f7c2023614c7 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:52.526897 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132e8f8-013d-4c36-bce9-f7c2023614c7 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:52.532222 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725244c-7aca-4f8a-8540-5091675180fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:52.532881 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725244c-7aca-4f8a-8540-5091675180fb admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:52.533160 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725244c-7aca-4f8a-8540-5091675180fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:52.533430 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725244c-7aca-4f8a-8540-5091675180fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:52.534068 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725244c-7aca-4f8a-8540-5091675180fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:13:52.536635 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725244c-7aca-4f8a-8540-5091675180fb admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:13:52.551779 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:13:52.648232 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1328/2673] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:13:52 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:13:52.652581 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec033396-61ef-456d-a917-758c51e503d9 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:52.663519 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec033396-61ef-456d-a917-758c51e503d9 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:52.724993 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c035254-4976-41cb-9518-54be431b1f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:52.725609 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c035254-4976-41cb-9518-54be431b1f74 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:52.725894 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c035254-4976-41cb-9518-54be431b1f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:52.726168 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c035254-4976-41cb-9518-54be431b1f74 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:52.726812 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c035254-4976-41cb-9518-54be431b1f74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:13:52.728749 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c035254-4976-41cb-9518-54be431b1f74 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:13:52.827390 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1346/2674] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:13:52 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:13:52.828591 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725244c-7aca-4f8a-8540-5091675180fb admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:52.839800 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725244c-7aca-4f8a-8540-5091675180fb admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:52.844584 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967f635-985e-4886-8c59-9114631bc26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:52.845132 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967f635-985e-4886-8c59-9114631bc26c admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:52.845809 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967f635-985e-4886-8c59-9114631bc26c admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:52.846266 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967f635-985e-4886-8c59-9114631bc26c admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:52.847187 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967f635-985e-4886-8c59-9114631bc26c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:13:52.849148 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967f635-985e-4886-8c59-9114631bc26c admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:13:52.860246 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1329/2675] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:13:52.864375 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c035254-4976-41cb-9518-54be431b1f74 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:52.875795 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c035254-4976-41cb-9518-54be431b1f74 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:52.881804 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad423d7-0aa9-4c07-8f73-667067737879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:52.882057 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad423d7-0aa9-4c07-8f73-667067737879 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:52.882408 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad423d7-0aa9-4c07-8f73-667067737879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:52.882744 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad423d7-0aa9-4c07-8f73-667067737879 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:52.883407 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad423d7-0aa9-4c07-8f73-667067737879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:13:52.885440 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad423d7-0aa9-4c07-8f73-667067737879 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:13:52.897833 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1347/2676] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:13:52.902156 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967f635-985e-4886-8c59-9114631bc26c admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:52.913164 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967f635-985e-4886-8c59-9114631bc26c admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:52.917874 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87658ab2-0899-4f4f-a8da-bd113431dd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:52.918555 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87658ab2-0899-4f4f-a8da-bd113431dd6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:52.919008 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87658ab2-0899-4f4f-a8da-bd113431dd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:52.919282 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87658ab2-0899-4f4f-a8da-bd113431dd6c admin admin] PATH_INFO: `/v3/projects/27f7ffc837af4976929c63d2ac047029/users/3df9763d30834b13964c491c4e5ef895/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:52.935172 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87658ab2-0899-4f4f-a8da-bd113431dd6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f7ffc837af4976929c63d2ac047029, user_id=3df9763d30834b13964c491c4e5ef895, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:13:52.938096 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87658ab2-0899-4f4f-a8da-bd113431dd6c admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:13:53.017041 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1330/2677] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:13:52 2022] PUT /identity/v3/projects/27f7ffc837af4976929c63d2ac047029/users/3df9763d30834b13964c491c4e5ef895/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:13:53.027491 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aac5cc-ca30-414c-abd0-98b1c9e98b47 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:53.027780 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aac5cc-ca30-414c-abd0-98b1c9e98b47 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:53.028054 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aac5cc-ca30-414c-abd0-98b1c9e98b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:53.056753 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-83aac5cc-ca30-414c-abd0-98b1c9e98b47 None None] MFA Rules not processed for user `3df9763d30834b13964c491c4e5ef895`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:13:53.057979 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-83aac5cc-ca30-414c-abd0-98b1c9e98b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:13:53.128508 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1348/2678] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:13:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:13:53.140923 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87658ab2-0899-4f4f-a8da-bd113431dd6c admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:53.142807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-87658ab2-0899-4f4f-a8da-bd113431dd6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:13:53.221868 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87658ab2-0899-4f4f-a8da-bd113431dd6c admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:53.227734 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01813ce-fa35-41ba-acdd-f44036d9e865 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:53.228351 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01813ce-fa35-41ba-acdd-f44036d9e865 service nova] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:53.228656 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01813ce-fa35-41ba-acdd-f44036d9e865 service nova] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:53.228934 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01813ce-fa35-41ba-acdd-f44036d9e865 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:53.237045 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01813ce-fa35-41ba-acdd-f44036d9e865 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:13:53.238650 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01813ce-fa35-41ba-acdd-f44036d9e865 service nova] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:13:53.248271 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1331/2679] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:13:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:13:54.963037 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aac5cc-ca30-414c-abd0-98b1c9e98b47 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:54.964538 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-83aac5cc-ca30-414c-abd0-98b1c9e98b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:13:54.985578 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:13:55.029383 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aac5cc-ca30-414c-abd0-98b1c9e98b47 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:55.033085 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a4f46-fa62-4bce-8dc7-4a5ebdf7516d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:55.033697 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a4f46-fa62-4bce-8dc7-4a5ebdf7516d service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:55.033972 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a4f46-fa62-4bce-8dc7-4a5ebdf7516d service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:55.034247 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a4f46-fa62-4bce-8dc7-4a5ebdf7516d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:55.036687 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-004a4f46-fa62-4bce-8dc7-4a5ebdf7516d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:13:55.104859 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a4f46-fa62-4bce-8dc7-4a5ebdf7516d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:13:55.106303 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a4f46-fa62-4bce-8dc7-4a5ebdf7516d service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:13:55.117469 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1349/2680] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:13:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:13:56.447469 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01813ce-fa35-41ba-acdd-f44036d9e865 service nova] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:56.458923 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01813ce-fa35-41ba-acdd-f44036d9e865 service nova] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:56.463986 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bd83d-a24c-4c86-8fed-9c65c00fa97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:56.464715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bd83d-a24c-4c86-8fed-9c65c00fa97b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:56.464933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bd83d-a24c-4c86-8fed-9c65c00fa97b admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:56.465204 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bd83d-a24c-4c86-8fed-9c65c00fa97b admin admin] PATH_INFO: `/v3/users/3df9763d30834b13964c491c4e5ef895` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:56.466370 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6bd83d-a24c-4c86-8fed-9c65c00fa97b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3df9763d30834b13964c491c4e5ef895)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:13:56.468421 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6bd83d-a24c-4c86-8fed-9c65c00fa97b admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:13:56.705114 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-6b6bd83d-a24c-4c86-8fed-9c65c00fa97b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3df9763d30834b13964c491c4e5ef895'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:13:56.705806 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-6b6bd83d-a24c-4c86-8fed-9c65c00fa97b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3df9763d30834b13964c491c4e5ef895'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:13:56.706453 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-6b6bd83d-a24c-4c86-8fed-9c65c00fa97b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3df9763d30834b13964c491c4e5ef895'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:13:56.787814 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-6b6bd83d-a24c-4c86-8fed-9c65c00fa97b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3df9763d30834b13964c491c4e5ef895'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:13:56.795758 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-6b6bd83d-a24c-4c86-8fed-9c65c00fa97b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3df9763d30834b13964c491c4e5ef895'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:13:56.814384 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1332/2681] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:13:56 2022] DELETE /identity/v3/users/3df9763d30834b13964c491c4e5ef895 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:13:56.820983 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee772b2-3299-4b64-881d-468e30d611bd None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:56.820983 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee772b2-3299-4b64-881d-468e30d611bd None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:56.820983 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee772b2-3299-4b64-881d-468e30d611bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:56.839969 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-0ee772b2-3299-4b64-881d-468e30d611bd None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:13:56.841298 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-0ee772b2-3299-4b64-881d-468e30d611bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:13:56.902801 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1350/2682] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:13:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:13:56.913289 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bd83d-a24c-4c86-8fed-9c65c00fa97b admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:56.914847 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-6b6bd83d-a24c-4c86-8fed-9c65c00fa97b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:13:56.927085 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:13:57.007735 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bd83d-a24c-4c86-8fed-9c65c00fa97b admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:57.012566 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e2c162-c653-4032-8a2d-18cfba41d83f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:57.013207 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2c162-c653-4032-8a2d-18cfba41d83f service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:57.013484 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2c162-c653-4032-8a2d-18cfba41d83f service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:57.013751 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2c162-c653-4032-8a2d-18cfba41d83f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:57.024330 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e2c162-c653-4032-8a2d-18cfba41d83f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:13:57.025800 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e2c162-c653-4032-8a2d-18cfba41d83f service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:13:57.038733 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1333/2683] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:13:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:13:57.640781 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee772b2-3299-4b64-881d-468e30d611bd None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:57.643903 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-0ee772b2-3299-4b64-881d-468e30d611bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:13:57.671701 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee772b2-3299-4b64-881d-468e30d611bd None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:57.684413 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19610c6-89fa-4d94-8eed-39bb74ddf4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:57.685113 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19610c6-89fa-4d94-8eed-39bb74ddf4d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:57.685395 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19610c6-89fa-4d94-8eed-39bb74ddf4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:57.685670 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19610c6-89fa-4d94-8eed-39bb74ddf4d2 admin admin] PATH_INFO: `/v3/projects/27f7ffc837af4976929c63d2ac047029` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:57.686819 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19610c6-89fa-4d94-8eed-39bb74ddf4d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27f7ffc837af4976929c63d2ac047029)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:13:57.688781 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19610c6-89fa-4d94-8eed-39bb74ddf4d2 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:13:57.846535 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-a19610c6-89fa-4d94-8eed-39bb74ddf4d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27f7ffc837af4976929c63d2ac047029', 'request_id': 'req-a19610c6-89fa-4d94-8eed-39bb74ddf4d2'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:13:57.937923 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-a19610c6-89fa-4d94-8eed-39bb74ddf4d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27f7ffc837af4976929c63d2ac047029', 'request_id': 'req-a19610c6-89fa-4d94-8eed-39bb74ddf4d2'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:13:57.948144 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-a19610c6-89fa-4d94-8eed-39bb74ddf4d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27f7ffc837af4976929c63d2ac047029', 'request_id': 'req-a19610c6-89fa-4d94-8eed-39bb74ddf4d2'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:13:57.950431 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:13:57.963287 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-a19610c6-89fa-4d94-8eed-39bb74ddf4d2 admin admin] The token cache is being invalidate because project 27f7ffc837af4976929c63d2ac047029 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:13:57.964136 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-a19610c6-89fa-4d94-8eed-39bb74ddf4d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:13:57.965022 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-a19610c6-89fa-4d94-8eed-39bb74ddf4d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:13:57.967248 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1351/2684] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:13:57 2022] DELETE /identity/v3/projects/27f7ffc837af4976929c63d2ac047029 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:13:57.975207 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7e180-f4da-4887-8929-5b35b41a3ffd None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:57.975753 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7e180-f4da-4887-8929-5b35b41a3ffd None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:57.975753 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7e180-f4da-4887-8929-5b35b41a3ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:58.005552 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-13f7e180-f4da-4887-8929-5b35b41a3ffd None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:13:58.006789 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-13f7e180-f4da-4887-8929-5b35b41a3ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:13:58.085239 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1334/2685] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:13:58.094863 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5a526-c0bc-4445-9523-e48bb9979164 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:58.095473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5a526-c0bc-4445-9523-e48bb9979164 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:58.095921 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5a526-c0bc-4445-9523-e48bb9979164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:58.141112 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-d3c5a526-c0bc-4445-9523-e48bb9979164 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:13:58.142328 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-d3c5a526-c0bc-4445-9523-e48bb9979164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:13:58.154543 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1352/2686] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:13:58.158880 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7e180-f4da-4887-8929-5b35b41a3ffd None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:58.170169 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7e180-f4da-4887-8929-5b35b41a3ffd None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:58.174826 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fcb8d6-096a-4d8c-98f8-038310f7cb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:58.175803 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcb8d6-096a-4d8c-98f8-038310f7cb03 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:58.175803 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcb8d6-096a-4d8c-98f8-038310f7cb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:58.176018 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcb8d6-096a-4d8c-98f8-038310f7cb03 admin admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:58.177275 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fcb8d6-096a-4d8c-98f8-038310f7cb03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:13:58.177709 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fcb8d6-096a-4d8c-98f8-038310f7cb03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:13:58.179155 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fcb8d6-096a-4d8c-98f8-038310f7cb03 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:13:58.201894 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1335/2687] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:13:58.203577 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5a526-c0bc-4445-9523-e48bb9979164 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:58.218407 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5a526-c0bc-4445-9523-e48bb9979164 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:58.226395 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003f3d2-8182-477d-a6cc-c45bc0cfc23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:58.227349 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003f3d2-8182-477d-a6cc-c45bc0cfc23b admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:58.227847 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003f3d2-8182-477d-a6cc-c45bc0cfc23b admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:58.228279 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003f3d2-8182-477d-a6cc-c45bc0cfc23b admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:58.229803 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8003f3d2-8182-477d-a6cc-c45bc0cfc23b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:13:58.232544 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8003f3d2-8182-477d-a6cc-c45bc0cfc23b admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:13:58.335216 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1353/2688] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:13:58 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:13:58.339065 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fcb8d6-096a-4d8c-98f8-038310f7cb03 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:58.356489 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fcb8d6-096a-4d8c-98f8-038310f7cb03 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:58.450462 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47930893-3e9f-49fd-97c0-dd338a85075e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:58.451087 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47930893-3e9f-49fd-97c0-dd338a85075e admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:58.455118 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47930893-3e9f-49fd-97c0-dd338a85075e admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:58.455118 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47930893-3e9f-49fd-97c0-dd338a85075e admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:58.455118 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47930893-3e9f-49fd-97c0-dd338a85075e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:13:58.455118 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47930893-3e9f-49fd-97c0-dd338a85075e admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:13:58.609735 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1336/2689] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:13:58 2022] POST /identity/v3/users => generated 287 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:13:58.610960 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003f3d2-8182-477d-a6cc-c45bc0cfc23b admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:58.621740 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003f3d2-8182-477d-a6cc-c45bc0cfc23b admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:58.626467 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0385e-95a5-46a7-8418-601148820e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:58.627134 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0385e-95a5-46a7-8418-601148820e1a admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:58.627438 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0385e-95a5-46a7-8418-601148820e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:58.628377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0385e-95a5-46a7-8418-601148820e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:58.628377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0385e-95a5-46a7-8418-601148820e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:13:58.630578 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0385e-95a5-46a7-8418-601148820e1a admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:13:58.646082 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1354/2690] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:13:58.647648 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47930893-3e9f-49fd-97c0-dd338a85075e admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:58.659006 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47930893-3e9f-49fd-97c0-dd338a85075e admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:58.664670 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae034bc9-791b-4ee3-9d21-c99ad531b927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:58.665297 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae034bc9-791b-4ee3-9d21-c99ad531b927 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:58.665672 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae034bc9-791b-4ee3-9d21-c99ad531b927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:58.666043 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae034bc9-791b-4ee3-9d21-c99ad531b927 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:58.666824 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae034bc9-791b-4ee3-9d21-c99ad531b927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:13:58.668558 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae034bc9-791b-4ee3-9d21-c99ad531b927 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:13:58.680363 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1337/2691] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:13:58.684472 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0385e-95a5-46a7-8418-601148820e1a admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:58.695398 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0385e-95a5-46a7-8418-601148820e1a admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:58.700197 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b74c13-662c-4bfa-9980-5e5a7aab8d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:58.700881 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b74c13-662c-4bfa-9980-5e5a7aab8d7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:58.701165 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b74c13-662c-4bfa-9980-5e5a7aab8d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:58.701441 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b74c13-662c-4bfa-9980-5e5a7aab8d7c admin admin] PATH_INFO: `/v3/projects/c918d03657df49c89a67ccabb4d1a903/users/7d9158ef498b460aa702d4080f2e2a42/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:58.720932 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b74c13-662c-4bfa-9980-5e5a7aab8d7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c918d03657df49c89a67ccabb4d1a903, user_id=7d9158ef498b460aa702d4080f2e2a42, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:13:58.724094 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b74c13-662c-4bfa-9980-5e5a7aab8d7c admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:13:58.796014 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1355/2692] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:13:58 2022] PUT /identity/v3/projects/c918d03657df49c89a67ccabb4d1a903/users/7d9158ef498b460aa702d4080f2e2a42/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:13:58.808939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80884391-f2db-4bb8-a2e8-60c5f95eedbc None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:58.809225 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80884391-f2db-4bb8-a2e8-60c5f95eedbc None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:58.809737 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80884391-f2db-4bb8-a2e8-60c5f95eedbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:58.849356 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-80884391-f2db-4bb8-a2e8-60c5f95eedbc None None] MFA Rules not processed for user `7d9158ef498b460aa702d4080f2e2a42`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:13:58.850783 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-80884391-f2db-4bb8-a2e8-60c5f95eedbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:13:58.855407 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:13:58.926068 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1338/2693] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:13:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:13:58.931753 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b74c13-662c-4bfa-9980-5e5a7aab8d7c admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:59.002241 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b74c13-662c-4bfa-9980-5e5a7aab8d7c admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:59.007440 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df6ff8-14f3-4023-8a05-afe3489c89a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:59.008054 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df6ff8-14f3-4023-8a05-afe3489c89a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:59.008339 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df6ff8-14f3-4023-8a05-afe3489c89a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:59.008616 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df6ff8-14f3-4023-8a05-afe3489c89a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:59.009283 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df6ff8-14f3-4023-8a05-afe3489c89a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:13:59.011449 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df6ff8-14f3-4023-8a05-afe3489c89a6 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:13:59.093526 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1356/2694] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:13:58 2022] POST /identity/v3/projects => generated 371 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:13:59.109088 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80884391-f2db-4bb8-a2e8-60c5f95eedbc None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:59.121254 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80884391-f2db-4bb8-a2e8-60c5f95eedbc None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:59.186264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77031123-db50-40e3-8f6b-993a4871741c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:59.216180 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77031123-db50-40e3-8f6b-993a4871741c admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:59.216180 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77031123-db50-40e3-8f6b-993a4871741c admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:59.216180 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77031123-db50-40e3-8f6b-993a4871741c admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:59.216180 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77031123-db50-40e3-8f6b-993a4871741c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:13:59.216180 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77031123-db50-40e3-8f6b-993a4871741c admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:13:59.428933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1339/2695] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:13:59 2022] POST /identity/v3/users => generated 292 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:13:59.432892 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df6ff8-14f3-4023-8a05-afe3489c89a6 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:59.446660 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df6ff8-14f3-4023-8a05-afe3489c89a6 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:59.451446 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638623b1-3c35-4dd0-b98a-017a0250a6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:59.452115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638623b1-3c35-4dd0-b98a-017a0250a6ea admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:59.452487 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638623b1-3c35-4dd0-b98a-017a0250a6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:59.452843 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638623b1-3c35-4dd0-b98a-017a0250a6ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:59.453554 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638623b1-3c35-4dd0-b98a-017a0250a6ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:13:59.455262 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638623b1-3c35-4dd0-b98a-017a0250a6ea admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:13:59.469647 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1357/2696] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:13:59.471617 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77031123-db50-40e3-8f6b-993a4871741c admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:59.473454 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-77031123-db50-40e3-8f6b-993a4871741c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:13:59.474368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638623b1-3c35-4dd0-b98a-017a0250a6ea admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:59.485952 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638623b1-3c35-4dd0-b98a-017a0250a6ea admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:59.486962 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77031123-db50-40e3-8f6b-993a4871741c admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:59.491022 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6479a-25da-4330-ac1b-b65dc3f0de42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:59.491865 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6479a-25da-4330-ac1b-b65dc3f0de42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:59.491981 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6479a-25da-4330-ac1b-b65dc3f0de42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:59.492228 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6479a-25da-4330-ac1b-b65dc3f0de42 admin admin] PATH_INFO: `/v3/projects/ecbb8bb8fecb4fdb8a91b3ceb8e2d0b1/users/e4641d825b2b49edaa7cfe5635568f37/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:59.494002 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174d261-cfa4-4b05-b73d-8d43f3cdadca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:59.494718 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174d261-cfa4-4b05-b73d-8d43f3cdadca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:59.495005 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174d261-cfa4-4b05-b73d-8d43f3cdadca admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:59.495279 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174d261-cfa4-4b05-b73d-8d43f3cdadca admin admin] PATH_INFO: `/v3/users/3f9710b10a9a4746a57a29dfedf88866` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:59.510475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174d261-cfa4-4b05-b73d-8d43f3cdadca admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f9710b10a9a4746a57a29dfedf88866)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:13:59.510706 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6479a-25da-4330-ac1b-b65dc3f0de42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecbb8bb8fecb4fdb8a91b3ceb8e2d0b1, user_id=e4641d825b2b49edaa7cfe5635568f37, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:13:59.512559 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174d261-cfa4-4b05-b73d-8d43f3cdadca admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:13:59.513193 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6479a-25da-4330-ac1b-b65dc3f0de42 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:13:59.581612 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1358/2697] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:13:59 2022] PUT /identity/v3/projects/ecbb8bb8fecb4fdb8a91b3ceb8e2d0b1/users/e4641d825b2b49edaa7cfe5635568f37/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:13:59.586159 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6479a-25da-4330-ac1b-b65dc3f0de42 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:59.627999 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:13:59.650862 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6479a-25da-4330-ac1b-b65dc3f0de42 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:59.655825 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81644531-d67c-40c4-ac96-e939f4bb8af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:59.656433 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81644531-d67c-40c4-ac96-e939f4bb8af4 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:59.656812 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81644531-d67c-40c4-ac96-e939f4bb8af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:59.657091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81644531-d67c-40c4-ac96-e939f4bb8af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:59.658731 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81644531-d67c-40c4-ac96-e939f4bb8af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:13:59.660353 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81644531-d67c-40c4-ac96-e939f4bb8af4 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:13:59.670451 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1359/2698] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:13:59.674447 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81644531-d67c-40c4-ac96-e939f4bb8af4 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:59.685370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81644531-d67c-40c4-ac96-e939f4bb8af4 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:59.690204 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6249427-8de3-4fb0-91f2-69681dde3e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:59.694863 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6249427-8de3-4fb0-91f2-69681dde3e69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:59.694863 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6249427-8de3-4fb0-91f2-69681dde3e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:59.694863 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6249427-8de3-4fb0-91f2-69681dde3e69 admin admin] PATH_INFO: `/v3/projects/ecbb8bb8fecb4fdb8a91b3ceb8e2d0b1/users/e4641d825b2b49edaa7cfe5635568f37/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:59.694863 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6249427-8de3-4fb0-91f2-69681dde3e69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecbb8bb8fecb4fdb8a91b3ceb8e2d0b1, user_id=e4641d825b2b49edaa7cfe5635568f37, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:13:59.696647 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6249427-8de3-4fb0-91f2-69681dde3e69 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:13:59.706820 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1360/2699] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:13:59 2022] PUT /identity/v3/projects/ecbb8bb8fecb4fdb8a91b3ceb8e2d0b1/users/e4641d825b2b49edaa7cfe5635568f37/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:13:59.716769 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa7be4-a751-4cd3-879b-f20e0a4bdb64 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:59.717060 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa7be4-a751-4cd3-879b-f20e0a4bdb64 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:59.717339 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa7be4-a751-4cd3-879b-f20e0a4bdb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:59.729802 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-d174d261-cfa4-4b05-b73d-8d43f3cdadca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f9710b10a9a4746a57a29dfedf88866'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:13:59.730494 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-d174d261-cfa4-4b05-b73d-8d43f3cdadca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f9710b10a9a4746a57a29dfedf88866'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:13:59.731115 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-d174d261-cfa4-4b05-b73d-8d43f3cdadca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f9710b10a9a4746a57a29dfedf88866'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:13:59.745348 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-e4fa7be4-a751-4cd3-879b-f20e0a4bdb64 None None] MFA Rules not processed for user `e4641d825b2b49edaa7cfe5635568f37`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:13:59.746560 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-e4fa7be4-a751-4cd3-879b-f20e0a4bdb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:13:59.805679 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-d174d261-cfa4-4b05-b73d-8d43f3cdadca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f9710b10a9a4746a57a29dfedf88866'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:13:59.814098 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-d174d261-cfa4-4b05-b73d-8d43f3cdadca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f9710b10a9a4746a57a29dfedf88866'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:13:59.819090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1361/2700] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:13:59 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:13:59.826706 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa7be4-a751-4cd3-879b-f20e0a4bdb64 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:13:59.828208 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-e4fa7be4-a751-4cd3-879b-f20e0a4bdb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:13:59.830347 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:13:59.837386 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1340/2701] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:13:59 2022] DELETE /identity/v3/users/3f9710b10a9a4746a57a29dfedf88866 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:13:59.887281 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa7be4-a751-4cd3-879b-f20e0a4bdb64 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:13:59.936968 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25b79f-a336-4bea-a131-afb5dd3f99b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:13:59.937637 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25b79f-a336-4bea-a131-afb5dd3f99b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:13:59.937921 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25b79f-a336-4bea-a131-afb5dd3f99b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:13:59.938194 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25b79f-a336-4bea-a131-afb5dd3f99b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:13:59.994608 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:00.006401 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25b79f-a336-4bea-a131-afb5dd3f99b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:00.007937 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25b79f-a336-4bea-a131-afb5dd3f99b4 service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:00.018053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1362/2702] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:13:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:14:00.151019 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174d261-cfa4-4b05-b73d-8d43f3cdadca admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:00.158372 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-d174d261-cfa4-4b05-b73d-8d43f3cdadca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:00.239727 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174d261-cfa4-4b05-b73d-8d43f3cdadca admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:00.244427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac916a1-9744-4e6f-a73a-8dd1018afd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:00.245108 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac916a1-9744-4e6f-a73a-8dd1018afd5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:00.245390 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac916a1-9744-4e6f-a73a-8dd1018afd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:00.245691 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac916a1-9744-4e6f-a73a-8dd1018afd5d admin admin] PATH_INFO: `/v3/projects/26f380b32d4640aabf2f43df27ec4f95` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:00.256328 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac916a1-9744-4e6f-a73a-8dd1018afd5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=26f380b32d4640aabf2f43df27ec4f95)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:00.258266 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac916a1-9744-4e6f-a73a-8dd1018afd5d admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:00.382525 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-3ac916a1-9744-4e6f-a73a-8dd1018afd5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26f380b32d4640aabf2f43df27ec4f95', 'request_id': 'req-3ac916a1-9744-4e6f-a73a-8dd1018afd5d'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:00.388820 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-3ac916a1-9744-4e6f-a73a-8dd1018afd5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26f380b32d4640aabf2f43df27ec4f95', 'request_id': 'req-3ac916a1-9744-4e6f-a73a-8dd1018afd5d'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:00.398394 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-3ac916a1-9744-4e6f-a73a-8dd1018afd5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26f380b32d4640aabf2f43df27ec4f95', 'request_id': 'req-3ac916a1-9744-4e6f-a73a-8dd1018afd5d'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:00.490890 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-3ac916a1-9744-4e6f-a73a-8dd1018afd5d admin admin] The token cache is being invalidate because project 26f380b32d4640aabf2f43df27ec4f95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:14:00.494124 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-3ac916a1-9744-4e6f-a73a-8dd1018afd5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:00.494124 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-3ac916a1-9744-4e6f-a73a-8dd1018afd5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:00.494124 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1341/2703] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:14:00 2022] DELETE /identity/v3/projects/26f380b32d4640aabf2f43df27ec4f95 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:14:00.498423 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61adee9c-d2a2-4a42-a1a3-ccfe50b57ac2 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:00.498712 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61adee9c-d2a2-4a42-a1a3-ccfe50b57ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:00.498996 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61adee9c-d2a2-4a42-a1a3-ccfe50b57ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:00.520219 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-61adee9c-d2a2-4a42-a1a3-ccfe50b57ac2 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:00.522670 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-61adee9c-d2a2-4a42-a1a3-ccfe50b57ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:00.596689 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1363/2704] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:14:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:14:00.599552 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e5119-7ffa-4b53-ae43-0a16f91e7347 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:00.599831 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e5119-7ffa-4b53-ae43-0a16f91e7347 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:00.600099 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e5119-7ffa-4b53-ae43-0a16f91e7347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:00.620525 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-112e5119-7ffa-4b53-ae43-0a16f91e7347 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:00.621841 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-112e5119-7ffa-4b53-ae43-0a16f91e7347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:00.631203 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1342/2705] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:14:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:14:00.644807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61adee9c-d2a2-4a42-a1a3-ccfe50b57ac2 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:00.645728 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61adee9c-d2a2-4a42-a1a3-ccfe50b57ac2 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:00.650666 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d473d49-5c5d-4d13-bc30-6ae7b1b43ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:00.651205 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d473d49-5c5d-4d13-bc30-6ae7b1b43ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:00.651481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d473d49-5c5d-4d13-bc30-6ae7b1b43ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:00.651762 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d473d49-5c5d-4d13-bc30-6ae7b1b43ad4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:00.652387 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d473d49-5c5d-4d13-bc30-6ae7b1b43ad4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:14:00.652713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d473d49-5c5d-4d13-bc30-6ae7b1b43ad4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:00.654318 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d473d49-5c5d-4d13-bc30-6ae7b1b43ad4 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:00.666559 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1364/2706] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:14:00.670947 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e5119-7ffa-4b53-ae43-0a16f91e7347 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:00.682529 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e5119-7ffa-4b53-ae43-0a16f91e7347 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:00.687623 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f71dfc-bdeb-4a08-a74f-c2496b3263bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:00.688225 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f71dfc-bdeb-4a08-a74f-c2496b3263bb admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:00.688501 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f71dfc-bdeb-4a08-a74f-c2496b3263bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:00.688838 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f71dfc-bdeb-4a08-a74f-c2496b3263bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:00.689520 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f71dfc-bdeb-4a08-a74f-c2496b3263bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:00.691443 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f71dfc-bdeb-4a08-a74f-c2496b3263bb admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:00.809708 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1343/2707] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:14:00 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:14:00.810758 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d473d49-5c5d-4d13-bc30-6ae7b1b43ad4 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:00.821486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d473d49-5c5d-4d13-bc30-6ae7b1b43ad4 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:00.882885 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff232fe3-b4c2-4d0b-843e-969b1ec0f260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:00.883630 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff232fe3-b4c2-4d0b-843e-969b1ec0f260 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:00.883909 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff232fe3-b4c2-4d0b-843e-969b1ec0f260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:00.884183 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff232fe3-b4c2-4d0b-843e-969b1ec0f260 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:00.885111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff232fe3-b4c2-4d0b-843e-969b1ec0f260 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:00.887041 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff232fe3-b4c2-4d0b-843e-969b1ec0f260 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:01.006056 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1365/2708] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:14:00 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:14:01.010475 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f71dfc-bdeb-4a08-a74f-c2496b3263bb admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:01.020885 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f71dfc-bdeb-4a08-a74f-c2496b3263bb admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:01.025398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f11130-d80b-4c51-ba53-74ffe42355df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:01.025989 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f11130-d80b-4c51-ba53-74ffe42355df admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:01.026263 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f11130-d80b-4c51-ba53-74ffe42355df admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:01.026532 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f11130-d80b-4c51-ba53-74ffe42355df admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:01.027162 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f11130-d80b-4c51-ba53-74ffe42355df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:01.028811 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f11130-d80b-4c51-ba53-74ffe42355df admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:01.040028 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1344/2709] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:14:01.040811 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff232fe3-b4c2-4d0b-843e-969b1ec0f260 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:01.043706 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-ff232fe3-b4c2-4d0b-843e-969b1ec0f260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:01.046247 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f11130-d80b-4c51-ba53-74ffe42355df admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:01.056887 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff232fe3-b4c2-4d0b-843e-969b1ec0f260 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:01.057069 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f11130-d80b-4c51-ba53-74ffe42355df admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:01.061470 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b82c5-55c8-4b6a-ad0f-d94140667daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:01.061615 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a7a2e-24f1-42d6-9b57-29ab19a7e51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:01.062152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b82c5-55c8-4b6a-ad0f-d94140667daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:01.062265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a7a2e-24f1-42d6-9b57-29ab19a7e51d admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:01.062435 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b82c5-55c8-4b6a-ad0f-d94140667daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:01.062542 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a7a2e-24f1-42d6-9b57-29ab19a7e51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:01.062701 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a7a2e-24f1-42d6-9b57-29ab19a7e51d admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:01.062818 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b82c5-55c8-4b6a-ad0f-d94140667daf admin admin] PATH_INFO: `/v3/users/7d9158ef498b460aa702d4080f2e2a42` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:01.063330 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a7a2e-24f1-42d6-9b57-29ab19a7e51d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:01.063828 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b82c5-55c8-4b6a-ad0f-d94140667daf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d9158ef498b460aa702d4080f2e2a42)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:01.064969 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a7a2e-24f1-42d6-9b57-29ab19a7e51d admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:01.065745 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b82c5-55c8-4b6a-ad0f-d94140667daf admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:01.075377 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1345/2710] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:14:01.079459 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a7a2e-24f1-42d6-9b57-29ab19a7e51d admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:01.091031 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:01.093255 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a7a2e-24f1-42d6-9b57-29ab19a7e51d admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:01.098643 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fdaa0-6fb1-4a40-8125-7e41bfaddf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:01.099600 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fdaa0-6fb1-4a40-8125-7e41bfaddf80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:01.099878 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fdaa0-6fb1-4a40-8125-7e41bfaddf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:01.100147 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fdaa0-6fb1-4a40-8125-7e41bfaddf80 admin admin] PATH_INFO: `/v3/projects/8d335e0b84ab4e4bba0a651afd80944d/users/22b6eed9050c416a92681ec1eb7b10b5/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:01.116003 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fdaa0-6fb1-4a40-8125-7e41bfaddf80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d335e0b84ab4e4bba0a651afd80944d, user_id=22b6eed9050c416a92681ec1eb7b10b5, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:01.118721 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fdaa0-6fb1-4a40-8125-7e41bfaddf80 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:01.200463 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1346/2711] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:14:01 2022] PUT /identity/v3/projects/8d335e0b84ab4e4bba0a651afd80944d/users/22b6eed9050c416a92681ec1eb7b10b5/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:14:01.205220 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252e022-84f6-411b-9a58-191bcc017e5f None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:01.205505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252e022-84f6-411b-9a58-191bcc017e5f None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:01.205778 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252e022-84f6-411b-9a58-191bcc017e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:01.213244 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:01.226151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-8252e022-84f6-411b-9a58-191bcc017e5f None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:01.232088 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-8252e022-84f6-411b-9a58-191bcc017e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:01.264344 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-278b82c5-55c8-4b6a-ad0f-d94140667daf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d9158ef498b460aa702d4080f2e2a42'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:01.265002 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-278b82c5-55c8-4b6a-ad0f-d94140667daf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d9158ef498b460aa702d4080f2e2a42'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:01.265617 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-278b82c5-55c8-4b6a-ad0f-d94140667daf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d9158ef498b460aa702d4080f2e2a42'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:01.278455 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-278b82c5-55c8-4b6a-ad0f-d94140667daf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d9158ef498b460aa702d4080f2e2a42'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:01.287811 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1347/2712] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:14:01.297558 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252e022-84f6-411b-9a58-191bcc017e5f None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:01.298974 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-8252e022-84f6-411b-9a58-191bcc017e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:01.342648 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-278b82c5-55c8-4b6a-ad0f-d94140667daf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d9158ef498b460aa702d4080f2e2a42'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:01.356874 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1366/2713] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:14:01 2022] DELETE /identity/v3/users/7d9158ef498b460aa702d4080f2e2a42 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:14:01.358325 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252e022-84f6-411b-9a58-191bcc017e5f None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:01.361260 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c5a26-135b-44dd-89e1-7e35ccfab090 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:01.361541 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c5a26-135b-44dd-89e1-7e35ccfab090 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:01.361812 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c5a26-135b-44dd-89e1-7e35ccfab090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:01.382185 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-169c5a26-135b-44dd-89e1-7e35ccfab090 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:01.383445 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-169c5a26-135b-44dd-89e1-7e35ccfab090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:01.409373 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d31408-90f3-422a-9139-beeca918d033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:01.409984 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d31408-90f3-422a-9139-beeca918d033 service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:01.410264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d31408-90f3-422a-9139-beeca918d033 service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:01.410577 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d31408-90f3-422a-9139-beeca918d033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:01.447807 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1367/2714] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:14:01.453957 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c5a26-135b-44dd-89e1-7e35ccfab090 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:01.463595 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c5a26-135b-44dd-89e1-7e35ccfab090 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:01.467241 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49162d-209c-4036-ad9d-b8ef003621c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:01.467835 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49162d-209c-4036-ad9d-b8ef003621c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:01.468116 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49162d-209c-4036-ad9d-b8ef003621c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:01.468525 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49162d-209c-4036-ad9d-b8ef003621c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:01.473226 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d31408-90f3-422a-9139-beeca918d033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:01.475126 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d31408-90f3-422a-9139-beeca918d033 service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:01.477777 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49162d-209c-4036-ad9d-b8ef003621c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:01.479217 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49162d-209c-4036-ad9d-b8ef003621c3 service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:01.485645 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1348/2715] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:14:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:14:01.489709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1368/2716] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:14:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:14:02.065285 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d31408-90f3-422a-9139-beeca918d033 service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:02.067301 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-99d31408-90f3-422a-9139-beeca918d033 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:02.079910 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d31408-90f3-422a-9139-beeca918d033 service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:02.085063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420afc3-f752-4054-9e3c-d8a7c8652d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:02.088871 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420afc3-f752-4054-9e3c-d8a7c8652d78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:02.088871 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420afc3-f752-4054-9e3c-d8a7c8652d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:02.088871 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420afc3-f752-4054-9e3c-d8a7c8652d78 admin admin] PATH_INFO: `/v3/projects/c918d03657df49c89a67ccabb4d1a903` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:02.088871 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420afc3-f752-4054-9e3c-d8a7c8652d78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c918d03657df49c89a67ccabb4d1a903)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:02.089362 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420afc3-f752-4054-9e3c-d8a7c8652d78 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:02.091784 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:02.263864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-8420afc3-f752-4054-9e3c-d8a7c8652d78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c918d03657df49c89a67ccabb4d1a903', 'request_id': 'req-8420afc3-f752-4054-9e3c-d8a7c8652d78'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:02.269427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-8420afc3-f752-4054-9e3c-d8a7c8652d78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c918d03657df49c89a67ccabb4d1a903', 'request_id': 'req-8420afc3-f752-4054-9e3c-d8a7c8652d78'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:02.276495 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-8420afc3-f752-4054-9e3c-d8a7c8652d78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c918d03657df49c89a67ccabb4d1a903', 'request_id': 'req-8420afc3-f752-4054-9e3c-d8a7c8652d78'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:02.348559 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-8420afc3-f752-4054-9e3c-d8a7c8652d78 admin admin] The token cache is being invalidate because project c918d03657df49c89a67ccabb4d1a903 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:14:02.348981 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-8420afc3-f752-4054-9e3c-d8a7c8652d78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:02.349610 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-8420afc3-f752-4054-9e3c-d8a7c8652d78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:02.351097 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1349/2717] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:14:02 2022] DELETE /identity/v3/projects/c918d03657df49c89a67ccabb4d1a903 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:14:02.355097 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49162d-209c-4036-ad9d-b8ef003621c3 service neutron] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:02.365779 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49162d-209c-4036-ad9d-b8ef003621c3 service neutron] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:02.429629 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec126b67-a354-4d51-afb9-f004a6118262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:02.430632 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec126b67-a354-4d51-afb9-f004a6118262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:02.430918 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec126b67-a354-4d51-afb9-f004a6118262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:02.431315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec126b67-a354-4d51-afb9-f004a6118262 admin admin] PATH_INFO: `/v3/users/e4641d825b2b49edaa7cfe5635568f37` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:02.432394 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec126b67-a354-4d51-afb9-f004a6118262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4641d825b2b49edaa7cfe5635568f37)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:02.434359 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec126b67-a354-4d51-afb9-f004a6118262 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:02.606459 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:02.620025 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-ec126b67-a354-4d51-afb9-f004a6118262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4641d825b2b49edaa7cfe5635568f37'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:02.620709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-ec126b67-a354-4d51-afb9-f004a6118262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4641d825b2b49edaa7cfe5635568f37'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:02.621308 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-ec126b67-a354-4d51-afb9-f004a6118262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4641d825b2b49edaa7cfe5635568f37'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:02.633187 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-ec126b67-a354-4d51-afb9-f004a6118262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4641d825b2b49edaa7cfe5635568f37'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:02.764186 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-ec126b67-a354-4d51-afb9-f004a6118262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4641d825b2b49edaa7cfe5635568f37'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:02.778960 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1369/2718] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:14:02 2022] DELETE /identity/v3/users/e4641d825b2b49edaa7cfe5635568f37 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:14:03.371407 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420afc3-f752-4054-9e3c-d8a7c8652d78 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:03.373210 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-8420afc3-f752-4054-9e3c-d8a7c8652d78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:03.390614 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420afc3-f752-4054-9e3c-d8a7c8652d78 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:03.475490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58be64-51a0-4af5-98bf-15127ac49498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:03.476247 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58be64-51a0-4af5-98bf-15127ac49498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:03.476532 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58be64-51a0-4af5-98bf-15127ac49498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:03.476856 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58be64-51a0-4af5-98bf-15127ac49498 admin admin] PATH_INFO: `/v3/projects/ecbb8bb8fecb4fdb8a91b3ceb8e2d0b1` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:03.477992 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58be64-51a0-4af5-98bf-15127ac49498 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecbb8bb8fecb4fdb8a91b3ceb8e2d0b1)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:03.480865 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58be64-51a0-4af5-98bf-15127ac49498 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:03.665448 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-7a58be64-51a0-4af5-98bf-15127ac49498 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecbb8bb8fecb4fdb8a91b3ceb8e2d0b1', 'request_id': 'req-7a58be64-51a0-4af5-98bf-15127ac49498'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:03.671854 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-7a58be64-51a0-4af5-98bf-15127ac49498 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecbb8bb8fecb4fdb8a91b3ceb8e2d0b1', 'request_id': 'req-7a58be64-51a0-4af5-98bf-15127ac49498'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:03.679337 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-7a58be64-51a0-4af5-98bf-15127ac49498 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecbb8bb8fecb4fdb8a91b3ceb8e2d0b1', 'request_id': 'req-7a58be64-51a0-4af5-98bf-15127ac49498'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:03.731560 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-7a58be64-51a0-4af5-98bf-15127ac49498 admin admin] The token cache is being invalidate because project ecbb8bb8fecb4fdb8a91b3ceb8e2d0b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:14:03.731872 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-7a58be64-51a0-4af5-98bf-15127ac49498 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:03.732559 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-7a58be64-51a0-4af5-98bf-15127ac49498 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:03.734111 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1350/2719] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:14:03 2022] DELETE /identity/v3/projects/ecbb8bb8fecb4fdb8a91b3ceb8e2d0b1 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:14:03.739750 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c21c1-02be-4f9c-a8d4-38ffd0bf2565 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:03.740280 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c21c1-02be-4f9c-a8d4-38ffd0bf2565 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:03.740379 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c21c1-02be-4f9c-a8d4-38ffd0bf2565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:03.766054 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-4b5c21c1-02be-4f9c-a8d4-38ffd0bf2565 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:03.767286 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-4b5c21c1-02be-4f9c-a8d4-38ffd0bf2565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:03.885221 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1370/2720] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:14:03.886548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839e203-040c-400a-a434-df89584ec995 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:03.886842 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839e203-040c-400a-a434-df89584ec995 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:03.887380 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839e203-040c-400a-a434-df89584ec995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:03.913251 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-d839e203-040c-400a-a434-df89584ec995 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:03.914476 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-d839e203-040c-400a-a434-df89584ec995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:03.923251 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1351/2721] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:14:03.929692 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c21c1-02be-4f9c-a8d4-38ffd0bf2565 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:03.943550 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c21c1-02be-4f9c-a8d4-38ffd0bf2565 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:03.949238 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d3c38-22ca-481e-985f-3199afbdd0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:03.949860 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d3c38-22ca-481e-985f-3199afbdd0cc admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:03.950143 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d3c38-22ca-481e-985f-3199afbdd0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:03.950418 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d3c38-22ca-481e-985f-3199afbdd0cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:03.951077 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d3c38-22ca-481e-985f-3199afbdd0cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:14:03.951383 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d3c38-22ca-481e-985f-3199afbdd0cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:03.953031 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d3c38-22ca-481e-985f-3199afbdd0cc admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:03.966015 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1371/2722] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:14:03.970602 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839e203-040c-400a-a434-df89584ec995 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:03.980897 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839e203-040c-400a-a434-df89584ec995 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:03.985819 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91132c5-d111-46e2-8f87-e26b6f9fff02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:03.986427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91132c5-d111-46e2-8f87-e26b6f9fff02 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:03.986752 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91132c5-d111-46e2-8f87-e26b6f9fff02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:03.989708 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91132c5-d111-46e2-8f87-e26b6f9fff02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:03.989708 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91132c5-d111-46e2-8f87-e26b6f9fff02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:03.990268 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91132c5-d111-46e2-8f87-e26b6f9fff02 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:04.005854 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:04.077563 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1352/2723] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:14:03 2022] POST /identity/v3/projects => generated 363 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:14:04.081542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d3c38-22ca-481e-985f-3199afbdd0cc admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:04.091706 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d3c38-22ca-481e-985f-3199afbdd0cc admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:04.158557 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ea4d2-98f0-4e88-bf84-bf2a595f0feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:04.159223 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ea4d2-98f0-4e88-bf84-bf2a595f0feb admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:04.159539 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ea4d2-98f0-4e88-bf84-bf2a595f0feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:04.159829 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ea4d2-98f0-4e88-bf84-bf2a595f0feb admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:04.160996 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ea4d2-98f0-4e88-bf84-bf2a595f0feb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:04.163013 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ea4d2-98f0-4e88-bf84-bf2a595f0feb admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:04.258294 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1372/2724] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:14:04 2022] POST /identity/v3/users => generated 282 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:14:04.262867 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91132c5-d111-46e2-8f87-e26b6f9fff02 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:04.273743 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91132c5-d111-46e2-8f87-e26b6f9fff02 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:04.279239 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b06f3c-46e2-4f1d-864b-0465f903dd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:04.280347 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b06f3c-46e2-4f1d-864b-0465f903dd42 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:04.280812 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b06f3c-46e2-4f1d-864b-0465f903dd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:04.281408 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b06f3c-46e2-4f1d-864b-0465f903dd42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:04.282019 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b06f3c-46e2-4f1d-864b-0465f903dd42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:04.284196 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b06f3c-46e2-4f1d-864b-0465f903dd42 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:04.302382 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1353/2725] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:14:04.306190 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ea4d2-98f0-4e88-bf84-bf2a595f0feb admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:04.321282 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ea4d2-98f0-4e88-bf84-bf2a595f0feb admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:04.330330 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f5dc0-4494-43ee-bdd3-1b7605f2d737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:04.330986 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f5dc0-4494-43ee-bdd3-1b7605f2d737 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:04.331267 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f5dc0-4494-43ee-bdd3-1b7605f2d737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:04.331540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f5dc0-4494-43ee-bdd3-1b7605f2d737 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:04.332976 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f5dc0-4494-43ee-bdd3-1b7605f2d737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:04.335309 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f5dc0-4494-43ee-bdd3-1b7605f2d737 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:04.347437 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1373/2726] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:14:04.352535 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b06f3c-46e2-4f1d-864b-0465f903dd42 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:04.363966 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b06f3c-46e2-4f1d-864b-0465f903dd42 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:04.368916 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f2fed-7c69-445c-9f72-a4f63adef2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:04.369735 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f2fed-7c69-445c-9f72-a4f63adef2cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:04.370152 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f2fed-7c69-445c-9f72-a4f63adef2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:04.373420 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f2fed-7c69-445c-9f72-a4f63adef2cd admin admin] PATH_INFO: `/v3/projects/323da2b1e52a475fa56c49c22d7ced0d/users/325fd0a25ded4987a93a17dda2dbbd56/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:04.390608 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f2fed-7c69-445c-9f72-a4f63adef2cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=323da2b1e52a475fa56c49c22d7ced0d, user_id=325fd0a25ded4987a93a17dda2dbbd56, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:04.396597 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f2fed-7c69-445c-9f72-a4f63adef2cd admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:04.485092 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1354/2727] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:14:04 2022] PUT /identity/v3/projects/323da2b1e52a475fa56c49c22d7ced0d/users/325fd0a25ded4987a93a17dda2dbbd56/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:14:04.485776 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8359a6-f6f2-451d-8ca2-b2702bcaf04f None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:04.486113 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8359a6-f6f2-451d-8ca2-b2702bcaf04f None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:04.486389 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8359a6-f6f2-451d-8ca2-b2702bcaf04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:04.521265 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:04.528340 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-9b8359a6-f6f2-451d-8ca2-b2702bcaf04f None None] MFA Rules not processed for user `325fd0a25ded4987a93a17dda2dbbd56`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:04.530078 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-9b8359a6-f6f2-451d-8ca2-b2702bcaf04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:04.624483 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1374/2728] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:14:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:14:04.628961 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f2fed-7c69-445c-9f72-a4f63adef2cd admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:04.720982 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f2fed-7c69-445c-9f72-a4f63adef2cd admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:04.727288 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67288244-b1fe-43fb-a0de-1c21d68b047a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:04.728052 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67288244-b1fe-43fb-a0de-1c21d68b047a admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:04.728415 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67288244-b1fe-43fb-a0de-1c21d68b047a admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:04.728804 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67288244-b1fe-43fb-a0de-1c21d68b047a admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:04.729516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67288244-b1fe-43fb-a0de-1c21d68b047a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:04.731525 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67288244-b1fe-43fb-a0de-1c21d68b047a admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:04.817582 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1355/2729] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:14:04 2022] POST /identity/v3/projects => generated 365 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:14:04.818711 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8359a6-f6f2-451d-8ca2-b2702bcaf04f None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:04.830543 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8359a6-f6f2-451d-8ca2-b2702bcaf04f None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:04.909522 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21949fa2-a7be-464c-8226-533b2894daac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:04.911509 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21949fa2-a7be-464c-8226-533b2894daac admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:04.912173 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21949fa2-a7be-464c-8226-533b2894daac admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:04.912607 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21949fa2-a7be-464c-8226-533b2894daac admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:04.913939 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21949fa2-a7be-464c-8226-533b2894daac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:04.916697 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21949fa2-a7be-464c-8226-533b2894daac admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:05.044135 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1375/2730] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:14:04 2022] POST /identity/v3/users => generated 289 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:14:05.048183 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67288244-b1fe-43fb-a0de-1c21d68b047a admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:05.059200 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67288244-b1fe-43fb-a0de-1c21d68b047a admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:05.073936 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8e7b1-2753-448b-a0a5-6731c4e7c4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:05.073936 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8e7b1-2753-448b-a0a5-6731c4e7c4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:05.073936 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8e7b1-2753-448b-a0a5-6731c4e7c4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:05.074332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8e7b1-2753-448b-a0a5-6731c4e7c4a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:05.075284 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8e7b1-2753-448b-a0a5-6731c4e7c4a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:05.077115 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8e7b1-2753-448b-a0a5-6731c4e7c4a4 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:05.092616 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1356/2731] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:14:05.096479 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21949fa2-a7be-464c-8226-533b2894daac admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:05.110762 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21949fa2-a7be-464c-8226-533b2894daac admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:05.117412 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad577c8-5f58-490a-ac23-a4037ce78bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:05.119753 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad577c8-5f58-490a-ac23-a4037ce78bb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:05.119753 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad577c8-5f58-490a-ac23-a4037ce78bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:05.119753 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad577c8-5f58-490a-ac23-a4037ce78bb9 admin admin] PATH_INFO: `/v3/projects/bb821bd276e047b1809f991c3e787f4d/users/c02f455fe4474d448e6a399b5821b4b4/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:05.140050 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad577c8-5f58-490a-ac23-a4037ce78bb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb821bd276e047b1809f991c3e787f4d, user_id=c02f455fe4474d448e6a399b5821b4b4, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:05.143227 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad577c8-5f58-490a-ac23-a4037ce78bb9 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:05.236919 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1376/2732] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:14:05 2022] PUT /identity/v3/projects/bb821bd276e047b1809f991c3e787f4d/users/c02f455fe4474d448e6a399b5821b4b4/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:14:05.240599 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8e7b1-2753-448b-a0a5-6731c4e7c4a4 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:05.250823 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8e7b1-2753-448b-a0a5-6731c4e7c4a4 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:05.330445 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ae6af-08e0-4d65-b91e-1cdba80e4aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:05.331069 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ae6af-08e0-4d65-b91e-1cdba80e4aaa admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:05.331344 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ae6af-08e0-4d65-b91e-1cdba80e4aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:05.331644 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ae6af-08e0-4d65-b91e-1cdba80e4aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:05.332293 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ae6af-08e0-4d65-b91e-1cdba80e4aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:05.336100 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ae6af-08e0-4d65-b91e-1cdba80e4aaa admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:05.348734 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1357/2733] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:14:05.353537 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad577c8-5f58-490a-ac23-a4037ce78bb9 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:05.368817 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad577c8-5f58-490a-ac23-a4037ce78bb9 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:05.375081 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721f025-3be0-41a7-bdc7-da8373cf7437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:05.376229 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721f025-3be0-41a7-bdc7-da8373cf7437 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:05.377585 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721f025-3be0-41a7-bdc7-da8373cf7437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:05.377585 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721f025-3be0-41a7-bdc7-da8373cf7437 admin admin] PATH_INFO: `/v3/projects/bb821bd276e047b1809f991c3e787f4d/users/c02f455fe4474d448e6a399b5821b4b4/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:05.379828 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721f025-3be0-41a7-bdc7-da8373cf7437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb821bd276e047b1809f991c3e787f4d, user_id=c02f455fe4474d448e6a399b5821b4b4, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:05.383094 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721f025-3be0-41a7-bdc7-da8373cf7437 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:05.398546 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1377/2734] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:14:05 2022] PUT /identity/v3/projects/bb821bd276e047b1809f991c3e787f4d/users/c02f455fe4474d448e6a399b5821b4b4/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:14:05.410528 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0127c3-4c03-4a6a-9a05-25588bb37a15 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:05.411876 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0127c3-4c03-4a6a-9a05-25588bb37a15 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:05.412225 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0127c3-4c03-4a6a-9a05-25588bb37a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:05.448718 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-7f0127c3-4c03-4a6a-9a05-25588bb37a15 None None] MFA Rules not processed for user `c02f455fe4474d448e6a399b5821b4b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:05.449956 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-7f0127c3-4c03-4a6a-9a05-25588bb37a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:05.476712 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:05.550889 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1358/2735] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:14:05 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:14:05.560245 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721f025-3be0-41a7-bdc7-da8373cf7437 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:05.564391 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-1721f025-3be0-41a7-bdc7-da8373cf7437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:05.639112 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721f025-3be0-41a7-bdc7-da8373cf7437 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:05.645266 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b442c5-9124-42fe-99a9-acd869a686a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:05.646147 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b442c5-9124-42fe-99a9-acd869a686a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:05.646430 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b442c5-9124-42fe-99a9-acd869a686a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:05.646705 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b442c5-9124-42fe-99a9-acd869a686a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:05.657721 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b442c5-9124-42fe-99a9-acd869a686a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:05.659177 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b442c5-9124-42fe-99a9-acd869a686a7 service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:05.664408 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:05.671808 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1378/2736] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:14:05 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:14:05.926453 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0127c3-4c03-4a6a-9a05-25588bb37a15 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:05.937165 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0127c3-4c03-4a6a-9a05-25588bb37a15 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:05.941190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218e236-e946-4f0a-ae1d-4937f90613e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:05.941983 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218e236-e946-4f0a-ae1d-4937f90613e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:05.942498 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218e236-e946-4f0a-ae1d-4937f90613e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:05.942844 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218e236-e946-4f0a-ae1d-4937f90613e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:06.029419 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218e236-e946-4f0a-ae1d-4937f90613e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:06.031148 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218e236-e946-4f0a-ae1d-4937f90613e7 service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:06.046090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1359/2737] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:14:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:14:07.300732 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec662185-89ce-4dce-adb7-abe3a57f5604 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:07.302292 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec662185-89ce-4dce-adb7-abe3a57f5604 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:07.302695 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec662185-89ce-4dce-adb7-abe3a57f5604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:07.334089 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-ec662185-89ce-4dce-adb7-abe3a57f5604 None None] MFA Rules not processed for user `22b6eed9050c416a92681ec1eb7b10b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:07.335317 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-ec662185-89ce-4dce-adb7-abe3a57f5604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:07.403737 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1379/2738] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:14:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:14:07.419994 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218e236-e946-4f0a-ae1d-4937f90613e7 service cinder] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:07.421474 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-5218e236-e946-4f0a-ae1d-4937f90613e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:07.499505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218e236-e946-4f0a-ae1d-4937f90613e7 service cinder] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:07.507066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe289c-02ac-4838-bbfb-cf779a02f2cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:07.507686 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe289c-02ac-4838-bbfb-cf779a02f2cf service nova] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:07.507967 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe289c-02ac-4838-bbfb-cf779a02f2cf service nova] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:07.508237 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe289c-02ac-4838-bbfb-cf779a02f2cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:07.517148 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe289c-02ac-4838-bbfb-cf779a02f2cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:07.518744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe289c-02ac-4838-bbfb-cf779a02f2cf service nova] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:07.528676 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1360/2739] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:14:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:14:09.933935 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1115f-e520-4486-8586-ffefb6891239 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:09.934450 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1115f-e520-4486-8586-ffefb6891239 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:09.934574 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1115f-e520-4486-8586-ffefb6891239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:09.957443 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-6fe1115f-e520-4486-8586-ffefb6891239 None None] MFA Rules not processed for user `22b6eed9050c416a92681ec1eb7b10b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:09.958422 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-6fe1115f-e520-4486-8586-ffefb6891239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:09.967648 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1380/2740] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:14:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:14:10.317776 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe289c-02ac-4838-bbfb-cf779a02f2cf service nova] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:10.318507 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-54fe289c-02ac-4838-bbfb-cf779a02f2cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:10.375780 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=100 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:10.394203 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe289c-02ac-4838-bbfb-cf779a02f2cf service nova] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:10.400997 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90505fe-881d-4135-a3aa-d72a9c77bf18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:10.406754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90505fe-881d-4135-a3aa-d72a9c77bf18 service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:10.406754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90505fe-881d-4135-a3aa-d72a9c77bf18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:10.406754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90505fe-881d-4135-a3aa-d72a9c77bf18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:10.406754 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-d90505fe-881d-4135-a3aa-d72a9c77bf18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:10.428565 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90505fe-881d-4135-a3aa-d72a9c77bf18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:10.433115 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90505fe-881d-4135-a3aa-d72a9c77bf18 service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:10.453873 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1361/2741] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:14:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:14:14.908589 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1115f-e520-4486-8586-ffefb6891239 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:14.922925 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1115f-e520-4486-8586-ffefb6891239 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:14.928591 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec239f-a541-4420-8150-9daceaa8af9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:14.929239 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec239f-a541-4420-8150-9daceaa8af9c service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:14.929532 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec239f-a541-4420-8150-9daceaa8af9c service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:14.929811 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec239f-a541-4420-8150-9daceaa8af9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:14.931599 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-faec239f-a541-4420-8150-9daceaa8af9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:14.944383 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec239f-a541-4420-8150-9daceaa8af9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:14.946012 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec239f-a541-4420-8150-9daceaa8af9c service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:14.957373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1381/2742] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:14:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:14:15.038530 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90505fe-881d-4135-a3aa-d72a9c77bf18 service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:15.104997 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90505fe-881d-4135-a3aa-d72a9c77bf18 service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:15.109529 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5502367-5b18-4a24-ab25-035dc27be981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:15.110159 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5502367-5b18-4a24-ab25-035dc27be981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:15.110442 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5502367-5b18-4a24-ab25-035dc27be981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:15.110717 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5502367-5b18-4a24-ab25-035dc27be981 admin admin] PATH_INFO: `/v3/users/325fd0a25ded4987a93a17dda2dbbd56` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:15.111862 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5502367-5b18-4a24-ab25-035dc27be981 admin admin] RBAC: Authorizing `identity:delete_user(user_id=325fd0a25ded4987a93a17dda2dbbd56)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:15.113828 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5502367-5b18-4a24-ab25-035dc27be981 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:15.334452 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a5502367-5b18-4a24-ab25-035dc27be981 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '325fd0a25ded4987a93a17dda2dbbd56'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:15.335131 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a5502367-5b18-4a24-ab25-035dc27be981 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '325fd0a25ded4987a93a17dda2dbbd56'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:15.336030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a5502367-5b18-4a24-ab25-035dc27be981 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '325fd0a25ded4987a93a17dda2dbbd56'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:15.404396 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a5502367-5b18-4a24-ab25-035dc27be981 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '325fd0a25ded4987a93a17dda2dbbd56'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:15.412089 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a5502367-5b18-4a24-ab25-035dc27be981 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '325fd0a25ded4987a93a17dda2dbbd56'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:15.431294 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1362/2743] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:14:15 2022] DELETE /identity/v3/users/325fd0a25ded4987a93a17dda2dbbd56 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:14:15.435407 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b415d-336f-4820-899d-1c5871c29671 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:15.435690 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b415d-336f-4820-899d-1c5871c29671 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:15.435962 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b415d-336f-4820-899d-1c5871c29671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:15.455014 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-d57b415d-336f-4820-899d-1c5871c29671 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:15.465899 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-d57b415d-336f-4820-899d-1c5871c29671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:15.514214 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1382/2744] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:14:15.524028 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5502367-5b18-4a24-ab25-035dc27be981 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:15.525465 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-a5502367-5b18-4a24-ab25-035dc27be981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:15.582100 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5502367-5b18-4a24-ab25-035dc27be981 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:15.585749 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9334389-7aee-4a8d-9482-e44ca71c7c93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:15.586347 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9334389-7aee-4a8d-9482-e44ca71c7c93 service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:15.586628 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9334389-7aee-4a8d-9482-e44ca71c7c93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:15.586904 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9334389-7aee-4a8d-9482-e44ca71c7c93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:15.595837 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9334389-7aee-4a8d-9482-e44ca71c7c93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:15.597304 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9334389-7aee-4a8d-9482-e44ca71c7c93 service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:15.606747 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1363/2745] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:14:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:14:16.041541 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b415d-336f-4820-899d-1c5871c29671 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:16.042993 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-d57b415d-336f-4820-899d-1c5871c29671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:16.057244 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b415d-336f-4820-899d-1c5871c29671 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:16.061878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca6a06-826f-4097-9e2f-82d2cc9b73b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:16.062532 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca6a06-826f-4097-9e2f-82d2cc9b73b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:16.062811 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca6a06-826f-4097-9e2f-82d2cc9b73b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:16.063088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca6a06-826f-4097-9e2f-82d2cc9b73b7 admin admin] PATH_INFO: `/v3/projects/323da2b1e52a475fa56c49c22d7ced0d` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:16.064243 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ca6a06-826f-4097-9e2f-82d2cc9b73b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=323da2b1e52a475fa56c49c22d7ced0d)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:16.066204 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ca6a06-826f-4097-9e2f-82d2cc9b73b7 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:16.163085 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f0ca6a06-826f-4097-9e2f-82d2cc9b73b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '323da2b1e52a475fa56c49c22d7ced0d', 'request_id': 'req-f0ca6a06-826f-4097-9e2f-82d2cc9b73b7'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:16.240608 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f0ca6a06-826f-4097-9e2f-82d2cc9b73b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '323da2b1e52a475fa56c49c22d7ced0d', 'request_id': 'req-f0ca6a06-826f-4097-9e2f-82d2cc9b73b7'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:16.247644 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f0ca6a06-826f-4097-9e2f-82d2cc9b73b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '323da2b1e52a475fa56c49c22d7ced0d', 'request_id': 'req-f0ca6a06-826f-4097-9e2f-82d2cc9b73b7'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:16.249801 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:16.260315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f0ca6a06-826f-4097-9e2f-82d2cc9b73b7 admin admin] The token cache is being invalidate because project 323da2b1e52a475fa56c49c22d7ced0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:14:16.260666 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f0ca6a06-826f-4097-9e2f-82d2cc9b73b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:16.261369 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f0ca6a06-826f-4097-9e2f-82d2cc9b73b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:16.262881 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1383/2746] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:14:16 2022] DELETE /identity/v3/projects/323da2b1e52a475fa56c49c22d7ced0d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:14:16.266909 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9334389-7aee-4a8d-9482-e44ca71c7c93 service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:16.272160 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:16.277534 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9334389-7aee-4a8d-9482-e44ca71c7c93 service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:16.335714 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaacdaa-0ec9-46ad-9bf5-9437f49bdd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:16.336346 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaacdaa-0ec9-46ad-9bf5-9437f49bdd96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:16.336648 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaacdaa-0ec9-46ad-9bf5-9437f49bdd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:16.336936 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaacdaa-0ec9-46ad-9bf5-9437f49bdd96 admin admin] PATH_INFO: `/v3/users/c02f455fe4474d448e6a399b5821b4b4` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:16.338047 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaacdaa-0ec9-46ad-9bf5-9437f49bdd96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c02f455fe4474d448e6a399b5821b4b4)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:16.339962 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaacdaa-0ec9-46ad-9bf5-9437f49bdd96 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:16.533526 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-9eaacdaa-0ec9-46ad-9bf5-9437f49bdd96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c02f455fe4474d448e6a399b5821b4b4'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:16.534252 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-9eaacdaa-0ec9-46ad-9bf5-9437f49bdd96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c02f455fe4474d448e6a399b5821b4b4'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:16.534875 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-9eaacdaa-0ec9-46ad-9bf5-9437f49bdd96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c02f455fe4474d448e6a399b5821b4b4'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:16.610993 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-9eaacdaa-0ec9-46ad-9bf5-9437f49bdd96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c02f455fe4474d448e6a399b5821b4b4'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:16.618957 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-9eaacdaa-0ec9-46ad-9bf5-9437f49bdd96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c02f455fe4474d448e6a399b5821b4b4'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:16.638007 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1364/2747] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:14:16 2022] DELETE /identity/v3/users/c02f455fe4474d448e6a399b5821b4b4 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:14:17.075056 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca6a06-826f-4097-9e2f-82d2cc9b73b7 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:17.076508 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-f0ca6a06-826f-4097-9e2f-82d2cc9b73b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:17.089556 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca6a06-826f-4097-9e2f-82d2cc9b73b7 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:17.147360 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab48e40-fdc9-44c1-bb29-80e045b38913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:17.147921 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab48e40-fdc9-44c1-bb29-80e045b38913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:17.148204 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab48e40-fdc9-44c1-bb29-80e045b38913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:17.148481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab48e40-fdc9-44c1-bb29-80e045b38913 admin admin] PATH_INFO: `/v3/projects/bb821bd276e047b1809f991c3e787f4d` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:17.149681 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab48e40-fdc9-44c1-bb29-80e045b38913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb821bd276e047b1809f991c3e787f4d)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:17.151621 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab48e40-fdc9-44c1-bb29-80e045b38913 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:17.278775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-cab48e40-fdc9-44c1-bb29-80e045b38913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb821bd276e047b1809f991c3e787f4d', 'request_id': 'req-cab48e40-fdc9-44c1-bb29-80e045b38913'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:17.353649 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-cab48e40-fdc9-44c1-bb29-80e045b38913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb821bd276e047b1809f991c3e787f4d', 'request_id': 'req-cab48e40-fdc9-44c1-bb29-80e045b38913'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:17.360574 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-cab48e40-fdc9-44c1-bb29-80e045b38913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb821bd276e047b1809f991c3e787f4d', 'request_id': 'req-cab48e40-fdc9-44c1-bb29-80e045b38913'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:17.372170 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-cab48e40-fdc9-44c1-bb29-80e045b38913 admin admin] The token cache is being invalidate because project bb821bd276e047b1809f991c3e787f4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:14:17.372456 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-cab48e40-fdc9-44c1-bb29-80e045b38913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:17.373110 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-cab48e40-fdc9-44c1-bb29-80e045b38913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:17.374591 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1384/2748] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:14:17 2022] DELETE /identity/v3/projects/bb821bd276e047b1809f991c3e787f4d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:14:17.379447 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136d400-12b8-4295-ae7e-7eb484df3e32 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:17.379942 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136d400-12b8-4295-ae7e-7eb484df3e32 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:17.380219 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136d400-12b8-4295-ae7e-7eb484df3e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:17.399958 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-f136d400-12b8-4295-ae7e-7eb484df3e32 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:17.401139 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-f136d400-12b8-4295-ae7e-7eb484df3e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:17.460004 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1365/2749] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:14:17.467768 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f33c27-8d84-49a6-94a5-bbe6ab404dc9 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:17.468052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f33c27-8d84-49a6-94a5-bbe6ab404dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:17.472334 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f33c27-8d84-49a6-94a5-bbe6ab404dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:17.489810 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-c1f33c27-8d84-49a6-94a5-bbe6ab404dc9 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:17.491138 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-c1f33c27-8d84-49a6-94a5-bbe6ab404dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:17.498988 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1385/2750] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:14:17.503170 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136d400-12b8-4295-ae7e-7eb484df3e32 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:17.522242 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136d400-12b8-4295-ae7e-7eb484df3e32 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:17.527092 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877c634-db98-4a7d-894a-2a341e39cd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:17.527785 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877c634-db98-4a7d-894a-2a341e39cd8e admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:17.528139 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877c634-db98-4a7d-894a-2a341e39cd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:17.528505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877c634-db98-4a7d-894a-2a341e39cd8e admin admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:17.529262 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4877c634-db98-4a7d-894a-2a341e39cd8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:14:17.529727 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4877c634-db98-4a7d-894a-2a341e39cd8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:17.531356 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4877c634-db98-4a7d-894a-2a341e39cd8e admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:17.544899 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1366/2751] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:14:17.549481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f33c27-8d84-49a6-94a5-bbe6ab404dc9 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:17.560057 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f33c27-8d84-49a6-94a5-bbe6ab404dc9 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:17.564880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cf018-5fb6-4a31-bf88-1c2abf610992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:17.565488 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cf018-5fb6-4a31-bf88-1c2abf610992 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:17.565768 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cf018-5fb6-4a31-bf88-1c2abf610992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:17.566038 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cf018-5fb6-4a31-bf88-1c2abf610992 admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:17.566673 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62cf018-5fb6-4a31-bf88-1c2abf610992 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:17.568602 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62cf018-5fb6-4a31-bf88-1c2abf610992 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:17.656731 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1386/2752] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:14:17 2022] POST /identity/v3/projects => generated 363 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:14:17.657818 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877c634-db98-4a7d-894a-2a341e39cd8e admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:17.668821 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877c634-db98-4a7d-894a-2a341e39cd8e admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:17.673728 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:17.728176 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105ec43-5036-434c-af30-deaedb374c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:17.728822 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105ec43-5036-434c-af30-deaedb374c22 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:17.729101 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105ec43-5036-434c-af30-deaedb374c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:17.729372 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105ec43-5036-434c-af30-deaedb374c22 admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:17.730038 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105ec43-5036-434c-af30-deaedb374c22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:17.731947 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105ec43-5036-434c-af30-deaedb374c22 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:17.832137 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1367/2753] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:14:17 2022] POST /identity/v3/users => generated 282 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:14:17.833932 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cf018-5fb6-4a31-bf88-1c2abf610992 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:17.844385 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cf018-5fb6-4a31-bf88-1c2abf610992 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:17.849444 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6578c0d-6be1-42da-8da4-47d84f430896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:17.856127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6578c0d-6be1-42da-8da4-47d84f430896 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:17.856127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6578c0d-6be1-42da-8da4-47d84f430896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:17.856127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6578c0d-6be1-42da-8da4-47d84f430896 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:17.856127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6578c0d-6be1-42da-8da4-47d84f430896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:17.856127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6578c0d-6be1-42da-8da4-47d84f430896 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:17.863780 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1387/2754] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:14:17.868595 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105ec43-5036-434c-af30-deaedb374c22 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:17.879058 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105ec43-5036-434c-af30-deaedb374c22 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:17.885265 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86dbecd-4020-4d49-8edc-936194c09a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:17.885939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86dbecd-4020-4d49-8edc-936194c09a28 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:17.886362 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86dbecd-4020-4d49-8edc-936194c09a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:17.886647 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86dbecd-4020-4d49-8edc-936194c09a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:17.887294 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86dbecd-4020-4d49-8edc-936194c09a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:17.888951 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86dbecd-4020-4d49-8edc-936194c09a28 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:17.899574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1368/2755] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:14:17.903753 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6578c0d-6be1-42da-8da4-47d84f430896 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:17.914493 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6578c0d-6be1-42da-8da4-47d84f430896 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:17.919085 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d8638-41f4-4665-a7ec-3feb9adcd5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:17.919748 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d8638-41f4-4665-a7ec-3feb9adcd5e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:17.920025 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d8638-41f4-4665-a7ec-3feb9adcd5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:17.920300 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d8638-41f4-4665-a7ec-3feb9adcd5e2 admin admin] PATH_INFO: `/v3/projects/37d397fa1b7e4db98384b4b770636592/users/833c52f991334df9b07a5600894b071d/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:17.937130 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d8638-41f4-4665-a7ec-3feb9adcd5e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37d397fa1b7e4db98384b4b770636592, user_id=833c52f991334df9b07a5600894b071d, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:17.939826 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d8638-41f4-4665-a7ec-3feb9adcd5e2 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:18.006514 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1388/2756] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:14:17 2022] PUT /identity/v3/projects/37d397fa1b7e4db98384b4b770636592/users/833c52f991334df9b07a5600894b071d/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:14:18.016726 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4481c0d-0c47-45be-b961-092e0c351db6 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:18.017055 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4481c0d-0c47-45be-b961-092e0c351db6 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:18.017299 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4481c0d-0c47-45be-b961-092e0c351db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:18.052841 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-b4481c0d-0c47-45be-b961-092e0c351db6 None None] MFA Rules not processed for user `833c52f991334df9b07a5600894b071d`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:18.054285 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-b4481c0d-0c47-45be-b961-092e0c351db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:18.135000 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1369/2757] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:14:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:14:18.139374 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d8638-41f4-4665-a7ec-3feb9adcd5e2 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:18.160863 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:18.205926 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d8638-41f4-4665-a7ec-3feb9adcd5e2 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:18.210937 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd79ac-34bd-41ec-842d-ef22b30046d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:18.211543 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd79ac-34bd-41ec-842d-ef22b30046d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:18.211825 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd79ac-34bd-41ec-842d-ef22b30046d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:18.212098 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd79ac-34bd-41ec-842d-ef22b30046d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:18.212801 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd79ac-34bd-41ec-842d-ef22b30046d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:18.214693 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd79ac-34bd-41ec-842d-ef22b30046d5 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:18.338794 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1389/2758] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:14:18 2022] POST /identity/v3/projects => generated 363 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:14:18.342825 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4481c0d-0c47-45be-b961-092e0c351db6 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:18.354210 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4481c0d-0c47-45be-b961-092e0c351db6 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:18.409932 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f561a69-bd29-4bd5-b378-28086ce82f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:18.410614 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f561a69-bd29-4bd5-b378-28086ce82f28 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:18.410858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f561a69-bd29-4bd5-b378-28086ce82f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:18.411807 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f561a69-bd29-4bd5-b378-28086ce82f28 admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:18.412575 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f561a69-bd29-4bd5-b378-28086ce82f28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:18.414705 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f561a69-bd29-4bd5-b378-28086ce82f28 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:18.492240 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1370/2759] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:14:18 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:14:18.495626 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd79ac-34bd-41ec-842d-ef22b30046d5 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:18.506222 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd79ac-34bd-41ec-842d-ef22b30046d5 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:18.511124 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd37ad-55b2-47f3-890f-8a5179efbff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:18.511716 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd37ad-55b2-47f3-890f-8a5179efbff9 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:18.511996 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd37ad-55b2-47f3-890f-8a5179efbff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:18.512267 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd37ad-55b2-47f3-890f-8a5179efbff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:18.512946 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd37ad-55b2-47f3-890f-8a5179efbff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:18.514540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd37ad-55b2-47f3-890f-8a5179efbff9 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:18.525830 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1390/2760] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:14:18.529864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f561a69-bd29-4bd5-b378-28086ce82f28 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:18.540741 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f561a69-bd29-4bd5-b378-28086ce82f28 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:18.545614 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb7437-0084-4ffc-bf00-0416bef30b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:18.546476 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb7437-0084-4ffc-bf00-0416bef30b84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:18.546762 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb7437-0084-4ffc-bf00-0416bef30b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:18.547038 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb7437-0084-4ffc-bf00-0416bef30b84 admin admin] PATH_INFO: `/v3/projects/a3dfaa5341554313aeefa382f918dce1/users/49a556ce4938421e85f0f12a3007124e/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:18.549454 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:18.563622 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb7437-0084-4ffc-bf00-0416bef30b84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3dfaa5341554313aeefa382f918dce1, user_id=49a556ce4938421e85f0f12a3007124e, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:18.566418 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb7437-0084-4ffc-bf00-0416bef30b84 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:18.646228 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1371/2761] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:14:18 2022] PUT /identity/v3/projects/a3dfaa5341554313aeefa382f918dce1/users/49a556ce4938421e85f0f12a3007124e/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:14:18.650801 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd37ad-55b2-47f3-890f-8a5179efbff9 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:18.661229 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd37ad-55b2-47f3-890f-8a5179efbff9 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:18.718248 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09257c7-ac3f-416f-a9a5-4125b2648bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:18.718859 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09257c7-ac3f-416f-a9a5-4125b2648bbc admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:18.719141 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09257c7-ac3f-416f-a9a5-4125b2648bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:18.719412 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09257c7-ac3f-416f-a9a5-4125b2648bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:18.720052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09257c7-ac3f-416f-a9a5-4125b2648bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:18.721680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09257c7-ac3f-416f-a9a5-4125b2648bbc admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:18.731362 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1391/2762] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:14:18.735571 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb7437-0084-4ffc-bf00-0416bef30b84 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:18.746995 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb7437-0084-4ffc-bf00-0416bef30b84 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:18.751555 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd35f6e-babf-4204-a5d3-430e479be2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:18.752205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd35f6e-babf-4204-a5d3-430e479be2c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:18.752483 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd35f6e-babf-4204-a5d3-430e479be2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:18.752787 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd35f6e-babf-4204-a5d3-430e479be2c0 admin admin] PATH_INFO: `/v3/projects/a3dfaa5341554313aeefa382f918dce1/users/49a556ce4938421e85f0f12a3007124e/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:18.754690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd35f6e-babf-4204-a5d3-430e479be2c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3dfaa5341554313aeefa382f918dce1, user_id=49a556ce4938421e85f0f12a3007124e, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:18.757981 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd35f6e-babf-4204-a5d3-430e479be2c0 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:18.768234 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1372/2763] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:14:18 2022] PUT /identity/v3/projects/a3dfaa5341554313aeefa382f918dce1/users/49a556ce4938421e85f0f12a3007124e/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:14:18.779268 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298b922-665b-463b-ab49-23d544d3604e None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:18.779558 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298b922-665b-463b-ab49-23d544d3604e None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:18.779833 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298b922-665b-463b-ab49-23d544d3604e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:18.808500 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-0298b922-665b-463b-ab49-23d544d3604e None None] MFA Rules not processed for user `49a556ce4938421e85f0f12a3007124e`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:18.809739 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-0298b922-665b-463b-ab49-23d544d3604e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:18.879117 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1392/2764] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:14:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:14:18.891461 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd35f6e-babf-4204-a5d3-430e479be2c0 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:18.893183 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-8fd35f6e-babf-4204-a5d3-430e479be2c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:18.952897 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd35f6e-babf-4204-a5d3-430e479be2c0 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:18.956508 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96b115-2999-4e34-9f7b-91109d3464f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:18.957126 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96b115-2999-4e34-9f7b-91109d3464f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:18.957405 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96b115-2999-4e34-9f7b-91109d3464f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:18.957673 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96b115-2999-4e34-9f7b-91109d3464f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:18.966780 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96b115-2999-4e34-9f7b-91109d3464f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:18.968284 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96b115-2999-4e34-9f7b-91109d3464f5 service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:18.978588 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1373/2765] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:14:18 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:14:19.242956 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298b922-665b-463b-ab49-23d544d3604e None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:19.253312 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298b922-665b-463b-ab49-23d544d3604e None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:19.257084 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a1926-1acc-481b-95af-b0aa32277089 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:19.259701 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a1926-1acc-481b-95af-b0aa32277089 service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:19.259701 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a1926-1acc-481b-95af-b0aa32277089 service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:19.259701 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a1926-1acc-481b-95af-b0aa32277089 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:19.269045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:19.320408 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a1926-1acc-481b-95af-b0aa32277089 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:19.321895 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a1926-1acc-481b-95af-b0aa32277089 service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:19.331556 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1393/2766] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:14:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:14:22.730420 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96b115-2999-4e34-9f7b-91109d3464f5 service cinder] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:22.797040 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96b115-2999-4e34-9f7b-91109d3464f5 service cinder] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:22.801670 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2af245-7ab6-4e49-b5c9-1d05fccf1597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:22.802335 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2af245-7ab6-4e49-b5c9-1d05fccf1597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:22.802617 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2af245-7ab6-4e49-b5c9-1d05fccf1597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:22.802888 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2af245-7ab6-4e49-b5c9-1d05fccf1597 admin admin] PATH_INFO: `/v3/users/833c52f991334df9b07a5600894b071d` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:22.804091 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2af245-7ab6-4e49-b5c9-1d05fccf1597 admin admin] RBAC: Authorizing `identity:delete_user(user_id=833c52f991334df9b07a5600894b071d)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:22.806050 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2af245-7ab6-4e49-b5c9-1d05fccf1597 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:22.983828 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0b2af245-7ab6-4e49-b5c9-1d05fccf1597 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '833c52f991334df9b07a5600894b071d'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:22.984478 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0b2af245-7ab6-4e49-b5c9-1d05fccf1597 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '833c52f991334df9b07a5600894b071d'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:22.985117 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0b2af245-7ab6-4e49-b5c9-1d05fccf1597 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '833c52f991334df9b07a5600894b071d'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:23.045686 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0b2af245-7ab6-4e49-b5c9-1d05fccf1597 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '833c52f991334df9b07a5600894b071d'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:23.053454 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0b2af245-7ab6-4e49-b5c9-1d05fccf1597 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '833c52f991334df9b07a5600894b071d'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:23.061315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:23.070972 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1374/2767] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:14:22 2022] DELETE /identity/v3/users/833c52f991334df9b07a5600894b071d => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:14:23.075467 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c828b-7833-4cdc-b1d8-af3cce948c2f None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:23.075942 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c828b-7833-4cdc-b1d8-af3cce948c2f None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:23.076041 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c828b-7833-4cdc-b1d8-af3cce948c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:23.096212 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-2f5c828b-7833-4cdc-b1d8-af3cce948c2f None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:23.097448 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-2f5c828b-7833-4cdc-b1d8-af3cce948c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:23.159484 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1394/2768] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:14:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:14:23.170217 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2af245-7ab6-4e49-b5c9-1d05fccf1597 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:23.171782 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-0b2af245-7ab6-4e49-b5c9-1d05fccf1597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:23.233262 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2af245-7ab6-4e49-b5c9-1d05fccf1597 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:23.236973 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d7d28-f5a7-4f8a-9313-66d5506f213b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:23.237580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d7d28-f5a7-4f8a-9313-66d5506f213b service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:23.237861 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d7d28-f5a7-4f8a-9313-66d5506f213b service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:23.238133 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d7d28-f5a7-4f8a-9313-66d5506f213b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:23.247439 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d7d28-f5a7-4f8a-9313-66d5506f213b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:23.248915 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d7d28-f5a7-4f8a-9313-66d5506f213b service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:23.258875 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1375/2769] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:14:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:14:23.682443 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c828b-7833-4cdc-b1d8-af3cce948c2f None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:23.683911 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-2f5c828b-7833-4cdc-b1d8-af3cce948c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:23.698472 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c828b-7833-4cdc-b1d8-af3cce948c2f None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:23.713182 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f5206-496c-47a4-9d87-5be32a04cb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:23.713837 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f5206-496c-47a4-9d87-5be32a04cb00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:23.714119 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f5206-496c-47a4-9d87-5be32a04cb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:23.714492 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f5206-496c-47a4-9d87-5be32a04cb00 admin admin] PATH_INFO: `/v3/projects/37d397fa1b7e4db98384b4b770636592` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:23.715569 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f5206-496c-47a4-9d87-5be32a04cb00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37d397fa1b7e4db98384b4b770636592)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:23.717655 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f5206-496c-47a4-9d87-5be32a04cb00 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:23.836256 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-860f5206-496c-47a4-9d87-5be32a04cb00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37d397fa1b7e4db98384b4b770636592', 'request_id': 'req-860f5206-496c-47a4-9d87-5be32a04cb00'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:23.919768 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-860f5206-496c-47a4-9d87-5be32a04cb00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37d397fa1b7e4db98384b4b770636592', 'request_id': 'req-860f5206-496c-47a4-9d87-5be32a04cb00'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:23.927767 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-860f5206-496c-47a4-9d87-5be32a04cb00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37d397fa1b7e4db98384b4b770636592', 'request_id': 'req-860f5206-496c-47a4-9d87-5be32a04cb00'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:23.940137 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-860f5206-496c-47a4-9d87-5be32a04cb00 admin admin] The token cache is being invalidate because project 37d397fa1b7e4db98384b4b770636592 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:14:23.940432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-860f5206-496c-47a4-9d87-5be32a04cb00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:23.941170 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-860f5206-496c-47a4-9d87-5be32a04cb00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:23.943349 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1395/2770] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:14:23 2022] DELETE /identity/v3/projects/37d397fa1b7e4db98384b4b770636592 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:14:23.947488 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d7d28-f5a7-4f8a-9313-66d5506f213b service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:23.957600 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d7d28-f5a7-4f8a-9313-66d5506f213b service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:24.023467 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62e6ab-4cd3-423f-bdc8-16a40581e641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:24.024233 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62e6ab-4cd3-423f-bdc8-16a40581e641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:24.024609 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62e6ab-4cd3-423f-bdc8-16a40581e641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:24.025005 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62e6ab-4cd3-423f-bdc8-16a40581e641 admin admin] PATH_INFO: `/v3/users/49a556ce4938421e85f0f12a3007124e` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:24.026319 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62e6ab-4cd3-423f-bdc8-16a40581e641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49a556ce4938421e85f0f12a3007124e)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:24.028455 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62e6ab-4cd3-423f-bdc8-16a40581e641 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:24.232872 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-2c62e6ab-4cd3-423f-bdc8-16a40581e641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49a556ce4938421e85f0f12a3007124e'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:24.233601 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-2c62e6ab-4cd3-423f-bdc8-16a40581e641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49a556ce4938421e85f0f12a3007124e'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:24.234344 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-2c62e6ab-4cd3-423f-bdc8-16a40581e641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49a556ce4938421e85f0f12a3007124e'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:24.318709 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-2c62e6ab-4cd3-423f-bdc8-16a40581e641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49a556ce4938421e85f0f12a3007124e'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:24.326653 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-2c62e6ab-4cd3-423f-bdc8-16a40581e641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49a556ce4938421e85f0f12a3007124e'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:24.350850 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1376/2771] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:14:23 2022] DELETE /identity/v3/users/49a556ce4938421e85f0f12a3007124e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:14:24.819652 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f5206-496c-47a4-9d87-5be32a04cb00 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:24.821207 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-860f5206-496c-47a4-9d87-5be32a04cb00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:24.840589 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f5206-496c-47a4-9d87-5be32a04cb00 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:24.886420 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:24.913769 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841d4b8-111d-4855-8375-1587e284719b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:24.914430 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841d4b8-111d-4855-8375-1587e284719b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:24.914724 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841d4b8-111d-4855-8375-1587e284719b admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:24.914980 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841d4b8-111d-4855-8375-1587e284719b admin admin] PATH_INFO: `/v3/projects/a3dfaa5341554313aeefa382f918dce1` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:24.916202 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d841d4b8-111d-4855-8375-1587e284719b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3dfaa5341554313aeefa382f918dce1)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:24.918220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d841d4b8-111d-4855-8375-1587e284719b admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:25.047268 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d841d4b8-111d-4855-8375-1587e284719b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3dfaa5341554313aeefa382f918dce1', 'request_id': 'req-d841d4b8-111d-4855-8375-1587e284719b'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:25.091081 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d841d4b8-111d-4855-8375-1587e284719b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3dfaa5341554313aeefa382f918dce1', 'request_id': 'req-d841d4b8-111d-4855-8375-1587e284719b'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:25.097903 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d841d4b8-111d-4855-8375-1587e284719b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3dfaa5341554313aeefa382f918dce1', 'request_id': 'req-d841d4b8-111d-4855-8375-1587e284719b'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:25.109688 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d841d4b8-111d-4855-8375-1587e284719b admin admin] The token cache is being invalidate because project a3dfaa5341554313aeefa382f918dce1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:14:25.110002 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d841d4b8-111d-4855-8375-1587e284719b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:25.110659 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-d841d4b8-111d-4855-8375-1587e284719b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:25.112160 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1396/2772] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:14:24 2022] DELETE /identity/v3/projects/a3dfaa5341554313aeefa382f918dce1 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:14:25.118039 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba6fc7-a526-4dc1-9643-278c47b70dd4 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:25.118524 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba6fc7-a526-4dc1-9643-278c47b70dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:25.118622 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba6fc7-a526-4dc1-9643-278c47b70dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:25.138512 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-a3ba6fc7-a526-4dc1-9643-278c47b70dd4 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:25.139721 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-a3ba6fc7-a526-4dc1-9643-278c47b70dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:25.150023 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:25.204386 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1377/2773] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:14:25.212934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab516d6-978f-4cd3-98e2-1f898fe2cce0 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:25.213713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab516d6-978f-4cd3-98e2-1f898fe2cce0 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:25.213713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab516d6-978f-4cd3-98e2-1f898fe2cce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:25.233219 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-eab516d6-978f-4cd3-98e2-1f898fe2cce0 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:25.234430 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-eab516d6-978f-4cd3-98e2-1f898fe2cce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:25.243122 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1397/2774] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:14:25.247531 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba6fc7-a526-4dc1-9643-278c47b70dd4 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:25.258145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba6fc7-a526-4dc1-9643-278c47b70dd4 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:25.263125 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f401a-5adf-452f-b8fd-30f124970c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:25.263705 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f401a-5adf-452f-b8fd-30f124970c07 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:25.263986 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f401a-5adf-452f-b8fd-30f124970c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:25.264947 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f401a-5adf-452f-b8fd-30f124970c07 admin admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:25.264947 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f401a-5adf-452f-b8fd-30f124970c07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:14:25.265217 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f401a-5adf-452f-b8fd-30f124970c07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:25.266798 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f401a-5adf-452f-b8fd-30f124970c07 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:25.278927 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1378/2775] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:14:25.283492 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab516d6-978f-4cd3-98e2-1f898fe2cce0 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:25.293180 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab516d6-978f-4cd3-98e2-1f898fe2cce0 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:25.298188 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65512ffd-51ff-453c-a7cc-93da52c1064b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:25.298823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65512ffd-51ff-453c-a7cc-93da52c1064b admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:25.299104 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65512ffd-51ff-453c-a7cc-93da52c1064b admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:25.299375 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65512ffd-51ff-453c-a7cc-93da52c1064b admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:25.300003 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65512ffd-51ff-453c-a7cc-93da52c1064b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:25.302524 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65512ffd-51ff-453c-a7cc-93da52c1064b admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:25.399980 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1398/2776] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:14:25 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:14:25.410433 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f401a-5adf-452f-b8fd-30f124970c07 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:25.421147 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f401a-5adf-452f-b8fd-30f124970c07 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:25.476583 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29c43f-87b6-4f76-9d48-390fea3557fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:25.477205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29c43f-87b6-4f76-9d48-390fea3557fd admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:25.477486 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29c43f-87b6-4f76-9d48-390fea3557fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:25.477758 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29c43f-87b6-4f76-9d48-390fea3557fd admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:25.478375 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29c43f-87b6-4f76-9d48-390fea3557fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:25.480327 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29c43f-87b6-4f76-9d48-390fea3557fd admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:25.594201 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1379/2777] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:14:25 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:14:25.598248 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65512ffd-51ff-453c-a7cc-93da52c1064b admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:25.609781 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65512ffd-51ff-453c-a7cc-93da52c1064b admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:25.615125 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df621646-b98e-4934-ae0a-58dbdbc93131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:25.615723 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df621646-b98e-4934-ae0a-58dbdbc93131 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:25.616007 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df621646-b98e-4934-ae0a-58dbdbc93131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:25.616275 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df621646-b98e-4934-ae0a-58dbdbc93131 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:25.616964 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df621646-b98e-4934-ae0a-58dbdbc93131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:25.622567 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df621646-b98e-4934-ae0a-58dbdbc93131 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:25.628275 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1399/2778] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:14:25.632394 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29c43f-87b6-4f76-9d48-390fea3557fd admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:25.642649 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29c43f-87b6-4f76-9d48-390fea3557fd admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:25.647365 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca993fe-29ca-4b5b-8b4f-98ffb8e10ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:25.647983 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca993fe-29ca-4b5b-8b4f-98ffb8e10ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:25.648264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca993fe-29ca-4b5b-8b4f-98ffb8e10ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:25.648537 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca993fe-29ca-4b5b-8b4f-98ffb8e10ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:25.649216 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca993fe-29ca-4b5b-8b4f-98ffb8e10ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:25.650800 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca993fe-29ca-4b5b-8b4f-98ffb8e10ff5 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:25.662698 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1380/2779] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:14:25.666009 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df621646-b98e-4934-ae0a-58dbdbc93131 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:25.676130 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df621646-b98e-4934-ae0a-58dbdbc93131 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:25.681571 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cfef1-7f88-4775-bf2d-7998343e11e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:25.682208 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cfef1-7f88-4775-bf2d-7998343e11e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:25.682484 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cfef1-7f88-4775-bf2d-7998343e11e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:25.682753 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cfef1-7f88-4775-bf2d-7998343e11e7 admin admin] PATH_INFO: `/v3/projects/b84692ec1f254131861d644cd2fcecd6/users/8788faa73b8b423eb34b0da3a79cfbe5/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:25.697240 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cfef1-7f88-4775-bf2d-7998343e11e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b84692ec1f254131861d644cd2fcecd6, user_id=8788faa73b8b423eb34b0da3a79cfbe5, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:25.699867 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cfef1-7f88-4775-bf2d-7998343e11e7 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:25.769964 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1400/2780] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:14:25 2022] PUT /identity/v3/projects/b84692ec1f254131861d644cd2fcecd6/users/8788faa73b8b423eb34b0da3a79cfbe5/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:14:25.780266 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aeef48-4a53-4d04-8e68-73709ab30f2d None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:25.780585 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aeef48-4a53-4d04-8e68-73709ab30f2d None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:25.780944 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aeef48-4a53-4d04-8e68-73709ab30f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:25.809407 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-20aeef48-4a53-4d04-8e68-73709ab30f2d None None] MFA Rules not processed for user `8788faa73b8b423eb34b0da3a79cfbe5`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:25.810620 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-20aeef48-4a53-4d04-8e68-73709ab30f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:25.877791 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1381/2781] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:14:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:14:25.882709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cfef1-7f88-4775-bf2d-7998343e11e7 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:25.945652 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cfef1-7f88-4775-bf2d-7998343e11e7 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:25.950377 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bc1d5-a24d-43b1-9a56-3d7ab03a43bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:25.950976 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bc1d5-a24d-43b1-9a56-3d7ab03a43bc admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:25.951253 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bc1d5-a24d-43b1-9a56-3d7ab03a43bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:25.951524 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bc1d5-a24d-43b1-9a56-3d7ab03a43bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:25.952152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bc1d5-a24d-43b1-9a56-3d7ab03a43bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:25.954071 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bc1d5-a24d-43b1-9a56-3d7ab03a43bc admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:25.959813 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:26.062326 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1401/2782] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:14:25 2022] POST /identity/v3/projects => generated 387 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:14:26.066516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aeef48-4a53-4d04-8e68-73709ab30f2d None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:26.077460 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aeef48-4a53-4d04-8e68-73709ab30f2d None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:26.082126 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:26.134768 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187ee89-9bdb-4a8d-982a-79bf9d8cd448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:26.135554 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187ee89-9bdb-4a8d-982a-79bf9d8cd448 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:26.136089 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187ee89-9bdb-4a8d-982a-79bf9d8cd448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:26.136821 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187ee89-9bdb-4a8d-982a-79bf9d8cd448 admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:26.137517 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e187ee89-9bdb-4a8d-982a-79bf9d8cd448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:26.141963 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e187ee89-9bdb-4a8d-982a-79bf9d8cd448 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:26.232578 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1382/2783] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:14:26 2022] POST /identity/v3/users => generated 300 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:14:26.236521 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bc1d5-a24d-43b1-9a56-3d7ab03a43bc admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:26.247285 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bc1d5-a24d-43b1-9a56-3d7ab03a43bc admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:26.252146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7b256-bddc-40b8-9bd1-fb129b630c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:26.252775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7b256-bddc-40b8-9bd1-fb129b630c24 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:26.253058 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7b256-bddc-40b8-9bd1-fb129b630c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:26.253332 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7b256-bddc-40b8-9bd1-fb129b630c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:26.253979 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7b256-bddc-40b8-9bd1-fb129b630c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:26.255908 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7b256-bddc-40b8-9bd1-fb129b630c24 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:26.266109 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1402/2784] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:14:26.270301 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187ee89-9bdb-4a8d-982a-79bf9d8cd448 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:26.280960 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187ee89-9bdb-4a8d-982a-79bf9d8cd448 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:26.285424 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad20352-cc83-43c1-a246-b7cb28f4cee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:26.286738 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad20352-cc83-43c1-a246-b7cb28f4cee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:26.287256 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad20352-cc83-43c1-a246-b7cb28f4cee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:26.287611 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad20352-cc83-43c1-a246-b7cb28f4cee4 admin admin] PATH_INFO: `/v3/projects/57aaef9a1e7f4190b6717d68dca3adb2/users/f82dad07834540ef841c7e11c5438f31/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:26.303939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad20352-cc83-43c1-a246-b7cb28f4cee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57aaef9a1e7f4190b6717d68dca3adb2, user_id=f82dad07834540ef841c7e11c5438f31, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:26.306577 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad20352-cc83-43c1-a246-b7cb28f4cee4 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:26.376528 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1383/2785] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:14:26 2022] PUT /identity/v3/projects/57aaef9a1e7f4190b6717d68dca3adb2/users/f82dad07834540ef841c7e11c5438f31/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:14:26.380997 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7b256-bddc-40b8-9bd1-fb129b630c24 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:26.391483 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7b256-bddc-40b8-9bd1-fb129b630c24 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:26.447769 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab155ea-4ec4-4f1c-a892-5f3be595ff19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:26.448383 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab155ea-4ec4-4f1c-a892-5f3be595ff19 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:26.448694 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab155ea-4ec4-4f1c-a892-5f3be595ff19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:26.448972 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab155ea-4ec4-4f1c-a892-5f3be595ff19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:26.449615 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab155ea-4ec4-4f1c-a892-5f3be595ff19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:26.451211 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab155ea-4ec4-4f1c-a892-5f3be595ff19 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:26.461703 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1403/2786] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:14:26.471315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad20352-cc83-43c1-a246-b7cb28f4cee4 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:26.482106 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad20352-cc83-43c1-a246-b7cb28f4cee4 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:26.486820 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628d749-3cf4-44f9-b08e-a1205509e5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:26.487407 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628d749-3cf4-44f9-b08e-a1205509e5a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:26.487680 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628d749-3cf4-44f9-b08e-a1205509e5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:26.487948 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628d749-3cf4-44f9-b08e-a1205509e5a9 admin admin] PATH_INFO: `/v3/projects/57aaef9a1e7f4190b6717d68dca3adb2/users/f82dad07834540ef841c7e11c5438f31/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:26.490151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628d749-3cf4-44f9-b08e-a1205509e5a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57aaef9a1e7f4190b6717d68dca3adb2, user_id=f82dad07834540ef841c7e11c5438f31, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:26.492783 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628d749-3cf4-44f9-b08e-a1205509e5a9 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:26.502789 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1384/2787] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:14:26 2022] PUT /identity/v3/projects/57aaef9a1e7f4190b6717d68dca3adb2/users/f82dad07834540ef841c7e11c5438f31/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:14:26.514725 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0f7f2-52a6-4391-b8f6-33c3b345d19b None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:26.515017 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0f7f2-52a6-4391-b8f6-33c3b345d19b None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:26.515297 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0f7f2-52a6-4391-b8f6-33c3b345d19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:26.543505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-faa0f7f2-52a6-4391-b8f6-33c3b345d19b None None] MFA Rules not processed for user `f82dad07834540ef841c7e11c5438f31`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:26.544753 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-faa0f7f2-52a6-4391-b8f6-33c3b345d19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:26.612074 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1404/2788] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:14:26 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:14:26.622899 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628d749-3cf4-44f9-b08e-a1205509e5a9 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:26.624703 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-6628d749-3cf4-44f9-b08e-a1205509e5a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:26.682590 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628d749-3cf4-44f9-b08e-a1205509e5a9 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:26.686231 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208df699-8b66-4dc7-932b-acd6b95f02bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:26.686823 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208df699-8b66-4dc7-932b-acd6b95f02bc service cinder] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:26.687101 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208df699-8b66-4dc7-932b-acd6b95f02bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:26.687374 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208df699-8b66-4dc7-932b-acd6b95f02bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:26.696944 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208df699-8b66-4dc7-932b-acd6b95f02bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:26.698398 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208df699-8b66-4dc7-932b-acd6b95f02bc service cinder] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:26.707702 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1385/2789] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:14:26 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:14:26.841911 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0f7f2-52a6-4391-b8f6-33c3b345d19b None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:26.900427 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:26.904442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0f7f2-52a6-4391-b8f6-33c3b345d19b None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:26.908971 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f6642-01b3-4cf1-85fc-15e39680c61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:26.915578 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f6642-01b3-4cf1-85fc-15e39680c61f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:26.915578 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f6642-01b3-4cf1-85fc-15e39680c61f admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:26.915578 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f6642-01b3-4cf1-85fc-15e39680c61f admin admin] PATH_INFO: `/v3/users/8788faa73b8b423eb34b0da3a79cfbe5` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:26.915578 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f6642-01b3-4cf1-85fc-15e39680c61f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8788faa73b8b423eb34b0da3a79cfbe5)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:26.915578 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f6642-01b3-4cf1-85fc-15e39680c61f admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:27.103558 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-067f6642-01b3-4cf1-85fc-15e39680c61f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8788faa73b8b423eb34b0da3a79cfbe5'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:27.104219 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-067f6642-01b3-4cf1-85fc-15e39680c61f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8788faa73b8b423eb34b0da3a79cfbe5'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:27.104851 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-067f6642-01b3-4cf1-85fc-15e39680c61f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8788faa73b8b423eb34b0da3a79cfbe5'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:27.117433 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-067f6642-01b3-4cf1-85fc-15e39680c61f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8788faa73b8b423eb34b0da3a79cfbe5'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:27.182510 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-067f6642-01b3-4cf1-85fc-15e39680c61f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8788faa73b8b423eb34b0da3a79cfbe5'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:27.195535 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1405/2790] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:14:26 2022] DELETE /identity/v3/users/8788faa73b8b423eb34b0da3a79cfbe5 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:14:27.200100 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367cd2c-f216-4a17-a25c-3e1d2637f8cf None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:27.200573 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367cd2c-f216-4a17-a25c-3e1d2637f8cf None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:27.200690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367cd2c-f216-4a17-a25c-3e1d2637f8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:27.219269 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-7367cd2c-f216-4a17-a25c-3e1d2637f8cf None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:27.220472 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-7367cd2c-f216-4a17-a25c-3e1d2637f8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:27.279804 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1386/2791] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:14:27.290917 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f6642-01b3-4cf1-85fc-15e39680c61f admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:27.292410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-067f6642-01b3-4cf1-85fc-15e39680c61f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:27.351118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f6642-01b3-4cf1-85fc-15e39680c61f admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:27.354701 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94019636-0956-41d1-80a8-44ed17e0e85c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:27.355326 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94019636-0956-41d1-80a8-44ed17e0e85c service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:27.355607 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94019636-0956-41d1-80a8-44ed17e0e85c service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:27.355878 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94019636-0956-41d1-80a8-44ed17e0e85c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:27.365626 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94019636-0956-41d1-80a8-44ed17e0e85c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:27.367049 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94019636-0956-41d1-80a8-44ed17e0e85c service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:27.376519 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1406/2792] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:14:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:14:27.796078 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367cd2c-f216-4a17-a25c-3e1d2637f8cf None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:27.797688 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-7367cd2c-f216-4a17-a25c-3e1d2637f8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:27.810784 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:27.819752 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367cd2c-f216-4a17-a25c-3e1d2637f8cf None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:27.824984 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4399b1-3d9e-472d-9c9c-c3b3e20afe1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:27.826094 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4399b1-3d9e-472d-9c9c-c3b3e20afe1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:27.826094 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4399b1-3d9e-472d-9c9c-c3b3e20afe1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:27.826557 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4399b1-3d9e-472d-9c9c-c3b3e20afe1c admin admin] PATH_INFO: `/v3/projects/b84692ec1f254131861d644cd2fcecd6` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:27.828031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4399b1-3d9e-472d-9c9c-c3b3e20afe1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b84692ec1f254131861d644cd2fcecd6)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:27.830021 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4399b1-3d9e-472d-9c9c-c3b3e20afe1c admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:27.954932 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-9a4399b1-3d9e-472d-9c9c-c3b3e20afe1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b84692ec1f254131861d644cd2fcecd6', 'request_id': 'req-9a4399b1-3d9e-472d-9c9c-c3b3e20afe1c'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:27.961393 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-9a4399b1-3d9e-472d-9c9c-c3b3e20afe1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b84692ec1f254131861d644cd2fcecd6', 'request_id': 'req-9a4399b1-3d9e-472d-9c9c-c3b3e20afe1c'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:27.969037 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-9a4399b1-3d9e-472d-9c9c-c3b3e20afe1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b84692ec1f254131861d644cd2fcecd6', 'request_id': 'req-9a4399b1-3d9e-472d-9c9c-c3b3e20afe1c'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:28.045002 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-9a4399b1-3d9e-472d-9c9c-c3b3e20afe1c admin admin] The token cache is being invalidate because project b84692ec1f254131861d644cd2fcecd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:14:28.045296 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-9a4399b1-3d9e-472d-9c9c-c3b3e20afe1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:28.046153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-9a4399b1-3d9e-472d-9c9c-c3b3e20afe1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:28.047639 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1387/2793] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:14:27 2022] DELETE /identity/v3/projects/b84692ec1f254131861d644cd2fcecd6 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:14:28.051850 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94019636-0956-41d1-80a8-44ed17e0e85c service neutron] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:28.061801 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94019636-0956-41d1-80a8-44ed17e0e85c service neutron] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:28.119094 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297756a7-1bf5-4f07-b70f-ba588fc534bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:28.119720 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297756a7-1bf5-4f07-b70f-ba588fc534bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:28.120000 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297756a7-1bf5-4f07-b70f-ba588fc534bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:28.120272 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297756a7-1bf5-4f07-b70f-ba588fc534bd admin admin] PATH_INFO: `/v3/users/f82dad07834540ef841c7e11c5438f31` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:28.121424 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297756a7-1bf5-4f07-b70f-ba588fc534bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f82dad07834540ef841c7e11c5438f31)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:28.123436 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297756a7-1bf5-4f07-b70f-ba588fc534bd admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:28.148669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:28.356822 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-297756a7-1bf5-4f07-b70f-ba588fc534bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f82dad07834540ef841c7e11c5438f31'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:28.357480 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-297756a7-1bf5-4f07-b70f-ba588fc534bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f82dad07834540ef841c7e11c5438f31'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:28.358086 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-297756a7-1bf5-4f07-b70f-ba588fc534bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f82dad07834540ef841c7e11c5438f31'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:28.372324 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-297756a7-1bf5-4f07-b70f-ba588fc534bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f82dad07834540ef841c7e11c5438f31'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:28.439409 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-297756a7-1bf5-4f07-b70f-ba588fc534bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f82dad07834540ef841c7e11c5438f31'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:28.452350 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1407/2794] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:14:28 2022] DELETE /identity/v3/users/f82dad07834540ef841c7e11c5438f31 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:14:28.881597 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4399b1-3d9e-472d-9c9c-c3b3e20afe1c admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:28.883250 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-9a4399b1-3d9e-472d-9c9c-c3b3e20afe1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:28.897864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4399b1-3d9e-472d-9c9c-c3b3e20afe1c admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:28.956087 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c79b4-0f98-4077-a89f-8b6b08badc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:28.956786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c79b4-0f98-4077-a89f-8b6b08badc8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:28.957064 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c79b4-0f98-4077-a89f-8b6b08badc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:28.957331 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c79b4-0f98-4077-a89f-8b6b08badc8c admin admin] PATH_INFO: `/v3/projects/57aaef9a1e7f4190b6717d68dca3adb2` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:28.959130 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c79b4-0f98-4077-a89f-8b6b08badc8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=57aaef9a1e7f4190b6717d68dca3adb2)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:28.961147 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c79b4-0f98-4077-a89f-8b6b08badc8c admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:29.050839 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-254c79b4-0f98-4077-a89f-8b6b08badc8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57aaef9a1e7f4190b6717d68dca3adb2', 'request_id': 'req-254c79b4-0f98-4077-a89f-8b6b08badc8c'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:29.056556 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-254c79b4-0f98-4077-a89f-8b6b08badc8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57aaef9a1e7f4190b6717d68dca3adb2', 'request_id': 'req-254c79b4-0f98-4077-a89f-8b6b08badc8c'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:29.062805 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-254c79b4-0f98-4077-a89f-8b6b08badc8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57aaef9a1e7f4190b6717d68dca3adb2', 'request_id': 'req-254c79b4-0f98-4077-a89f-8b6b08badc8c'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:29.148747 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-254c79b4-0f98-4077-a89f-8b6b08badc8c admin admin] The token cache is being invalidate because project 57aaef9a1e7f4190b6717d68dca3adb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:14:29.149041 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-254c79b4-0f98-4077-a89f-8b6b08badc8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:29.149696 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-254c79b4-0f98-4077-a89f-8b6b08badc8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:29.151197 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1388/2795] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:14:28 2022] DELETE /identity/v3/projects/57aaef9a1e7f4190b6717d68dca3adb2 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:14:29.156075 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b089db-e6e6-4875-8390-0383f15b0d9f None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:29.156537 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b089db-e6e6-4875-8390-0383f15b0d9f None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:29.156654 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b089db-e6e6-4875-8390-0383f15b0d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:29.177216 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-f4b089db-e6e6-4875-8390-0383f15b0d9f None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:29.178433 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-f4b089db-e6e6-4875-8390-0383f15b0d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:29.239623 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1408/2796] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:14:29.247643 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880a7bc-4516-4da4-bf00-2837e1574f26 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:29.247938 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880a7bc-4516-4da4-bf00-2837e1574f26 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:29.248219 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880a7bc-4516-4da4-bf00-2837e1574f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:29.268191 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-9880a7bc-4516-4da4-bf00-2837e1574f26 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:29.269440 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-9880a7bc-4516-4da4-bf00-2837e1574f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:29.278305 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1389/2797] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:14:29.282737 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b089db-e6e6-4875-8390-0383f15b0d9f None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:29.294167 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b089db-e6e6-4875-8390-0383f15b0d9f None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:29.298794 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544ae49-c71f-4b24-889f-5cf1b04fbb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:29.299393 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544ae49-c71f-4b24-889f-5cf1b04fbb2c admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:29.299669 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544ae49-c71f-4b24-889f-5cf1b04fbb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:29.299937 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544ae49-c71f-4b24-889f-5cf1b04fbb2c admin admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:29.300581 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544ae49-c71f-4b24-889f-5cf1b04fbb2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:14:29.300954 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544ae49-c71f-4b24-889f-5cf1b04fbb2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:29.302793 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544ae49-c71f-4b24-889f-5cf1b04fbb2c admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:29.314657 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1409/2798] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:14:29.319669 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880a7bc-4516-4da4-bf00-2837e1574f26 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:29.328896 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880a7bc-4516-4da4-bf00-2837e1574f26 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:29.334236 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda75ceb-572d-4180-a06d-85a32dd14acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:29.334936 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda75ceb-572d-4180-a06d-85a32dd14acd admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:29.335218 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda75ceb-572d-4180-a06d-85a32dd14acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:29.335515 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda75ceb-572d-4180-a06d-85a32dd14acd admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:29.336130 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda75ceb-572d-4180-a06d-85a32dd14acd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:29.338058 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda75ceb-572d-4180-a06d-85a32dd14acd admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:29.347513 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:29.411569 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1390/2799] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:14:29 2022] POST /identity/v3/projects => generated 387 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:14:29.415790 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544ae49-c71f-4b24-889f-5cf1b04fbb2c admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:29.426068 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544ae49-c71f-4b24-889f-5cf1b04fbb2c admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:29.482309 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b65b2-df5c-456e-bfaa-35904e2bbf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:29.482912 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b65b2-df5c-456e-bfaa-35904e2bbf7a admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:29.483195 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b65b2-df5c-456e-bfaa-35904e2bbf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:29.483471 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b65b2-df5c-456e-bfaa-35904e2bbf7a admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:29.484106 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b65b2-df5c-456e-bfaa-35904e2bbf7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:29.486052 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b65b2-df5c-456e-bfaa-35904e2bbf7a admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:29.570653 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1410/2800] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:14:29 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:14:29.574680 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda75ceb-572d-4180-a06d-85a32dd14acd admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:29.585404 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda75ceb-572d-4180-a06d-85a32dd14acd admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:29.590065 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88777a1-833c-4bf7-8515-14ee5f1544aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:29.590658 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88777a1-833c-4bf7-8515-14ee5f1544aa admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:29.590938 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88777a1-833c-4bf7-8515-14ee5f1544aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:29.591209 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88777a1-833c-4bf7-8515-14ee5f1544aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:29.591843 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88777a1-833c-4bf7-8515-14ee5f1544aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:29.593461 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88777a1-833c-4bf7-8515-14ee5f1544aa admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:29.603594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1391/2801] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:14:29.607573 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b65b2-df5c-456e-bfaa-35904e2bbf7a admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:29.617768 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b65b2-df5c-456e-bfaa-35904e2bbf7a admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:29.622433 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21496ad5-61dd-43f4-8282-82c75c38f937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:29.623026 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21496ad5-61dd-43f4-8282-82c75c38f937 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:29.623311 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21496ad5-61dd-43f4-8282-82c75c38f937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:29.623589 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21496ad5-61dd-43f4-8282-82c75c38f937 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:29.624240 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21496ad5-61dd-43f4-8282-82c75c38f937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:29.625896 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21496ad5-61dd-43f4-8282-82c75c38f937 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:29.637382 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1411/2802] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:14:29.641363 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88777a1-833c-4bf7-8515-14ee5f1544aa admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:29.651963 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88777a1-833c-4bf7-8515-14ee5f1544aa admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:29.656583 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b450ef7-500e-429c-b596-31cb5066878c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:29.657248 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b450ef7-500e-429c-b596-31cb5066878c admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:29.657528 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b450ef7-500e-429c-b596-31cb5066878c admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:29.657802 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b450ef7-500e-429c-b596-31cb5066878c admin admin] PATH_INFO: `/v3/projects/b49c8a508af444b69f748e6e48c0304b/users/6f2d6e62363c4425a588ca2034e72cba/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:29.671956 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b450ef7-500e-429c-b596-31cb5066878c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b49c8a508af444b69f748e6e48c0304b, user_id=6f2d6e62363c4425a588ca2034e72cba, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:29.674615 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b450ef7-500e-429c-b596-31cb5066878c admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:29.746634 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1392/2803] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:14:29 2022] PUT /identity/v3/projects/b49c8a508af444b69f748e6e48c0304b/users/6f2d6e62363c4425a588ca2034e72cba/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:14:29.758417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183979cc-1b31-4cbe-96e9-e22a67a22d58 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:29.758702 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183979cc-1b31-4cbe-96e9-e22a67a22d58 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:29.759006 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183979cc-1b31-4cbe-96e9-e22a67a22d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:29.767315 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:29.787029 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-183979cc-1b31-4cbe-96e9-e22a67a22d58 None None] MFA Rules not processed for user `6f2d6e62363c4425a588ca2034e72cba`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:29.788382 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-183979cc-1b31-4cbe-96e9-e22a67a22d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:29.854276 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1412/2804] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:14:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:14:29.858662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b450ef7-500e-429c-b596-31cb5066878c admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:29.926016 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b450ef7-500e-429c-b596-31cb5066878c admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:29.931725 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e17db-8251-48c8-abd4-43edd19f11b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:29.932382 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e17db-8251-48c8-abd4-43edd19f11b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:29.932690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e17db-8251-48c8-abd4-43edd19f11b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:29.933004 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e17db-8251-48c8-abd4-43edd19f11b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:29.933732 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e17db-8251-48c8-abd4-43edd19f11b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:29.936097 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e17db-8251-48c8-abd4-43edd19f11b2 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:30.144148 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1393/2805] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:14:29 2022] POST /identity/v3/projects => generated 385 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:14:30.149071 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183979cc-1b31-4cbe-96e9-e22a67a22d58 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:30.160318 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183979cc-1b31-4cbe-96e9-e22a67a22d58 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:30.219185 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b502a0b-4825-46fd-99a8-452a33e248d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:30.219790 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b502a0b-4825-46fd-99a8-452a33e248d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:30.220076 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b502a0b-4825-46fd-99a8-452a33e248d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:30.220366 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b502a0b-4825-46fd-99a8-452a33e248d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:30.221039 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b502a0b-4825-46fd-99a8-452a33e248d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:30.223155 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b502a0b-4825-46fd-99a8-452a33e248d5 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:30.304510 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1413/2806] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:14:30 2022] POST /identity/v3/users => generated 299 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:14:30.308415 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e17db-8251-48c8-abd4-43edd19f11b2 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:30.319637 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e17db-8251-48c8-abd4-43edd19f11b2 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:30.324187 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c5768-6246-4c1c-9dd6-d627fc5a45fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:30.324819 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c5768-6246-4c1c-9dd6-d627fc5a45fa admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:30.325127 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c5768-6246-4c1c-9dd6-d627fc5a45fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:30.325375 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c5768-6246-4c1c-9dd6-d627fc5a45fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:30.326014 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c5768-6246-4c1c-9dd6-d627fc5a45fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:30.327608 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c5768-6246-4c1c-9dd6-d627fc5a45fa admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:30.338935 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1394/2807] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:14:30.342976 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b502a0b-4825-46fd-99a8-452a33e248d5 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:30.353312 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b502a0b-4825-46fd-99a8-452a33e248d5 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:30.357889 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f3a99-50d8-4791-a7f5-ef54594b7d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:30.358527 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f3a99-50d8-4791-a7f5-ef54594b7d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:30.358806 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f3a99-50d8-4791-a7f5-ef54594b7d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:30.359075 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f3a99-50d8-4791-a7f5-ef54594b7d47 admin admin] PATH_INFO: `/v3/projects/da2b5f9fae3e4c9b890b542f5ed9abff/users/edebe01e609741258655f1798b32d84d/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:30.373886 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f3a99-50d8-4791-a7f5-ef54594b7d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da2b5f9fae3e4c9b890b542f5ed9abff, user_id=edebe01e609741258655f1798b32d84d, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:30.376509 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f3a99-50d8-4791-a7f5-ef54594b7d47 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:30.450226 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1414/2808] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:14:30 2022] PUT /identity/v3/projects/da2b5f9fae3e4c9b890b542f5ed9abff/users/edebe01e609741258655f1798b32d84d/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:14:30.454176 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c5768-6246-4c1c-9dd6-d627fc5a45fa admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:30.464151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c5768-6246-4c1c-9dd6-d627fc5a45fa admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:30.520896 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf322d-b893-4e15-96a0-757c5eb023ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:30.521490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf322d-b893-4e15-96a0-757c5eb023ee admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:30.521764 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf322d-b893-4e15-96a0-757c5eb023ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:30.522036 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf322d-b893-4e15-96a0-757c5eb023ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:30.522663 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf322d-b893-4e15-96a0-757c5eb023ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:30.524231 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf322d-b893-4e15-96a0-757c5eb023ee admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:30.533841 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1395/2809] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:14:30.538406 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f3a99-50d8-4791-a7f5-ef54594b7d47 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:30.548742 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f3a99-50d8-4791-a7f5-ef54594b7d47 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:30.554033 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512b1e1-a1db-46ce-b26e-cd628ba0453b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:30.554658 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512b1e1-a1db-46ce-b26e-cd628ba0453b admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:30.554938 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512b1e1-a1db-46ce-b26e-cd628ba0453b admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:30.555209 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512b1e1-a1db-46ce-b26e-cd628ba0453b admin admin] PATH_INFO: `/v3/projects/da2b5f9fae3e4c9b890b542f5ed9abff/users/edebe01e609741258655f1798b32d84d/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:30.557145 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512b1e1-a1db-46ce-b26e-cd628ba0453b admin admin] RBAC: Authorizing `identity:create_grant(project_id=da2b5f9fae3e4c9b890b542f5ed9abff, user_id=edebe01e609741258655f1798b32d84d, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:30.559755 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512b1e1-a1db-46ce-b26e-cd628ba0453b admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:30.570532 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1415/2810] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:14:30 2022] PUT /identity/v3/projects/da2b5f9fae3e4c9b890b542f5ed9abff/users/edebe01e609741258655f1798b32d84d/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:14:30.635891 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c4af3-7ff1-4d73-be4a-439d48e56d9e None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:30.636287 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c4af3-7ff1-4d73-be4a-439d48e56d9e None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:30.636606 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c4af3-7ff1-4d73-be4a-439d48e56d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:30.663638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-cb3c4af3-7ff1-4d73-be4a-439d48e56d9e None None] MFA Rules not processed for user `edebe01e609741258655f1798b32d84d`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:30.664895 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-cb3c4af3-7ff1-4d73-be4a-439d48e56d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:30.676510 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:30.735310 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1396/2811] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:14:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:14:30.747300 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512b1e1-a1db-46ce-b26e-cd628ba0453b admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:30.749084 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-a512b1e1-a1db-46ce-b26e-cd628ba0453b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:30.804318 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:30.809511 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512b1e1-a1db-46ce-b26e-cd628ba0453b admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:30.813253 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78560b20-93f9-4ded-b673-1aa60dec5f3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:30.819078 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78560b20-93f9-4ded-b673-1aa60dec5f3e service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:30.819078 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78560b20-93f9-4ded-b673-1aa60dec5f3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:30.819078 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78560b20-93f9-4ded-b673-1aa60dec5f3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:30.823449 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78560b20-93f9-4ded-b673-1aa60dec5f3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:30.824917 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78560b20-93f9-4ded-b673-1aa60dec5f3e service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:30.834370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1416/2812] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:14:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:14:31.935304 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c4af3-7ff1-4d73-be4a-439d48e56d9e None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:31.999489 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c4af3-7ff1-4d73-be4a-439d48e56d9e None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:32.004048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ea9dc-81c1-436b-89f4-998e8e6859cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:32.004700 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ea9dc-81c1-436b-89f4-998e8e6859cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:32.005036 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ea9dc-81c1-436b-89f4-998e8e6859cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:32.005314 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ea9dc-81c1-436b-89f4-998e8e6859cf admin admin] PATH_INFO: `/v3/users/6f2d6e62363c4425a588ca2034e72cba` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:32.006535 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ea9dc-81c1-436b-89f4-998e8e6859cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f2d6e62363c4425a588ca2034e72cba)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:32.008437 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ea9dc-81c1-436b-89f4-998e8e6859cf admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:32.191106 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-bd9ea9dc-81c1-436b-89f4-998e8e6859cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f2d6e62363c4425a588ca2034e72cba'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:32.191679 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-bd9ea9dc-81c1-436b-89f4-998e8e6859cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f2d6e62363c4425a588ca2034e72cba'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:32.192354 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-bd9ea9dc-81c1-436b-89f4-998e8e6859cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f2d6e62363c4425a588ca2034e72cba'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:32.262370 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-bd9ea9dc-81c1-436b-89f4-998e8e6859cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f2d6e62363c4425a588ca2034e72cba'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:32.269582 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-bd9ea9dc-81c1-436b-89f4-998e8e6859cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f2d6e62363c4425a588ca2034e72cba'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:32.287863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1397/2813] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:14:31 2022] DELETE /identity/v3/users/6f2d6e62363c4425a588ca2034e72cba => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:14:32.292381 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e3adf-27e4-4304-9551-786e052c1b66 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:32.292888 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e3adf-27e4-4304-9551-786e052c1b66 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:32.293004 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e3adf-27e4-4304-9551-786e052c1b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:32.436184 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-880e3adf-27e4-4304-9551-786e052c1b66 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:32.437437 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-880e3adf-27e4-4304-9551-786e052c1b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:32.497039 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1417/2814] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:14:32.507584 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ea9dc-81c1-436b-89f4-998e8e6859cf admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:32.509059 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-bd9ea9dc-81c1-436b-89f4-998e8e6859cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:32.542821 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:32.569153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ea9dc-81c1-436b-89f4-998e8e6859cf admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:32.573057 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf34a7-875d-4907-b6ca-483915cc01f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:32.573662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf34a7-875d-4907-b6ca-483915cc01f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:32.573941 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf34a7-875d-4907-b6ca-483915cc01f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:32.574216 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf34a7-875d-4907-b6ca-483915cc01f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:32.584223 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf34a7-875d-4907-b6ca-483915cc01f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:32.585692 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf34a7-875d-4907-b6ca-483915cc01f1 service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:32.595106 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1398/2815] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:14:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:14:32.996830 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e3adf-27e4-4304-9551-786e052c1b66 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:32.998535 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-880e3adf-27e4-4304-9551-786e052c1b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:33.013903 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e3adf-27e4-4304-9551-786e052c1b66 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:33.023026 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c569179-629c-4da8-a659-8a468792fa8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:33.023026 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c569179-629c-4da8-a659-8a468792fa8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:33.023026 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c569179-629c-4da8-a659-8a468792fa8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:33.023026 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c569179-629c-4da8-a659-8a468792fa8e admin admin] PATH_INFO: `/v3/projects/b49c8a508af444b69f748e6e48c0304b` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:33.025103 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c569179-629c-4da8-a659-8a468792fa8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b49c8a508af444b69f748e6e48c0304b)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:33.027091 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c569179-629c-4da8-a659-8a468792fa8e admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:33.170406 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-2c569179-629c-4da8-a659-8a468792fa8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b49c8a508af444b69f748e6e48c0304b', 'request_id': 'req-2c569179-629c-4da8-a659-8a468792fa8e'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:33.256674 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-2c569179-629c-4da8-a659-8a468792fa8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b49c8a508af444b69f748e6e48c0304b', 'request_id': 'req-2c569179-629c-4da8-a659-8a468792fa8e'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:33.263873 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-2c569179-629c-4da8-a659-8a468792fa8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b49c8a508af444b69f748e6e48c0304b', 'request_id': 'req-2c569179-629c-4da8-a659-8a468792fa8e'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:33.274119 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-2c569179-629c-4da8-a659-8a468792fa8e admin admin] The token cache is being invalidate because project b49c8a508af444b69f748e6e48c0304b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:14:33.274402 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-2c569179-629c-4da8-a659-8a468792fa8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:33.275025 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-2c569179-629c-4da8-a659-8a468792fa8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:33.276486 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1418/2816] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:14:32 2022] DELETE /identity/v3/projects/b49c8a508af444b69f748e6e48c0304b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:14:33.280443 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf34a7-875d-4907-b6ca-483915cc01f1 service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:33.290898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf34a7-875d-4907-b6ca-483915cc01f1 service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:33.346819 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f3d2e-5035-47fd-bd68-bc06ac0a8932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:33.347441 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f3d2e-5035-47fd-bd68-bc06ac0a8932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:33.347717 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f3d2e-5035-47fd-bd68-bc06ac0a8932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:33.347989 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f3d2e-5035-47fd-bd68-bc06ac0a8932 admin admin] PATH_INFO: `/v3/users/edebe01e609741258655f1798b32d84d` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:33.349131 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f3d2e-5035-47fd-bd68-bc06ac0a8932 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edebe01e609741258655f1798b32d84d)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:33.351573 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f3d2e-5035-47fd-bd68-bc06ac0a8932 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:33.561662 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-bb6f3d2e-5035-47fd-bd68-bc06ac0a8932 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edebe01e609741258655f1798b32d84d'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:33.562270 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-bb6f3d2e-5035-47fd-bd68-bc06ac0a8932 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edebe01e609741258655f1798b32d84d'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:33.562904 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-bb6f3d2e-5035-47fd-bd68-bc06ac0a8932 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edebe01e609741258655f1798b32d84d'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:33.622236 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-bb6f3d2e-5035-47fd-bd68-bc06ac0a8932 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edebe01e609741258655f1798b32d84d'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:33.629717 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-bb6f3d2e-5035-47fd-bd68-bc06ac0a8932 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edebe01e609741258655f1798b32d84d'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:33.648164 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1399/2817] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:14:33 2022] DELETE /identity/v3/users/edebe01e609741258655f1798b32d84d => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:14:34.045467 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c569179-629c-4da8-a659-8a468792fa8e admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:34.046816 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-2c569179-629c-4da8-a659-8a468792fa8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:34.064563 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c569179-629c-4da8-a659-8a468792fa8e admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:34.123095 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713cde14-f0db-4457-b0e4-2070ae6a38f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:34.123648 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713cde14-f0db-4457-b0e4-2070ae6a38f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:34.123926 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713cde14-f0db-4457-b0e4-2070ae6a38f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:34.124224 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713cde14-f0db-4457-b0e4-2070ae6a38f0 admin admin] PATH_INFO: `/v3/projects/da2b5f9fae3e4c9b890b542f5ed9abff` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:34.125373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713cde14-f0db-4457-b0e4-2070ae6a38f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da2b5f9fae3e4c9b890b542f5ed9abff)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:34.127257 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713cde14-f0db-4457-b0e4-2070ae6a38f0 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:34.143759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:34.246053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-713cde14-f0db-4457-b0e4-2070ae6a38f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da2b5f9fae3e4c9b890b542f5ed9abff', 'request_id': 'req-713cde14-f0db-4457-b0e4-2070ae6a38f0'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:34.348353 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-713cde14-f0db-4457-b0e4-2070ae6a38f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da2b5f9fae3e4c9b890b542f5ed9abff', 'request_id': 'req-713cde14-f0db-4457-b0e4-2070ae6a38f0'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:34.355498 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-713cde14-f0db-4457-b0e4-2070ae6a38f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da2b5f9fae3e4c9b890b542f5ed9abff', 'request_id': 'req-713cde14-f0db-4457-b0e4-2070ae6a38f0'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:34.366721 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-713cde14-f0db-4457-b0e4-2070ae6a38f0 admin admin] The token cache is being invalidate because project da2b5f9fae3e4c9b890b542f5ed9abff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:14:34.367008 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-713cde14-f0db-4457-b0e4-2070ae6a38f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:34.367643 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-713cde14-f0db-4457-b0e4-2070ae6a38f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:34.369265 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1419/2818] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:14:34 2022] DELETE /identity/v3/projects/da2b5f9fae3e4c9b890b542f5ed9abff => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:14:34.374207 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb3ffc-8920-454d-b8bc-6d545df9ffb1 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:34.374670 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb3ffc-8920-454d-b8bc-6d545df9ffb1 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:34.374670 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb3ffc-8920-454d-b8bc-6d545df9ffb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:34.397593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-9abb3ffc-8920-454d-b8bc-6d545df9ffb1 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:34.398787 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-9abb3ffc-8920-454d-b8bc-6d545df9ffb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:34.443175 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:34.458355 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1400/2819] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:14:34.466487 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5fb03-dedf-4264-a691-61a6c9a5388d None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:34.466769 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5fb03-dedf-4264-a691-61a6c9a5388d None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:34.467038 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5fb03-dedf-4264-a691-61a6c9a5388d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:34.485842 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-88f5fb03-dedf-4264-a691-61a6c9a5388d None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:34.492994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-88f5fb03-dedf-4264-a691-61a6c9a5388d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:34.495768 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1420/2820] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:14:34.500288 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb3ffc-8920-454d-b8bc-6d545df9ffb1 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:34.510724 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb3ffc-8920-454d-b8bc-6d545df9ffb1 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:34.515823 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42deaa-247c-43ed-95b2-f79c5de830ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:34.516413 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42deaa-247c-43ed-95b2-f79c5de830ab admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:34.516737 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42deaa-247c-43ed-95b2-f79c5de830ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:34.517011 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42deaa-247c-43ed-95b2-f79c5de830ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:34.517646 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42deaa-247c-43ed-95b2-f79c5de830ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:14:34.517947 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42deaa-247c-43ed-95b2-f79c5de830ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:34.519523 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42deaa-247c-43ed-95b2-f79c5de830ab admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:34.530965 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1401/2821] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:14:34.535325 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5fb03-dedf-4264-a691-61a6c9a5388d None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:34.545276 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5fb03-dedf-4264-a691-61a6c9a5388d None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:34.549823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e9d37-9fa9-480f-948e-c996341b32a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:34.550408 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e9d37-9fa9-480f-948e-c996341b32a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:34.550682 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e9d37-9fa9-480f-948e-c996341b32a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:34.550948 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e9d37-9fa9-480f-948e-c996341b32a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:34.551569 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e9d37-9fa9-480f-948e-c996341b32a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:34.554739 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e9d37-9fa9-480f-948e-c996341b32a0 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:34.674794 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1421/2822] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:14:34 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:14:34.679538 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42deaa-247c-43ed-95b2-f79c5de830ab admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:34.689971 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42deaa-247c-43ed-95b2-f79c5de830ab admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:34.745502 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350897e-fed1-4cc1-9b6a-7fe8eb5d550a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:34.746522 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350897e-fed1-4cc1-9b6a-7fe8eb5d550a admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:34.746835 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350897e-fed1-4cc1-9b6a-7fe8eb5d550a admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:34.747111 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350897e-fed1-4cc1-9b6a-7fe8eb5d550a admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:34.747735 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350897e-fed1-4cc1-9b6a-7fe8eb5d550a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:34.749753 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350897e-fed1-4cc1-9b6a-7fe8eb5d550a admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:34.843552 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1402/2823] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:14:34 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:14:34.847721 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e9d37-9fa9-480f-948e-c996341b32a0 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:34.859454 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e9d37-9fa9-480f-948e-c996341b32a0 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:34.864298 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee995f-f1bc-4e58-8507-cf2c19df89f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:34.864935 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee995f-f1bc-4e58-8507-cf2c19df89f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:34.865214 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee995f-f1bc-4e58-8507-cf2c19df89f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:34.865484 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee995f-f1bc-4e58-8507-cf2c19df89f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:34.866238 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee995f-f1bc-4e58-8507-cf2c19df89f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:34.868345 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee995f-f1bc-4e58-8507-cf2c19df89f8 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:34.878367 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1422/2824] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:14:34.888235 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350897e-fed1-4cc1-9b6a-7fe8eb5d550a admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:34.899164 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350897e-fed1-4cc1-9b6a-7fe8eb5d550a admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:34.903739 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c205cf-0a76-46c1-9b79-3ecebac1f548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:34.904332 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c205cf-0a76-46c1-9b79-3ecebac1f548 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:34.904607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c205cf-0a76-46c1-9b79-3ecebac1f548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:34.904903 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c205cf-0a76-46c1-9b79-3ecebac1f548 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:34.905537 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c205cf-0a76-46c1-9b79-3ecebac1f548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:34.907120 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c205cf-0a76-46c1-9b79-3ecebac1f548 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:34.918656 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1403/2825] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:14:34.922777 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee995f-f1bc-4e58-8507-cf2c19df89f8 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:34.933307 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee995f-f1bc-4e58-8507-cf2c19df89f8 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:34.938007 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1cd99-9181-4f6c-92c8-4e32f1e73d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:34.942671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1cd99-9181-4f6c-92c8-4e32f1e73d46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:34.942671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1cd99-9181-4f6c-92c8-4e32f1e73d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:34.942671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1cd99-9181-4f6c-92c8-4e32f1e73d46 admin admin] PATH_INFO: `/v3/projects/e49b3d060d1b4b28b2d78a6e02b716fe/users/15c145b8ed0b4730824c9865498ebce6/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:34.953695 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f1cd99-9181-4f6c-92c8-4e32f1e73d46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e49b3d060d1b4b28b2d78a6e02b716fe, user_id=15c145b8ed0b4730824c9865498ebce6, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:34.956481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f1cd99-9181-4f6c-92c8-4e32f1e73d46 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:35.016856 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1423/2826] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:14:34 2022] PUT /identity/v3/projects/e49b3d060d1b4b28b2d78a6e02b716fe/users/15c145b8ed0b4730824c9865498ebce6/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:14:35.029619 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f34c5f-2953-4be8-840b-ecf7a80282a5 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:35.034245 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f34c5f-2953-4be8-840b-ecf7a80282a5 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:35.034245 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f34c5f-2953-4be8-840b-ecf7a80282a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:35.058001 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-f1f34c5f-2953-4be8-840b-ecf7a80282a5 None None] MFA Rules not processed for user `15c145b8ed0b4730824c9865498ebce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:35.059199 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-f1f34c5f-2953-4be8-840b-ecf7a80282a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:35.122879 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1404/2827] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:14:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:14:35.133629 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1cd99-9181-4f6c-92c8-4e32f1e73d46 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:35.135717 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-97f1cd99-9181-4f6c-92c8-4e32f1e73d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:35.195090 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1cd99-9181-4f6c-92c8-4e32f1e73d46 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:35.198696 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6d62c-3258-422b-b4cd-aef6dec058e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:35.199376 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6d62c-3258-422b-b4cd-aef6dec058e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:35.199662 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6d62c-3258-422b-b4cd-aef6dec058e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:35.199932 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6d62c-3258-422b-b4cd-aef6dec058e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:35.208170 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6d62c-3258-422b-b4cd-aef6dec058e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:35.209637 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6d62c-3258-422b-b4cd-aef6dec058e8 service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:35.219083 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1424/2828] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:14:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:14:36.888369 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd688cc-aee6-4841-a952-c3b4fad15c50 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:36.888932 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd688cc-aee6-4841-a952-c3b4fad15c50 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:36.888932 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd688cc-aee6-4841-a952-c3b4fad15c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:36.907497 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-1dd688cc-aee6-4841-a952-c3b4fad15c50 None None] MFA Rules not processed for user `15c145b8ed0b4730824c9865498ebce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:36.908708 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-1dd688cc-aee6-4841-a952-c3b4fad15c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:36.915914 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1405/2829] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:14:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:14:45.215119 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:46.462823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6d62c-3258-422b-b4cd-aef6dec058e8 service cinder] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:46.464352 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-36d6d62c-3258-422b-b4cd-aef6dec058e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:46.538973 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6d62c-3258-422b-b4cd-aef6dec058e8 service cinder] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:46.544412 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298f183-dea9-4eda-b57a-fc3a12dc785a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:46.545045 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298f183-dea9-4eda-b57a-fc3a12dc785a service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:46.545326 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298f183-dea9-4eda-b57a-fc3a12dc785a service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:46.545603 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298f183-dea9-4eda-b57a-fc3a12dc785a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:46.547329 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-0298f183-dea9-4eda-b57a-fc3a12dc785a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:46.560126 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298f183-dea9-4eda-b57a-fc3a12dc785a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:46.561940 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298f183-dea9-4eda-b57a-fc3a12dc785a service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:46.573683 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1425/2830] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:14:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:14:46.902795 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=79,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:53.437391 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e7cb2-87c3-4bc0-8c58-6dbeee922253 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:53.438030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e7cb2-87c3-4bc0-8c58-6dbeee922253 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:53.438030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e7cb2-87c3-4bc0-8c58-6dbeee922253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:53.487778 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-2b3e7cb2-87c3-4bc0-8c58-6dbeee922253 None None] MFA Rules not processed for user `eaf3821dd57a4d8f9ca6385c202bb0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:53.489046 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-2b3e7cb2-87c3-4bc0-8c58-6dbeee922253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:53.554781 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1406/2831] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 24 16:14:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:14:53.688262 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298f183-dea9-4eda-b57a-fc3a12dc785a service nova] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:53.689716 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-0298f183-dea9-4eda-b57a-fc3a12dc785a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:53.781103 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298f183-dea9-4eda-b57a-fc3a12dc785a service nova] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:53.786086 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b210337-29b8-47c9-90dd-4443fcef5cb5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a0a84e4c4e47fc930881109fc07039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:53.786682 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b210337-29b8-47c9-90dd-4443fcef5cb5 service swift] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:53.786961 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b210337-29b8-47c9-90dd-4443fcef5cb5 service swift] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:53.787232 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b210337-29b8-47c9-90dd-4443fcef5cb5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:53.795710 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b210337-29b8-47c9-90dd-4443fcef5cb5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:53.797309 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b210337-29b8-47c9-90dd-4443fcef5cb5 service swift] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:53.805113 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1426/2832] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 24 16:14:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:14:54.577622 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da664a-0ce4-4ef5-ac78-db4df3ed06f5 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:54.578078 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da664a-0ce4-4ef5-ac78-db4df3ed06f5 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:54.578425 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da664a-0ce4-4ef5-ac78-db4df3ed06f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:54.599188 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-66da664a-0ce4-4ef5-ac78-db4df3ed06f5 None None] MFA Rules not processed for user `eaf3821dd57a4d8f9ca6385c202bb0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:54.600395 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-66da664a-0ce4-4ef5-ac78-db4df3ed06f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:54.608477 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1407/2833] 10.222.0.64 () {58 vars in 967 bytes} [Wed Aug 24 16:14:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:14:54.620823 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b210337-29b8-47c9-90dd-4443fcef5cb5 service swift] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:54.631743 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b210337-29b8-47c9-90dd-4443fcef5cb5 service swift] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:54.637494 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069401e-1c50-4b5a-a8f0-2a07a8732691 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a0a84e4c4e47fc930881109fc07039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:54.638078 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069401e-1c50-4b5a-a8f0-2a07a8732691 service swift] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:54.638353 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069401e-1c50-4b5a-a8f0-2a07a8732691 service swift] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:54.638648 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069401e-1c50-4b5a-a8f0-2a07a8732691 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:54.646671 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069401e-1c50-4b5a-a8f0-2a07a8732691 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:54.648220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069401e-1c50-4b5a-a8f0-2a07a8732691 service swift] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:54.656615 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1427/2834] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 24 16:14:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:14:55.319119 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834cd3dd-c65a-41c2-82b5-4a161b432a69 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:55.324945 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834cd3dd-c65a-41c2-82b5-4a161b432a69 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:55.324945 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834cd3dd-c65a-41c2-82b5-4a161b432a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:55.339421 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-834cd3dd-c65a-41c2-82b5-4a161b432a69 None None] MFA Rules not processed for user `eaf3821dd57a4d8f9ca6385c202bb0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:55.340770 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-834cd3dd-c65a-41c2-82b5-4a161b432a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:55.348090 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1408/2835] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 24 16:14:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:14:55.360591 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069401e-1c50-4b5a-a8f0-2a07a8732691 service swift] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:55.371726 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069401e-1c50-4b5a-a8f0-2a07a8732691 service swift] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:55.378030 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f3d73-ed77-4de7-9eb9-fbb3c7dfbd47 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a0a84e4c4e47fc930881109fc07039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:55.378617 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f3d73-ed77-4de7-9eb9-fbb3c7dfbd47 service swift] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:55.378894 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f3d73-ed77-4de7-9eb9-fbb3c7dfbd47 service swift] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:55.379162 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f3d73-ed77-4de7-9eb9-fbb3c7dfbd47 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:55.387605 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f3d73-ed77-4de7-9eb9-fbb3c7dfbd47 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:55.389207 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f3d73-ed77-4de7-9eb9-fbb3c7dfbd47 service swift] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:55.397086 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1428/2836] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 24 16:14:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:14:55.913359 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd891e-1d54-41e8-847c-e35697d83017 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:55.913813 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd891e-1d54-41e8-847c-e35697d83017 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:55.913930 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd891e-1d54-41e8-847c-e35697d83017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:55.934664 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-90fd891e-1d54-41e8-847c-e35697d83017 None None] MFA Rules not processed for user `eaf3821dd57a4d8f9ca6385c202bb0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:55.935927 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-90fd891e-1d54-41e8-847c-e35697d83017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:55.942995 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1409/2837] 10.222.0.64 () {58 vars in 967 bytes} [Wed Aug 24 16:14:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:14:55.955075 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f3d73-ed77-4de7-9eb9-fbb3c7dfbd47 service swift] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:55.966073 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f3d73-ed77-4de7-9eb9-fbb3c7dfbd47 service swift] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:55.971092 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8fba7-6e63-4e7c-86ed-faf8fa3f334a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a0a84e4c4e47fc930881109fc07039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:55.971680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8fba7-6e63-4e7c-86ed-faf8fa3f334a service swift] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:55.971960 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8fba7-6e63-4e7c-86ed-faf8fa3f334a service swift] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:55.972231 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8fba7-6e63-4e7c-86ed-faf8fa3f334a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:55.980217 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8fba7-6e63-4e7c-86ed-faf8fa3f334a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:55.982493 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8fba7-6e63-4e7c-86ed-faf8fa3f334a service swift] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:55.990504 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1429/2838] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 24 16:14:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:14:58.643181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd891e-1d54-41e8-847c-e35697d83017 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:58.706013 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd891e-1d54-41e8-847c-e35697d83017 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:58.710483 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28008f41-8034-4fec-8b53-5d9c11256302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:58.711107 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28008f41-8034-4fec-8b53-5d9c11256302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:58.711387 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28008f41-8034-4fec-8b53-5d9c11256302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:58.711660 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28008f41-8034-4fec-8b53-5d9c11256302 admin admin] PATH_INFO: `/v3/users/15c145b8ed0b4730824c9865498ebce6` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:58.712811 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28008f41-8034-4fec-8b53-5d9c11256302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15c145b8ed0b4730824c9865498ebce6)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:58.714730 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28008f41-8034-4fec-8b53-5d9c11256302 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:58.876144 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-28008f41-8034-4fec-8b53-5d9c11256302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15c145b8ed0b4730824c9865498ebce6'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:58.876772 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-28008f41-8034-4fec-8b53-5d9c11256302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15c145b8ed0b4730824c9865498ebce6'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:58.877381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-28008f41-8034-4fec-8b53-5d9c11256302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15c145b8ed0b4730824c9865498ebce6'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:58.946085 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-28008f41-8034-4fec-8b53-5d9c11256302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15c145b8ed0b4730824c9865498ebce6'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:58.947435 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:58.954553 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-28008f41-8034-4fec-8b53-5d9c11256302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15c145b8ed0b4730824c9865498ebce6'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:58.971962 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1410/2839] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:14:58 2022] DELETE /identity/v3/users/15c145b8ed0b4730824c9865498ebce6 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:14:58.976715 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45d5a3-def6-4849-bf15-1156339c966e None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:58.977245 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45d5a3-def6-4849-bf15-1156339c966e None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:58.977245 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45d5a3-def6-4849-bf15-1156339c966e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:58.995859 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-bb45d5a3-def6-4849-bf15-1156339c966e None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:14:58.997630 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-bb45d5a3-def6-4849-bf15-1156339c966e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:59.007423 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:59.057112 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1430/2840] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:14:59.067614 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28008f41-8034-4fec-8b53-5d9c11256302 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:59.075815 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-28008f41-8034-4fec-8b53-5d9c11256302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:59.127347 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28008f41-8034-4fec-8b53-5d9c11256302 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:59.131030 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449165b-de57-408f-af24-58fbf57a3fc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:59.134936 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449165b-de57-408f-af24-58fbf57a3fc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:59.134936 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449165b-de57-408f-af24-58fbf57a3fc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:59.134936 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449165b-de57-408f-af24-58fbf57a3fc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:59.141808 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449165b-de57-408f-af24-58fbf57a3fc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:59.143288 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449165b-de57-408f-af24-58fbf57a3fc0 service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:59.152957 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1411/2841] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:14:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:14:59.405788 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45d5a3-def6-4849-bf15-1156339c966e None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:14:59.407465 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-bb45d5a3-def6-4849-bf15-1156339c966e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:14:59.419993 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45d5a3-def6-4849-bf15-1156339c966e None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:14:59.424548 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12725e36-a1be-43a9-8d26-cb6283b3385f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:14:59.425211 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12725e36-a1be-43a9-8d26-cb6283b3385f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:14:59.425499 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12725e36-a1be-43a9-8d26-cb6283b3385f admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:14:59.425808 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12725e36-a1be-43a9-8d26-cb6283b3385f admin admin] PATH_INFO: `/v3/projects/e49b3d060d1b4b28b2d78a6e02b716fe` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:14:59.427342 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12725e36-a1be-43a9-8d26-cb6283b3385f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e49b3d060d1b4b28b2d78a6e02b716fe)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:14:59.429336 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12725e36-a1be-43a9-8d26-cb6283b3385f admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:14:59.542900 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-12725e36-a1be-43a9-8d26-cb6283b3385f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e49b3d060d1b4b28b2d78a6e02b716fe', 'request_id': 'req-12725e36-a1be-43a9-8d26-cb6283b3385f'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:59.627775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-12725e36-a1be-43a9-8d26-cb6283b3385f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e49b3d060d1b4b28b2d78a6e02b716fe', 'request_id': 'req-12725e36-a1be-43a9-8d26-cb6283b3385f'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:59.634745 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-12725e36-a1be-43a9-8d26-cb6283b3385f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e49b3d060d1b4b28b2d78a6e02b716fe', 'request_id': 'req-12725e36-a1be-43a9-8d26-cb6283b3385f'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:59.645587 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-12725e36-a1be-43a9-8d26-cb6283b3385f admin admin] The token cache is being invalidate because project e49b3d060d1b4b28b2d78a6e02b716fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:14:59.645952 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-12725e36-a1be-43a9-8d26-cb6283b3385f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:59.646576 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-12725e36-a1be-43a9-8d26-cb6283b3385f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:14:59.648175 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1431/2842] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:14:59 2022] DELETE /identity/v3/projects/e49b3d060d1b4b28b2d78a6e02b716fe => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:15:09.148693 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=37,keystone:DELETE=2 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:15:09.642444 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:15:39.097551 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449165b-de57-408f-af24-58fbf57a3fc0 service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:15:39.106164 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449165b-de57-408f-af24-58fbf57a3fc0 service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:15:39.157015 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888912c-3ee0-4006-92d3-228710b3b36a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:15:39.157617 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888912c-3ee0-4006-92d3-228710b3b36a service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:15:39.157898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888912c-3ee0-4006-92d3-228710b3b36a service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:15:39.158173 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888912c-3ee0-4006-92d3-228710b3b36a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:15:39.159890 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-9888912c-3ee0-4006-92d3-228710b3b36a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:15:39.220070 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888912c-3ee0-4006-92d3-228710b3b36a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:15:39.221536 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888912c-3ee0-4006-92d3-228710b3b36a service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:15:39.230511 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1412/2843] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:15:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:15:40.144046 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12725e36-a1be-43a9-8d26-cb6283b3385f admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:15:40.145657 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-12725e36-a1be-43a9-8d26-cb6283b3385f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:15:40.232549 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12725e36-a1be-43a9-8d26-cb6283b3385f admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:15:40.238725 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd8da2-047b-4145-827a-ea329f5c80dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:15:40.239329 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd8da2-047b-4145-827a-ea329f5c80dc service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:15:40.239629 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd8da2-047b-4145-827a-ea329f5c80dc service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:15:40.239871 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd8da2-047b-4145-827a-ea329f5c80dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:15:40.246408 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-b5cd8da2-047b-4145-827a-ea329f5c80dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:15:40.254356 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd8da2-047b-4145-827a-ea329f5c80dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:15:40.255921 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd8da2-047b-4145-827a-ea329f5c80dc service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:15:40.267897 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1432/2844] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:15:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:15:45.717451 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888912c-3ee0-4006-92d3-228710b3b36a service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:15:45.718898 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-9888912c-3ee0-4006-92d3-228710b3b36a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:15:45.729797 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888912c-3ee0-4006-92d3-228710b3b36a service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:15:45.734385 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc404928-de08-43f6-9f2e-cc57397a446a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:15:45.734907 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc404928-de08-43f6-9f2e-cc57397a446a service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:15:45.735184 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc404928-de08-43f6-9f2e-cc57397a446a service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:15:45.736145 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc404928-de08-43f6-9f2e-cc57397a446a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:15:45.739166 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-bc404928-de08-43f6-9f2e-cc57397a446a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:15:45.806434 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc404928-de08-43f6-9f2e-cc57397a446a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:15:45.807867 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc404928-de08-43f6-9f2e-cc57397a446a service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:15:45.818586 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1413/2845] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:15:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:15:49.333881 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd8da2-047b-4145-827a-ea329f5c80dc service nova] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:15:49.335299 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-b5cd8da2-047b-4145-827a-ea329f5c80dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:15:49.409649 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd8da2-047b-4145-827a-ea329f5c80dc service nova] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:15:49.414792 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d421d73-a9fd-4a69-9c9e-2ddf19d7e8bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6907dfd3254d3c97d07ca2fb648858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:15:49.415403 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d421d73-a9fd-4a69-9c9e-2ddf19d7e8bd service placement] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:15:49.415688 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d421d73-a9fd-4a69-9c9e-2ddf19d7e8bd service placement] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:15:49.415968 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d421d73-a9fd-4a69-9c9e-2ddf19d7e8bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:15:49.417711 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-3d421d73-a9fd-4a69-9c9e-2ddf19d7e8bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:15:49.430193 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d421d73-a9fd-4a69-9c9e-2ddf19d7e8bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:15:49.431741 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d421d73-a9fd-4a69-9c9e-2ddf19d7e8bd service placement] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:15:49.442334 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1433/2846] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:15:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:15:52.965900 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc404928-de08-43f6-9f2e-cc57397a446a service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:15:52.967443 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-bc404928-de08-43f6-9f2e-cc57397a446a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:15:52.979855 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc404928-de08-43f6-9f2e-cc57397a446a service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:15:52.985159 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cfedd-4627-41b2-81d5-df7516a830d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:15:52.985792 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cfedd-4627-41b2-81d5-df7516a830d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:15:52.986071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cfedd-4627-41b2-81d5-df7516a830d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:15:52.986344 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cfedd-4627-41b2-81d5-df7516a830d3 admin admin] PATH_INFO: `/v3/users/82daa6f49e504b089901028a8fa48752` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:15:52.987461 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cfedd-4627-41b2-81d5-df7516a830d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82daa6f49e504b089901028a8fa48752)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:15:52.989439 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cfedd-4627-41b2-81d5-df7516a830d3 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:15:53.181298 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:15:53.183787 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-953cfedd-4627-41b2-81d5-df7516a830d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82daa6f49e504b089901028a8fa48752'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:15:53.184434 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-953cfedd-4627-41b2-81d5-df7516a830d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82daa6f49e504b089901028a8fa48752'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:15:53.185059 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-953cfedd-4627-41b2-81d5-df7516a830d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82daa6f49e504b089901028a8fa48752'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:15:53.261224 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-953cfedd-4627-41b2-81d5-df7516a830d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82daa6f49e504b089901028a8fa48752'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:15:53.269138 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-953cfedd-4627-41b2-81d5-df7516a830d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82daa6f49e504b089901028a8fa48752'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:15:53.290842 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1414/2847] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:15:52 2022] DELETE /identity/v3/users/82daa6f49e504b089901028a8fa48752 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:15:53.554587 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d421d73-a9fd-4a69-9c9e-2ddf19d7e8bd service placement] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:15:53.566368 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d421d73-a9fd-4a69-9c9e-2ddf19d7e8bd service placement] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:15:53.624759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b51f6f-6055-4538-b370-89537dc24f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:15:53.625384 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b51f6f-6055-4538-b370-89537dc24f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:15:53.625659 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b51f6f-6055-4538-b370-89537dc24f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:15:53.625927 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b51f6f-6055-4538-b370-89537dc24f1b admin admin] PATH_INFO: `/v3/projects/f54ecd682f3a4ae7ae4f21ffb96e769c` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:15:53.627030 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b51f6f-6055-4538-b370-89537dc24f1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f54ecd682f3a4ae7ae4f21ffb96e769c)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:15:53.628949 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b51f6f-6055-4538-b370-89537dc24f1b admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:15:53.645685 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=100 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:15:53.770969 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f6b51f6f-6055-4538-b370-89537dc24f1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f54ecd682f3a4ae7ae4f21ffb96e769c', 'request_id': 'req-f6b51f6f-6055-4538-b370-89537dc24f1b'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:15:53.838395 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f6b51f6f-6055-4538-b370-89537dc24f1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f54ecd682f3a4ae7ae4f21ffb96e769c', 'request_id': 'req-f6b51f6f-6055-4538-b370-89537dc24f1b'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:15:53.845794 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f6b51f6f-6055-4538-b370-89537dc24f1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f54ecd682f3a4ae7ae4f21ffb96e769c', 'request_id': 'req-f6b51f6f-6055-4538-b370-89537dc24f1b'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:15:53.856054 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f6b51f6f-6055-4538-b370-89537dc24f1b admin admin] The token cache is being invalidate because project f54ecd682f3a4ae7ae4f21ffb96e769c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:15:53.861432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f6b51f6f-6055-4538-b370-89537dc24f1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:15:53.861432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f6b51f6f-6055-4538-b370-89537dc24f1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:15:53.861432 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1434/2848] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:15:53 2022] DELETE /identity/v3/projects/f54ecd682f3a4ae7ae4f21ffb96e769c => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:15:53.862821 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cfedd-4627-41b2-81d5-df7516a830d3 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:15:53.864205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-953cfedd-4627-41b2-81d5-df7516a830d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:15:53.877162 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cfedd-4627-41b2-81d5-df7516a830d3 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:15:53.934171 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae6aa3-b0ad-4188-b18d-990552a57122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:15:53.934802 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae6aa3-b0ad-4188-b18d-990552a57122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:15:53.935085 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae6aa3-b0ad-4188-b18d-990552a57122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:15:53.935428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae6aa3-b0ad-4188-b18d-990552a57122 admin admin] PATH_INFO: `/v3/users/e7e7902297c24fecb54fbd52b4f741f2` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:15:53.936594 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae6aa3-b0ad-4188-b18d-990552a57122 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7e7902297c24fecb54fbd52b4f741f2)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:15:53.938550 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae6aa3-b0ad-4188-b18d-990552a57122 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:15:54.155062 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0eae6aa3-b0ad-4188-b18d-990552a57122 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7e7902297c24fecb54fbd52b4f741f2'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:15:54.155715 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0eae6aa3-b0ad-4188-b18d-990552a57122 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7e7902297c24fecb54fbd52b4f741f2'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:15:54.156244 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0eae6aa3-b0ad-4188-b18d-990552a57122 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7e7902297c24fecb54fbd52b4f741f2'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:15:54.244351 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0eae6aa3-b0ad-4188-b18d-990552a57122 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7e7902297c24fecb54fbd52b4f741f2'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:15:54.252175 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-0eae6aa3-b0ad-4188-b18d-990552a57122 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7e7902297c24fecb54fbd52b4f741f2'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:15:54.270482 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1415/2849] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:15:53 2022] DELETE /identity/v3/users/e7e7902297c24fecb54fbd52b4f741f2 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:15:54.497623 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b51f6f-6055-4538-b370-89537dc24f1b admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:15:54.499487 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-f6b51f6f-6055-4538-b370-89537dc24f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:15:54.515998 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b51f6f-6055-4538-b370-89537dc24f1b admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:15:54.586003 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9cebe-99b7-447f-ad1a-ad73fd9516f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:15:54.586709 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9cebe-99b7-447f-ad1a-ad73fd9516f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:15:54.586945 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9cebe-99b7-447f-ad1a-ad73fd9516f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:15:54.587216 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9cebe-99b7-447f-ad1a-ad73fd9516f8 admin admin] PATH_INFO: `/v3/projects/f07b61e25bd84ad08ca31d61437ccff9` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:15:54.588453 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9cebe-99b7-447f-ad1a-ad73fd9516f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f07b61e25bd84ad08ca31d61437ccff9)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:15:54.590396 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9cebe-99b7-447f-ad1a-ad73fd9516f8 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:15:54.714741 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f5e9cebe-99b7-447f-ad1a-ad73fd9516f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f07b61e25bd84ad08ca31d61437ccff9', 'request_id': 'req-f5e9cebe-99b7-447f-ad1a-ad73fd9516f8'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:15:54.798463 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f5e9cebe-99b7-447f-ad1a-ad73fd9516f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f07b61e25bd84ad08ca31d61437ccff9', 'request_id': 'req-f5e9cebe-99b7-447f-ad1a-ad73fd9516f8'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:15:54.805102 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f5e9cebe-99b7-447f-ad1a-ad73fd9516f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f07b61e25bd84ad08ca31d61437ccff9', 'request_id': 'req-f5e9cebe-99b7-447f-ad1a-ad73fd9516f8'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:15:54.817099 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f5e9cebe-99b7-447f-ad1a-ad73fd9516f8 admin admin] The token cache is being invalidate because project f07b61e25bd84ad08ca31d61437ccff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:15:54.817388 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f5e9cebe-99b7-447f-ad1a-ad73fd9516f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:15:54.818135 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-f5e9cebe-99b7-447f-ad1a-ad73fd9516f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:15:54.819757 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1435/2850] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:15:54 2022] DELETE /identity/v3/projects/f07b61e25bd84ad08ca31d61437ccff9 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:16:04.266863 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:DELETE=14,keystone:SELECT=66,keystone:INSERT=2 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:16:04.813907 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=68,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:17:06.296783 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae6aa3-b0ad-4188-b18d-990552a57122 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:17:06.298202 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-0eae6aa3-b0ad-4188-b18d-990552a57122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:17:06.371071 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae6aa3-b0ad-4188-b18d-990552a57122 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:17:06.433914 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af696de9-ec89-4171-a37e-0d6ddbaaac97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6907dfd3254d3c97d07ca2fb648858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:17:06.434530 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af696de9-ec89-4171-a37e-0d6ddbaaac97 service placement] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:17:06.434814 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af696de9-ec89-4171-a37e-0d6ddbaaac97 service placement] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:17:06.435091 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af696de9-ec89-4171-a37e-0d6ddbaaac97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:17:06.436864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-af696de9-ec89-4171-a37e-0d6ddbaaac97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:17:06.448371 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af696de9-ec89-4171-a37e-0d6ddbaaac97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:17:06.449985 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af696de9-ec89-4171-a37e-0d6ddbaaac97 service placement] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:17:06.460488 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1416/2851] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:17:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:17:16.455665 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=58 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:18:26.843111 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dc3da-2a15-4384-849f-a4065a1a39be None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:18:26.843643 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dc3da-2a15-4384-849f-a4065a1a39be None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:18:26.843776 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dc3da-2a15-4384-849f-a4065a1a39be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:18:26.863030 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-9a5dc3da-2a15-4384-849f-a4065a1a39be None None] MFA Rules not processed for user `22b6eed9050c416a92681ec1eb7b10b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:18:26.865118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-9a5dc3da-2a15-4384-849f-a4065a1a39be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:18:26.920913 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1436/2852] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:18:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:18:27.224229 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af696de9-ec89-4171-a37e-0d6ddbaaac97 service placement] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:18:27.225794 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-af696de9-ec89-4171-a37e-0d6ddbaaac97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:18:27.283711 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af696de9-ec89-4171-a37e-0d6ddbaaac97 service placement] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:18:27.287902 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646881c-3ef7-47a7-82d5-272ff7840513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:18:27.288531 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646881c-3ef7-47a7-82d5-272ff7840513 service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:18:27.288844 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646881c-3ef7-47a7-82d5-272ff7840513 service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:18:27.289121 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646881c-3ef7-47a7-82d5-272ff7840513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:18:27.290884 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-0646881c-3ef7-47a7-82d5-272ff7840513 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:18:27.300903 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646881c-3ef7-47a7-82d5-272ff7840513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:18:27.303388 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646881c-3ef7-47a7-82d5-272ff7840513 service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:18:27.311550 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1417/2853] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:18:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:18:33.458573 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dc3da-2a15-4384-849f-a4065a1a39be None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:18:33.468022 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dc3da-2a15-4384-849f-a4065a1a39be None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:18:33.471828 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46a09f-525e-4270-be38-280d6000a8dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:18:33.472414 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46a09f-525e-4270-be38-280d6000a8dd service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:18:33.472726 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46a09f-525e-4270-be38-280d6000a8dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:18:33.473622 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46a09f-525e-4270-be38-280d6000a8dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:18:33.475312 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-6a46a09f-525e-4270-be38-280d6000a8dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:18:33.544263 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a46a09f-525e-4270-be38-280d6000a8dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:18:33.545705 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a46a09f-525e-4270-be38-280d6000a8dd service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:18:33.557982 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1437/2854] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:18:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:18:34.736224 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646881c-3ef7-47a7-82d5-272ff7840513 service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:18:34.745153 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646881c-3ef7-47a7-82d5-272ff7840513 service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:18:34.748744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63aa23d-65ca-47d0-9f39-acbde18e99af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:18:34.749330 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63aa23d-65ca-47d0-9f39-acbde18e99af service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:18:34.749633 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63aa23d-65ca-47d0-9f39-acbde18e99af service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:18:34.749902 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63aa23d-65ca-47d0-9f39-acbde18e99af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:18:34.751584 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-d63aa23d-65ca-47d0-9f39-acbde18e99af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:18:34.765430 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63aa23d-65ca-47d0-9f39-acbde18e99af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:18:34.766829 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63aa23d-65ca-47d0-9f39-acbde18e99af service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:18:34.778638 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1418/2855] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:18:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:18:43.553130 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=59 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:18:44.773872 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=32 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:19:16.014775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46a09f-525e-4270-be38-280d6000a8dd service neutron] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:19:16.024379 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46a09f-525e-4270-be38-280d6000a8dd service neutron] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:19:16.027971 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19476a-b55f-443e-885f-ae96a74559f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:19:16.028559 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19476a-b55f-443e-885f-ae96a74559f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:19:16.028865 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19476a-b55f-443e-885f-ae96a74559f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:19:16.029135 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19476a-b55f-443e-885f-ae96a74559f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:19:16.030841 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-1b19476a-b55f-443e-885f-ae96a74559f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:19:16.040700 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19476a-b55f-443e-885f-ae96a74559f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:19:16.042168 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19476a-b55f-443e-885f-ae96a74559f4 service neutron] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:19:16.050043 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1438/2856] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:19:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:19:26.046508 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=6 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:19:57.154464 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63aa23d-65ca-47d0-9f39-acbde18e99af service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:19:57.174561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-d63aa23d-65ca-47d0-9f39-acbde18e99af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:19:57.174561 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63aa23d-65ca-47d0-9f39-acbde18e99af service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:19:57.175429 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cd4f4-17b1-4f0f-ba60-312701b7380f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:19:57.176014 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cd4f4-17b1-4f0f-ba60-312701b7380f service nova] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:19:57.176288 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cd4f4-17b1-4f0f-ba60-312701b7380f service nova] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:19:57.176559 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cd4f4-17b1-4f0f-ba60-312701b7380f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:19:57.178275 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e30cd4f4-17b1-4f0f-ba60-312701b7380f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:19:57.189377 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30cd4f4-17b1-4f0f-ba60-312701b7380f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:19:57.193545 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30cd4f4-17b1-4f0f-ba60-312701b7380f service nova] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:19:57.200922 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1419/2857] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:19:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:20:07.197149 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=6 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:20:14.805904 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19476a-b55f-443e-885f-ae96a74559f4 service neutron] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:20:14.819853 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19476a-b55f-443e-885f-ae96a74559f4 service neutron] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:20:14.826325 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6f8be-db78-431b-b1cf-8894e8fab705 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:20:14.826921 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6f8be-db78-431b-b1cf-8894e8fab705 service nova] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:20:14.827220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6f8be-db78-431b-b1cf-8894e8fab705 service nova] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:20:14.827500 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6f8be-db78-431b-b1cf-8894e8fab705 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:20:14.829349 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-9cf6f8be-db78-431b-b1cf-8894e8fab705 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:20:14.843233 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6f8be-db78-431b-b1cf-8894e8fab705 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:20:14.844861 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6f8be-db78-431b-b1cf-8894e8fab705 service nova] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:20:14.856381 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1439/2858] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:20:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:20:20.888356 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cd4f4-17b1-4f0f-ba60-312701b7380f service nova] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:20:20.897690 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cd4f4-17b1-4f0f-ba60-312701b7380f service nova] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:20:20.901946 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c0513-aca3-4084-8e6c-26bb4cfb5b73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:20:20.902537 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c0513-aca3-4084-8e6c-26bb4cfb5b73 service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:20:20.902814 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c0513-aca3-4084-8e6c-26bb4cfb5b73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:20:20.903083 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c0513-aca3-4084-8e6c-26bb4cfb5b73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:20:20.904821 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-2f7c0513-aca3-4084-8e6c-26bb4cfb5b73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:20:20.969847 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c0513-aca3-4084-8e6c-26bb4cfb5b73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:20:20.971357 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c0513-aca3-4084-8e6c-26bb4cfb5b73 service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:20:20.981233 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1420/2859] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:20:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:20:24.612350 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6f8be-db78-431b-b1cf-8894e8fab705 service nova] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:20:24.612350 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-9cf6f8be-db78-431b-b1cf-8894e8fab705 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:20:24.623183 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6f8be-db78-431b-b1cf-8894e8fab705 service nova] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:20:24.628018 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2ddbc-6405-45dc-888a-5ad526b35efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:20:24.628670 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2ddbc-6405-45dc-888a-5ad526b35efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:20:24.628954 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2ddbc-6405-45dc-888a-5ad526b35efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:20:24.629226 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2ddbc-6405-45dc-888a-5ad526b35efb admin admin] PATH_INFO: `/v3/users/22b6eed9050c416a92681ec1eb7b10b5` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:20:24.630357 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2ddbc-6405-45dc-888a-5ad526b35efb admin admin] RBAC: Authorizing `identity:delete_user(user_id=22b6eed9050c416a92681ec1eb7b10b5)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:20:24.632268 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2ddbc-6405-45dc-888a-5ad526b35efb admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:20:24.878115 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-68f2ddbc-6405-45dc-888a-5ad526b35efb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22b6eed9050c416a92681ec1eb7b10b5'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:20:24.878762 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-68f2ddbc-6405-45dc-888a-5ad526b35efb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22b6eed9050c416a92681ec1eb7b10b5'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:20:24.879425 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-68f2ddbc-6405-45dc-888a-5ad526b35efb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22b6eed9050c416a92681ec1eb7b10b5'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:20:24.891675 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-68f2ddbc-6405-45dc-888a-5ad526b35efb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22b6eed9050c416a92681ec1eb7b10b5'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:20:24.966947 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-68f2ddbc-6405-45dc-888a-5ad526b35efb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22b6eed9050c416a92681ec1eb7b10b5'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:20:24.980299 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1440/2860] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:20:24 2022] DELETE /identity/v3/users/22b6eed9050c416a92681ec1eb7b10b5 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:20:25.269368 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c0513-aca3-4084-8e6c-26bb4cfb5b73 service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:20:25.284198 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c0513-aca3-4084-8e6c-26bb4cfb5b73 service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:20:25.346009 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68512b7-f8f2-49a6-9fb1-df0701ab7872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:20:25.346655 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68512b7-f8f2-49a6-9fb1-df0701ab7872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:20:25.347002 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68512b7-f8f2-49a6-9fb1-df0701ab7872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:20:25.347226 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68512b7-f8f2-49a6-9fb1-df0701ab7872 admin admin] PATH_INFO: `/v3/projects/8d335e0b84ab4e4bba0a651afd80944d` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:20:25.348397 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68512b7-f8f2-49a6-9fb1-df0701ab7872 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d335e0b84ab4e4bba0a651afd80944d)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:20:25.350593 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68512b7-f8f2-49a6-9fb1-df0701ab7872 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:20:25.475916 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c68512b7-f8f2-49a6-9fb1-df0701ab7872 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d335e0b84ab4e4bba0a651afd80944d', 'request_id': 'req-c68512b7-f8f2-49a6-9fb1-df0701ab7872'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:20:25.481869 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c68512b7-f8f2-49a6-9fb1-df0701ab7872 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d335e0b84ab4e4bba0a651afd80944d', 'request_id': 'req-c68512b7-f8f2-49a6-9fb1-df0701ab7872'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:20:25.488034 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c68512b7-f8f2-49a6-9fb1-df0701ab7872 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d335e0b84ab4e4bba0a651afd80944d', 'request_id': 'req-c68512b7-f8f2-49a6-9fb1-df0701ab7872'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:20:25.572515 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c68512b7-f8f2-49a6-9fb1-df0701ab7872 admin admin] The token cache is being invalidate because project 8d335e0b84ab4e4bba0a651afd80944d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81717) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:20:25.572784 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c68512b7-f8f2-49a6-9fb1-df0701ab7872 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:20:25.573407 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-c68512b7-f8f2-49a6-9fb1-df0701ab7872 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:20:25.574875 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1421/2861] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:20:25 2022] DELETE /identity/v3/projects/8d335e0b84ab4e4bba0a651afd80944d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:20:25.579902 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9a7af-3f53-4602-b5e8-694dc7fcbf41 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:20:25.580190 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9a7af-3f53-4602-b5e8-694dc7fcbf41 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:20:25.580495 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9a7af-3f53-4602-b5e8-694dc7fcbf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:20:25.599489 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-4fe9a7af-3f53-4602-b5e8-694dc7fcbf41 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:20:25.600696 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-4fe9a7af-3f53-4602-b5e8-694dc7fcbf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:20:25.658589 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1441/2862] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:20:25.667901 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b05a2-d11b-4204-842d-d877b1c5c03f None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:20:25.668186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b05a2-d11b-4204-842d-d877b1c5c03f None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:20:25.668459 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b05a2-d11b-4204-842d-d877b1c5c03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:20:25.688357 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-de4b05a2-d11b-4204-842d-d877b1c5c03f None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:20:25.689574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-de4b05a2-d11b-4204-842d-d877b1c5c03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:20:25.698003 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1422/2863] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:20:25.702234 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9a7af-3f53-4602-b5e8-694dc7fcbf41 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:20:25.711909 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9a7af-3f53-4602-b5e8-694dc7fcbf41 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:20:25.716570 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd63cb-9f2b-479e-ab06-56608dd2b2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:20:25.717203 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd63cb-9f2b-479e-ab06-56608dd2b2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:20:25.717485 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd63cb-9f2b-479e-ab06-56608dd2b2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:20:25.717759 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd63cb-9f2b-479e-ab06-56608dd2b2d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:20:25.718410 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dd63cb-9f2b-479e-ab06-56608dd2b2d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81716) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:20:25.718713 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dd63cb-9f2b-479e-ab06-56608dd2b2d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:20:25.720300 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dd63cb-9f2b-479e-ab06-56608dd2b2d7 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:20:25.731765 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1442/2864] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:20:25.736048 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b05a2-d11b-4204-842d-d877b1c5c03f None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:20:25.746018 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b05a2-d11b-4204-842d-d877b1c5c03f None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:20:25.750892 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1a774-0bdd-4420-8e47-e6a23b617d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:20:25.751734 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1a774-0bdd-4420-8e47-e6a23b617d5f admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:20:25.752013 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1a774-0bdd-4420-8e47-e6a23b617d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:20:25.752287 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1a774-0bdd-4420-8e47-e6a23b617d5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:20:25.752941 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1a774-0bdd-4420-8e47-e6a23b617d5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:20:25.754836 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1a774-0bdd-4420-8e47-e6a23b617d5f admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:20:25.771078 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:20:25.857743 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1423/2865] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:20:25 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:20:25.861789 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd63cb-9f2b-479e-ab06-56608dd2b2d7 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:20:25.873234 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd63cb-9f2b-479e-ab06-56608dd2b2d7 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:20:25.918535 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:20:25.931777 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a7623-bab1-4bd9-963f-4579df8f68f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:20:25.932376 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a7623-bab1-4bd9-963f-4579df8f68f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:20:25.932699 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a7623-bab1-4bd9-963f-4579df8f68f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:20:25.932983 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a7623-bab1-4bd9-963f-4579df8f68f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:20:25.933595 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a7623-bab1-4bd9-963f-4579df8f68f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:20:25.935609 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a7623-bab1-4bd9-963f-4579df8f68f8 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:20:26.007151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1443/2866] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:20:25 2022] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:20:26.011518 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1a774-0bdd-4420-8e47-e6a23b617d5f admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:20:26.021931 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1a774-0bdd-4420-8e47-e6a23b617d5f admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:20:26.027085 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4ac05-abfa-40f3-848c-47a65e1bac16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:20:26.027685 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4ac05-abfa-40f3-848c-47a65e1bac16 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:20:26.027963 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4ac05-abfa-40f3-848c-47a65e1bac16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:20:26.028233 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4ac05-abfa-40f3-848c-47a65e1bac16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:20:26.028902 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4ac05-abfa-40f3-848c-47a65e1bac16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:20:26.030494 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4ac05-abfa-40f3-848c-47a65e1bac16 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:20:26.041955 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1424/2867] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:20:26.045957 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a7623-bab1-4bd9-963f-4579df8f68f8 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:20:26.056768 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a7623-bab1-4bd9-963f-4579df8f68f8 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:20:26.061538 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d8af8-85a5-47c2-a251-2ec2d376f1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:20:26.062161 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d8af8-85a5-47c2-a251-2ec2d376f1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:20:26.062440 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d8af8-85a5-47c2-a251-2ec2d376f1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:20:26.062714 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d8af8-85a5-47c2-a251-2ec2d376f1a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:20:26.063386 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d8af8-85a5-47c2-a251-2ec2d376f1a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:20:26.065032 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d8af8-85a5-47c2-a251-2ec2d376f1a8 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:20:26.075503 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1444/2868] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:20:26.079619 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4ac05-abfa-40f3-848c-47a65e1bac16 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:20:26.089666 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4ac05-abfa-40f3-848c-47a65e1bac16 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:20:26.094271 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde39a6e-159e-4496-95fd-ba413cbd36a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:20:26.094914 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde39a6e-159e-4496-95fd-ba413cbd36a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:20:26.095192 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde39a6e-159e-4496-95fd-ba413cbd36a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:20:26.095463 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde39a6e-159e-4496-95fd-ba413cbd36a6 admin admin] PATH_INFO: `/v3/projects/d411b8ef44c342b09e1dc2f78be5e42c/users/d272c0ae48454dacbcc4073c6ed89dd3/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:20:26.110240 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde39a6e-159e-4496-95fd-ba413cbd36a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d411b8ef44c342b09e1dc2f78be5e42c, user_id=d272c0ae48454dacbcc4073c6ed89dd3, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:20:26.112842 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde39a6e-159e-4496-95fd-ba413cbd36a6 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:20:26.210410 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1425/2869] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:20:26 2022] PUT /identity/v3/projects/d411b8ef44c342b09e1dc2f78be5e42c/users/d272c0ae48454dacbcc4073c6ed89dd3/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:20:26.215627 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75eabc-1ad2-41d8-927b-1543c8639759 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:20:26.215911 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75eabc-1ad2-41d8-927b-1543c8639759 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:20:26.216181 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75eabc-1ad2-41d8-927b-1543c8639759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:20:26.235481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-9d75eabc-1ad2-41d8-927b-1543c8639759 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:20:26.236715 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-9d75eabc-1ad2-41d8-927b-1543c8639759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:20:26.296811 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1445/2870] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:20:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:20:26.307152 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde39a6e-159e-4496-95fd-ba413cbd36a6 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:20:26.308953 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-fde39a6e-159e-4496-95fd-ba413cbd36a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:20:26.366133 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde39a6e-159e-4496-95fd-ba413cbd36a6 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:20:26.370717 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094b516-1d64-4019-b075-3e62c20a3abb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:20:26.371314 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094b516-1d64-4019-b075-3e62c20a3abb service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:20:26.371591 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094b516-1d64-4019-b075-3e62c20a3abb service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:20:26.371862 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094b516-1d64-4019-b075-3e62c20a3abb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:20:26.380998 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b094b516-1d64-4019-b075-3e62c20a3abb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:20:26.382409 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b094b516-1d64-4019-b075-3e62c20a3abb service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:20:26.392557 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1426/2871] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:20:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:20:27.505879 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82722e2-f152-426a-98d7-8aedca1f8217 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:20:27.506385 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82722e2-f152-426a-98d7-8aedca1f8217 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:20:27.506505 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82722e2-f152-426a-98d7-8aedca1f8217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:20:27.538078 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-e82722e2-f152-426a-98d7-8aedca1f8217 None None] MFA Rules not processed for user `d272c0ae48454dacbcc4073c6ed89dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:20:27.538865 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-e82722e2-f152-426a-98d7-8aedca1f8217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:20:27.607924 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1446/2872] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:20:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:20:27.612574 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094b516-1d64-4019-b075-3e62c20a3abb service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:20:27.622477 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094b516-1d64-4019-b075-3e62c20a3abb service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:20:27.627540 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f362f-3dff-450d-8092-9090989d23eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:20:27.628212 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f362f-3dff-450d-8092-9090989d23eb admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:20:27.628563 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f362f-3dff-450d-8092-9090989d23eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:20:27.628928 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f362f-3dff-450d-8092-9090989d23eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:20:27.629640 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f362f-3dff-450d-8092-9090989d23eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:20:27.631600 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f362f-3dff-450d-8092-9090989d23eb admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:20:27.729166 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1427/2873] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:20:27 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:20:27.733219 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82722e2-f152-426a-98d7-8aedca1f8217 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:20:27.743945 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82722e2-f152-426a-98d7-8aedca1f8217 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:20:27.793949 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:20:27.800755 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550a17f-5093-41aa-bfe4-f761398f23c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:20:27.801366 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550a17f-5093-41aa-bfe4-f761398f23c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:20:27.801647 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550a17f-5093-41aa-bfe4-f761398f23c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:20:27.801918 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550a17f-5093-41aa-bfe4-f761398f23c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:20:27.802540 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550a17f-5093-41aa-bfe4-f761398f23c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:20:27.804500 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550a17f-5093-41aa-bfe4-f761398f23c2 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:20:27.910439 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1447/2874] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:20:27 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:20:27.914395 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f362f-3dff-450d-8092-9090989d23eb admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:20:27.925036 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f362f-3dff-450d-8092-9090989d23eb admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:20:27.929602 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd70cbd-5056-4a0d-ae35-28fc6c34e91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:20:27.930197 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd70cbd-5056-4a0d-ae35-28fc6c34e91b admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:20:27.931067 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd70cbd-5056-4a0d-ae35-28fc6c34e91b admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:20:27.931467 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd70cbd-5056-4a0d-ae35-28fc6c34e91b admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:20:27.932330 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd70cbd-5056-4a0d-ae35-28fc6c34e91b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:20:27.933964 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd70cbd-5056-4a0d-ae35-28fc6c34e91b admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:20:27.944549 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1428/2875] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:20:27.949237 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550a17f-5093-41aa-bfe4-f761398f23c2 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:20:27.959765 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550a17f-5093-41aa-bfe4-f761398f23c2 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:20:27.964868 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057613ca-2032-4446-86f3-04a67b1b80e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:20:27.965525 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057613ca-2032-4446-86f3-04a67b1b80e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:20:27.965795 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057613ca-2032-4446-86f3-04a67b1b80e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:20:27.966064 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057613ca-2032-4446-86f3-04a67b1b80e5 admin admin] PATH_INFO: `/v3/projects/85c30619de9f422d8acf02216b012cfe/users/519b3b9cac14439bb87eb8ea4e307735/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:20:27.982060 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057613ca-2032-4446-86f3-04a67b1b80e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85c30619de9f422d8acf02216b012cfe, user_id=519b3b9cac14439bb87eb8ea4e307735, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:20:27.984911 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057613ca-2032-4446-86f3-04a67b1b80e5 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:20:28.057722 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1448/2876] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:20:27 2022] PUT /identity/v3/projects/85c30619de9f422d8acf02216b012cfe/users/519b3b9cac14439bb87eb8ea4e307735/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:20:28.061635 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd70cbd-5056-4a0d-ae35-28fc6c34e91b admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:20:28.072738 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd70cbd-5056-4a0d-ae35-28fc6c34e91b admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:20:28.129263 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae0020-86b1-47ac-a720-26f93fd1e8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:20:28.129872 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae0020-86b1-47ac-a720-26f93fd1e8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:20:28.130154 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae0020-86b1-47ac-a720-26f93fd1e8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:20:28.130427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae0020-86b1-47ac-a720-26f93fd1e8a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:20:28.131057 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae0020-86b1-47ac-a720-26f93fd1e8a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:20:28.132651 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae0020-86b1-47ac-a720-26f93fd1e8a5 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:20:28.143205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1429/2877] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:20:28.147389 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057613ca-2032-4446-86f3-04a67b1b80e5 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:20:28.157890 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057613ca-2032-4446-86f3-04a67b1b80e5 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:20:28.162496 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3655e-ad0a-45ec-bc00-e2c75ad6a02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:20:28.163146 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3655e-ad0a-45ec-bc00-e2c75ad6a02c admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:20:28.163547 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3655e-ad0a-45ec-bc00-e2c75ad6a02c admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:20:28.164442 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3655e-ad0a-45ec-bc00-e2c75ad6a02c admin admin] PATH_INFO: `/v3/projects/85c30619de9f422d8acf02216b012cfe/users/519b3b9cac14439bb87eb8ea4e307735/roles/c6745e08f9da4a2bae8510c9983635c3` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:20:28.167319 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3655e-ad0a-45ec-bc00-e2c75ad6a02c admin admin] RBAC: Authorizing `identity:create_grant(project_id=85c30619de9f422d8acf02216b012cfe, user_id=519b3b9cac14439bb87eb8ea4e307735, role_id=c6745e08f9da4a2bae8510c9983635c3)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:20:28.169991 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3655e-ad0a-45ec-bc00-e2c75ad6a02c admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:20:28.180076 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1449/2878] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:20:28 2022] PUT /identity/v3/projects/85c30619de9f422d8acf02216b012cfe/users/519b3b9cac14439bb87eb8ea4e307735/roles/c6745e08f9da4a2bae8510c9983635c3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:20:29.425928 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d6044-2069-4f31-ac99-6d05dc3a6663 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:20:29.426484 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d6044-2069-4f31-ac99-6d05dc3a6663 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:20:29.426484 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d6044-2069-4f31-ac99-6d05dc3a6663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:20:29.454780 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-797d6044-2069-4f31-ac99-6d05dc3a6663 None None] MFA Rules not processed for user `519b3b9cac14439bb87eb8ea4e307735`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:20:29.456014 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-797d6044-2069-4f31-ac99-6d05dc3a6663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:20:29.470027 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:20:29.526697 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1430/2879] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:20:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:20:29.538620 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e920c6-e05f-4d6a-b113-950ec954b1f1 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:20:29.539190 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e920c6-e05f-4d6a-b113-950ec954b1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:20:29.539190 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e920c6-e05f-4d6a-b113-950ec954b1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:20:29.561617 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-54e920c6-e05f-4d6a-b113-950ec954b1f1 None None] MFA Rules not processed for user `d272c0ae48454dacbcc4073c6ed89dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:20:29.562829 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-54e920c6-e05f-4d6a-b113-950ec954b1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:20:29.617364 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1450/2880] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:20:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:20:29.628706 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d6044-2069-4f31-ac99-6d05dc3a6663 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:20:29.630095 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-797d6044-2069-4f31-ac99-6d05dc3a6663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:20:29.704546 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d6044-2069-4f31-ac99-6d05dc3a6663 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:20:29.710425 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff1231-4471-47b7-974e-e2ad399effc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:20:29.711031 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff1231-4471-47b7-974e-e2ad399effc6 service nova] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:20:29.711309 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff1231-4471-47b7-974e-e2ad399effc6 service nova] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:20:29.711584 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff1231-4471-47b7-974e-e2ad399effc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:20:29.720458 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff1231-4471-47b7-974e-e2ad399effc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:20:29.722083 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff1231-4471-47b7-974e-e2ad399effc6 service nova] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:20:29.731469 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1431/2881] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:20:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:20:30.375078 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e920c6-e05f-4d6a-b113-950ec954b1f1 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:20:30.376784 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-54e920c6-e05f-4d6a-b113-950ec954b1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:20:30.447977 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e920c6-e05f-4d6a-b113-950ec954b1f1 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:20:30.453060 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e54c9-6955-469b-81b3-751187f5017e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6907dfd3254d3c97d07ca2fb648858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:20:30.453662 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e54c9-6955-469b-81b3-751187f5017e service placement] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:20:30.453947 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e54c9-6955-469b-81b3-751187f5017e service placement] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:20:30.454220 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e54c9-6955-469b-81b3-751187f5017e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:20:30.455932 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-a40e54c9-6955-469b-81b3-751187f5017e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:20:30.467846 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e54c9-6955-469b-81b3-751187f5017e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:20:30.469458 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e54c9-6955-469b-81b3-751187f5017e service placement] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:20:30.479342 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1451/2882] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:20:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:20:39.732646 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=56 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:20:40.475070 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=76,keystone:INSERT=5 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:20:41.888940 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff1231-4471-47b7-974e-e2ad399effc6 service nova] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:20:41.899887 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff1231-4471-47b7-974e-e2ad399effc6 service nova] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:20:41.905521 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d6b49-3e37-4169-8c73-7177578c2200 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f0d8fe42e74d68bfa9a0e365bab4b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:20:41.906210 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d6b49-3e37-4169-8c73-7177578c2200 service nova] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:20:41.906490 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d6b49-3e37-4169-8c73-7177578c2200 service nova] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:20:41.906763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d6b49-3e37-4169-8c73-7177578c2200 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:20:41.908485 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-c75d6b49-3e37-4169-8c73-7177578c2200 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:20:41.920844 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d6b49-3e37-4169-8c73-7177578c2200 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:20:41.922412 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d6b49-3e37-4169-8c73-7177578c2200 service nova] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:20:41.933417 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1432/2883] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:20:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:20:46.973405 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e54c9-6955-469b-81b3-751187f5017e service placement] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:20:46.974808 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-a40e54c9-6955-469b-81b3-751187f5017e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:20:47.031629 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e54c9-6955-469b-81b3-751187f5017e service placement] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:20:47.035521 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab0681-e6ab-455e-91a8-db07d8f24f65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:20:47.036118 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab0681-e6ab-455e-91a8-db07d8f24f65 service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:20:47.036397 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab0681-e6ab-455e-91a8-db07d8f24f65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:20:47.036725 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab0681-e6ab-455e-91a8-db07d8f24f65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:20:47.046732 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab0681-e6ab-455e-91a8-db07d8f24f65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:20:47.048151 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab0681-e6ab-455e-91a8-db07d8f24f65 service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:20:47.058363 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1452/2884] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:20:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:20:51.928590 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=6 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:20:57.053337 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=26 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:21:09.891068 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d6b49-3e37-4169-8c73-7177578c2200 service nova] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:09.892519 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-c75d6b49-3e37-4169-8c73-7177578c2200 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:21:09.958148 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d6b49-3e37-4169-8c73-7177578c2200 service nova] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:09.963387 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d62c2-172f-475e-ba15-3ada0cb10e28 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6907dfd3254d3c97d07ca2fb648858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:09.968368 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d62c2-172f-475e-ba15-3ada0cb10e28 service placement] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:09.968368 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d62c2-172f-475e-ba15-3ada0cb10e28 service placement] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:09.968368 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d62c2-172f-475e-ba15-3ada0cb10e28 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:09.968368 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-8c1d62c2-172f-475e-ba15-3ada0cb10e28 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:21:09.978208 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d62c2-172f-475e-ba15-3ada0cb10e28 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:09.979770 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d62c2-172f-475e-ba15-3ada0cb10e28 service placement] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:21:09.991056 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1433/2885] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:21:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:21:10.597300 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab0681-e6ab-455e-91a8-db07d8f24f65 service cinder] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:10.642375 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab0681-e6ab-455e-91a8-db07d8f24f65 service cinder] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:10.647657 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef7204-9aee-4b3e-b91b-3355ef5ea6e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6907dfd3254d3c97d07ca2fb648858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:10.648259 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef7204-9aee-4b3e-b91b-3355ef5ea6e8 service placement] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:10.648546 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef7204-9aee-4b3e-b91b-3355ef5ea6e8 service placement] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:10.648849 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef7204-9aee-4b3e-b91b-3355ef5ea6e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:10.650563 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-50ef7204-9aee-4b3e-b91b-3355ef5ea6e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:21:10.662479 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef7204-9aee-4b3e-b91b-3355ef5ea6e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:10.664036 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef7204-9aee-4b3e-b91b-3355ef5ea6e8 service placement] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:21:10.673817 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1453/2886] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:21:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:21:10.740095 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d62c2-172f-475e-ba15-3ada0cb10e28 service placement] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:10.827294 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d62c2-172f-475e-ba15-3ada0cb10e28 service placement] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:10.831922 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded9c42-0660-4bec-a680-93aaa9bbe955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:10.832548 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded9c42-0660-4bec-a680-93aaa9bbe955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:10.832864 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded9c42-0660-4bec-a680-93aaa9bbe955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:10.833166 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded9c42-0660-4bec-a680-93aaa9bbe955 admin admin] PATH_INFO: `/v3/users/d272c0ae48454dacbcc4073c6ed89dd3` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:10.834281 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded9c42-0660-4bec-a680-93aaa9bbe955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d272c0ae48454dacbcc4073c6ed89dd3)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:10.836264 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded9c42-0660-4bec-a680-93aaa9bbe955 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:21:11.071098 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-6ded9c42-0660-4bec-a680-93aaa9bbe955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd272c0ae48454dacbcc4073c6ed89dd3'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:11.071777 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-6ded9c42-0660-4bec-a680-93aaa9bbe955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd272c0ae48454dacbcc4073c6ed89dd3'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:11.072485 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-6ded9c42-0660-4bec-a680-93aaa9bbe955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd272c0ae48454dacbcc4073c6ed89dd3'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:11.130814 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-6ded9c42-0660-4bec-a680-93aaa9bbe955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd272c0ae48454dacbcc4073c6ed89dd3'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:11.138804 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-6ded9c42-0660-4bec-a680-93aaa9bbe955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd272c0ae48454dacbcc4073c6ed89dd3'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:11.152905 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:21:11.157181 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1434/2887] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:21:10 2022] DELETE /identity/v3/users/d272c0ae48454dacbcc4073c6ed89dd3 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:21:11.422102 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef7204-9aee-4b3e-b91b-3355ef5ea6e8 service placement] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:11.436869 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef7204-9aee-4b3e-b91b-3355ef5ea6e8 service placement] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:11.493932 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9b42c-4926-4fbe-bd50-9374164332d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:11.494550 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9b42c-4926-4fbe-bd50-9374164332d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:11.494836 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9b42c-4926-4fbe-bd50-9374164332d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:11.495102 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9b42c-4926-4fbe-bd50-9374164332d9 admin admin] PATH_INFO: `/v3/projects/d411b8ef44c342b09e1dc2f78be5e42c` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:11.496750 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9b42c-4926-4fbe-bd50-9374164332d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d411b8ef44c342b09e1dc2f78be5e42c)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:11.498638 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9b42c-4926-4fbe-bd50-9374164332d9 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:21:11.603716 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-49a9b42c-4926-4fbe-bd50-9374164332d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd411b8ef44c342b09e1dc2f78be5e42c', 'request_id': 'req-49a9b42c-4926-4fbe-bd50-9374164332d9'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:11.679596 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-49a9b42c-4926-4fbe-bd50-9374164332d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd411b8ef44c342b09e1dc2f78be5e42c', 'request_id': 'req-49a9b42c-4926-4fbe-bd50-9374164332d9'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:11.686612 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-49a9b42c-4926-4fbe-bd50-9374164332d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd411b8ef44c342b09e1dc2f78be5e42c', 'request_id': 'req-49a9b42c-4926-4fbe-bd50-9374164332d9'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:11.708596 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-49a9b42c-4926-4fbe-bd50-9374164332d9 admin admin] The token cache is being invalidate because project d411b8ef44c342b09e1dc2f78be5e42c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:21:11.708909 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-49a9b42c-4926-4fbe-bd50-9374164332d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:11.709532 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-49a9b42c-4926-4fbe-bd50-9374164332d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:11.710984 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1454/2888] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:21:11 2022] DELETE /identity/v3/projects/d411b8ef44c342b09e1dc2f78be5e42c => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:21:11.715162 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded9c42-0660-4bec-a680-93aaa9bbe955 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:11.716562 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-6ded9c42-0660-4bec-a680-93aaa9bbe955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:21:11.729281 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded9c42-0660-4bec-a680-93aaa9bbe955 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:11.785827 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea115a29-2c0d-478c-9545-7a598a976839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:11.786448 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea115a29-2c0d-478c-9545-7a598a976839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:11.786724 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea115a29-2c0d-478c-9545-7a598a976839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:11.786991 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea115a29-2c0d-478c-9545-7a598a976839 admin admin] PATH_INFO: `/v3/users/519b3b9cac14439bb87eb8ea4e307735` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:11.788095 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea115a29-2c0d-478c-9545-7a598a976839 admin admin] RBAC: Authorizing `identity:delete_user(user_id=519b3b9cac14439bb87eb8ea4e307735)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:11.790069 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea115a29-2c0d-478c-9545-7a598a976839 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:21:11.968282 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-ea115a29-2c0d-478c-9545-7a598a976839 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '519b3b9cac14439bb87eb8ea4e307735'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:11.969201 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-ea115a29-2c0d-478c-9545-7a598a976839 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '519b3b9cac14439bb87eb8ea4e307735'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:11.969815 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-ea115a29-2c0d-478c-9545-7a598a976839 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '519b3b9cac14439bb87eb8ea4e307735'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:12.033928 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-ea115a29-2c0d-478c-9545-7a598a976839 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '519b3b9cac14439bb87eb8ea4e307735'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:12.041396 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-ea115a29-2c0d-478c-9545-7a598a976839 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '519b3b9cac14439bb87eb8ea4e307735'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:12.060141 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1435/2889] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:21:11 2022] DELETE /identity/v3/users/519b3b9cac14439bb87eb8ea4e307735 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:21:12.350251 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9b42c-4926-4fbe-bd50-9374164332d9 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:12.351761 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-49a9b42c-4926-4fbe-bd50-9374164332d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:21:12.366680 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9b42c-4926-4fbe-bd50-9374164332d9 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:12.399316 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:21:12.423226 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e5d9f-8c5b-4115-8781-0afb3b485e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:12.423852 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e5d9f-8c5b-4115-8781-0afb3b485e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:12.424138 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e5d9f-8c5b-4115-8781-0afb3b485e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:12.424430 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e5d9f-8c5b-4115-8781-0afb3b485e8c admin admin] PATH_INFO: `/v3/projects/85c30619de9f422d8acf02216b012cfe` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:12.425584 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e5d9f-8c5b-4115-8781-0afb3b485e8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=85c30619de9f422d8acf02216b012cfe)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:12.427473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e5d9f-8c5b-4115-8781-0afb3b485e8c admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:21:12.589360 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-102e5d9f-8c5b-4115-8781-0afb3b485e8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85c30619de9f422d8acf02216b012cfe', 'request_id': 'req-102e5d9f-8c5b-4115-8781-0afb3b485e8c'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:12.689021 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-102e5d9f-8c5b-4115-8781-0afb3b485e8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85c30619de9f422d8acf02216b012cfe', 'request_id': 'req-102e5d9f-8c5b-4115-8781-0afb3b485e8c'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:12.695481 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-102e5d9f-8c5b-4115-8781-0afb3b485e8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85c30619de9f422d8acf02216b012cfe', 'request_id': 'req-102e5d9f-8c5b-4115-8781-0afb3b485e8c'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:12.708557 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-102e5d9f-8c5b-4115-8781-0afb3b485e8c admin admin] The token cache is being invalidate because project 85c30619de9f422d8acf02216b012cfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:21:12.711336 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-102e5d9f-8c5b-4115-8781-0afb3b485e8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:12.712048 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-102e5d9f-8c5b-4115-8781-0afb3b485e8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:12.713678 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1455/2890] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:21:12 2022] DELETE /identity/v3/projects/85c30619de9f422d8acf02216b012cfe => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:21:12.718785 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f4b85-c8dc-44bc-9433-5a41915dc1b3 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:12.719272 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f4b85-c8dc-44bc-9433-5a41915dc1b3 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:12.719383 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f4b85-c8dc-44bc-9433-5a41915dc1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:12.777051 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-338f4b85-c8dc-44bc-9433-5a41915dc1b3 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:21:12.778293 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-338f4b85-c8dc-44bc-9433-5a41915dc1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:21:12.821066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:21:12.837033 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1436/2891] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:21:12.844777 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a65af9-f934-4961-aea9-2c0d09cfd388 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:12.844995 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a65af9-f934-4961-aea9-2c0d09cfd388 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:12.845271 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a65af9-f934-4961-aea9-2c0d09cfd388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:12.864880 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-d4a65af9-f934-4961-aea9-2c0d09cfd388 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:21:12.866078 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-d4a65af9-f934-4961-aea9-2c0d09cfd388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:21:12.874585 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1456/2892] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:21:12.879161 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f4b85-c8dc-44bc-9433-5a41915dc1b3 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:12.888896 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f4b85-c8dc-44bc-9433-5a41915dc1b3 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:12.894302 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122f55a-1d1d-4fb5-9028-83d7d8a93aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:12.895007 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122f55a-1d1d-4fb5-9028-83d7d8a93aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:12.895288 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122f55a-1d1d-4fb5-9028-83d7d8a93aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:12.895592 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122f55a-1d1d-4fb5-9028-83d7d8a93aa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:12.896238 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122f55a-1d1d-4fb5-9028-83d7d8a93aa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:21:12.896544 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122f55a-1d1d-4fb5-9028-83d7d8a93aa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:12.898233 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122f55a-1d1d-4fb5-9028-83d7d8a93aa1 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:21:12.909871 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1437/2893] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:21:12.914156 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a65af9-f934-4961-aea9-2c0d09cfd388 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:12.923461 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a65af9-f934-4961-aea9-2c0d09cfd388 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:12.928109 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de75b0-9245-46f6-92f6-c1119d6dfec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:12.928732 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de75b0-9245-46f6-92f6-c1119d6dfec0 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:12.929011 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de75b0-9245-46f6-92f6-c1119d6dfec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:12.929279 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de75b0-9245-46f6-92f6-c1119d6dfec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:12.929891 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de75b0-9245-46f6-92f6-c1119d6dfec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:12.931794 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de75b0-9245-46f6-92f6-c1119d6dfec0 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:21:13.014805 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1457/2894] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:21:12 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:21:13.025338 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122f55a-1d1d-4fb5-9028-83d7d8a93aa1 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:13.037878 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122f55a-1d1d-4fb5-9028-83d7d8a93aa1 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:13.097404 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dda782-7841-462b-a9e0-cb789e088173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:13.097939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dda782-7841-462b-a9e0-cb789e088173 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:13.098225 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dda782-7841-462b-a9e0-cb789e088173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:13.098508 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dda782-7841-462b-a9e0-cb789e088173 admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:13.099139 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dda782-7841-462b-a9e0-cb789e088173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:13.101160 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dda782-7841-462b-a9e0-cb789e088173 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:21:13.188995 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1438/2895] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:21:13 2022] POST /identity/v3/users => generated 288 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:21:13.194940 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de75b0-9245-46f6-92f6-c1119d6dfec0 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:13.205625 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de75b0-9245-46f6-92f6-c1119d6dfec0 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:13.210881 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf8bc5-6358-4e11-8d53-1464dc54eab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:13.211478 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf8bc5-6358-4e11-8d53-1464dc54eab5 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:13.211760 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf8bc5-6358-4e11-8d53-1464dc54eab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:13.212027 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf8bc5-6358-4e11-8d53-1464dc54eab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:13.212696 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf8bc5-6358-4e11-8d53-1464dc54eab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:13.214291 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf8bc5-6358-4e11-8d53-1464dc54eab5 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:21:13.224721 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1458/2896] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:21:13.229244 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dda782-7841-462b-a9e0-cb789e088173 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:13.240911 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dda782-7841-462b-a9e0-cb789e088173 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:13.245850 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda96fd9-49ae-4bd4-9a8f-aff87ce13e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:13.250207 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda96fd9-49ae-4bd4-9a8f-aff87ce13e5b admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:13.250207 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda96fd9-49ae-4bd4-9a8f-aff87ce13e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:13.250207 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda96fd9-49ae-4bd4-9a8f-aff87ce13e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:13.250207 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda96fd9-49ae-4bd4-9a8f-aff87ce13e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:13.250635 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda96fd9-49ae-4bd4-9a8f-aff87ce13e5b admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:21:13.262748 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1439/2897] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:21:13.267299 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf8bc5-6358-4e11-8d53-1464dc54eab5 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:13.277795 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf8bc5-6358-4e11-8d53-1464dc54eab5 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:13.283906 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520575e-4963-4fcd-85b2-c256379b783c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:13.284937 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520575e-4963-4fcd-85b2-c256379b783c admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:13.285213 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520575e-4963-4fcd-85b2-c256379b783c admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:13.285498 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520575e-4963-4fcd-85b2-c256379b783c admin admin] PATH_INFO: `/v3/projects/102732b85d694c1c87099e71d71e596a/users/0c99d0007ca6409a843c74eda3dd8d50/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:13.313176 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520575e-4963-4fcd-85b2-c256379b783c admin admin] RBAC: Authorizing `identity:create_grant(project_id=102732b85d694c1c87099e71d71e596a, user_id=0c99d0007ca6409a843c74eda3dd8d50, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:13.313176 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520575e-4963-4fcd-85b2-c256379b783c admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:21:13.429469 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1459/2898] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:21:13 2022] PUT /identity/v3/projects/102732b85d694c1c87099e71d71e596a/users/0c99d0007ca6409a843c74eda3dd8d50/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:21:13.441125 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42a7c3-37dd-400a-ab14-4e62fea4be0a None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:13.441409 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42a7c3-37dd-400a-ab14-4e62fea4be0a None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:13.441720 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42a7c3-37dd-400a-ab14-4e62fea4be0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:13.472833 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-9e42a7c3-37dd-400a-ab14-4e62fea4be0a None None] MFA Rules not processed for user `0c99d0007ca6409a843c74eda3dd8d50`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:21:13.474066 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-9e42a7c3-37dd-400a-ab14-4e62fea4be0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:21:13.541280 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1440/2899] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:21:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:21:13.555205 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520575e-4963-4fcd-85b2-c256379b783c admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:13.556900 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-2520575e-4963-4fcd-85b2-c256379b783c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:21:13.631005 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:21:13.640451 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520575e-4963-4fcd-85b2-c256379b783c admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:13.644873 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee310ab9-26b8-48b7-8d39-783e9e9fa9c3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21fda517a384dc5a6a9f36d68ac1a2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:13.645471 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee310ab9-26b8-48b7-8d39-783e9e9fa9c3 service glance] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:13.645747 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee310ab9-26b8-48b7-8d39-783e9e9fa9c3 service glance] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:13.646014 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee310ab9-26b8-48b7-8d39-783e9e9fa9c3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:13.655934 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee310ab9-26b8-48b7-8d39-783e9e9fa9c3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:13.657489 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee310ab9-26b8-48b7-8d39-783e9e9fa9c3 service glance] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:21:13.667605 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1460/2900] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:21:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:21:23.538355 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=77,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:21:23.725881 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=7 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:21:32.902166 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42a7c3-37dd-400a-ab14-4e62fea4be0a None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:32.963868 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42a7c3-37dd-400a-ab14-4e62fea4be0a None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:32.968385 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ee9b2-1cc6-4036-9de2-57d6c31c92e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:32.969102 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ee9b2-1cc6-4036-9de2-57d6c31c92e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:32.969381 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ee9b2-1cc6-4036-9de2-57d6c31c92e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:32.969653 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ee9b2-1cc6-4036-9de2-57d6c31c92e6 admin admin] PATH_INFO: `/v3/users/0c99d0007ca6409a843c74eda3dd8d50` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:32.970786 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ee9b2-1cc6-4036-9de2-57d6c31c92e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c99d0007ca6409a843c74eda3dd8d50)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:32.972804 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ee9b2-1cc6-4036-9de2-57d6c31c92e6 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:21:33.189680 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-525ee9b2-1cc6-4036-9de2-57d6c31c92e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c99d0007ca6409a843c74eda3dd8d50'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:33.190331 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-525ee9b2-1cc6-4036-9de2-57d6c31c92e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c99d0007ca6409a843c74eda3dd8d50'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:33.190944 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-525ee9b2-1cc6-4036-9de2-57d6c31c92e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c99d0007ca6409a843c74eda3dd8d50'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:33.283363 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-525ee9b2-1cc6-4036-9de2-57d6c31c92e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c99d0007ca6409a843c74eda3dd8d50'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:33.290768 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-525ee9b2-1cc6-4036-9de2-57d6c31c92e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c99d0007ca6409a843c74eda3dd8d50'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:33.309428 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1441/2901] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:21:32 2022] DELETE /identity/v3/users/0c99d0007ca6409a843c74eda3dd8d50 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:21:33.313958 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b9005-6a0f-40cd-a3b6-75e6454cd8a7 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:33.314424 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b9005-6a0f-40cd-a3b6-75e6454cd8a7 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:33.314570 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b9005-6a0f-40cd-a3b6-75e6454cd8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:33.334169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-ee0b9005-6a0f-40cd-a3b6-75e6454cd8a7 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:21:33.336367 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-ee0b9005-6a0f-40cd-a3b6-75e6454cd8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:21:33.394504 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1461/2902] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:21:33.404454 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ee9b2-1cc6-4036-9de2-57d6c31c92e6 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:33.405900 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-525ee9b2-1cc6-4036-9de2-57d6c31c92e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:21:33.484448 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ee9b2-1cc6-4036-9de2-57d6c31c92e6 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:33.488044 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971b726-92aa-41cd-91cb-aa541bf17e86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:33.488674 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971b726-92aa-41cd-91cb-aa541bf17e86 service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:33.488956 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971b726-92aa-41cd-91cb-aa541bf17e86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:33.489226 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971b726-92aa-41cd-91cb-aa541bf17e86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:33.498763 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3971b726-92aa-41cd-91cb-aa541bf17e86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:33.500452 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3971b726-92aa-41cd-91cb-aa541bf17e86 service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:21:33.510756 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1442/2903] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:21:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:21:33.960397 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b9005-6a0f-40cd-a3b6-75e6454cd8a7 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:33.962053 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-ee0b9005-6a0f-40cd-a3b6-75e6454cd8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:21:33.974213 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b9005-6a0f-40cd-a3b6-75e6454cd8a7 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:33.980258 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e862e16-7f79-431b-9915-1d18dea0e05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:33.981837 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e862e16-7f79-431b-9915-1d18dea0e05f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:33.982471 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e862e16-7f79-431b-9915-1d18dea0e05f admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:33.982749 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e862e16-7f79-431b-9915-1d18dea0e05f admin admin] PATH_INFO: `/v3/projects/102732b85d694c1c87099e71d71e596a` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:33.983925 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e862e16-7f79-431b-9915-1d18dea0e05f admin admin] RBAC: Authorizing `identity:delete_project(project_id=102732b85d694c1c87099e71d71e596a)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:33.986754 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e862e16-7f79-431b-9915-1d18dea0e05f admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:21:34.094579 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-6e862e16-7f79-431b-9915-1d18dea0e05f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '102732b85d694c1c87099e71d71e596a', 'request_id': 'req-6e862e16-7f79-431b-9915-1d18dea0e05f'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:34.174152 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-6e862e16-7f79-431b-9915-1d18dea0e05f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '102732b85d694c1c87099e71d71e596a', 'request_id': 'req-6e862e16-7f79-431b-9915-1d18dea0e05f'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:34.181864 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-6e862e16-7f79-431b-9915-1d18dea0e05f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '102732b85d694c1c87099e71d71e596a', 'request_id': 'req-6e862e16-7f79-431b-9915-1d18dea0e05f'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:34.193996 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-6e862e16-7f79-431b-9915-1d18dea0e05f admin admin] The token cache is being invalidate because project 102732b85d694c1c87099e71d71e596a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:21:34.194424 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-6e862e16-7f79-431b-9915-1d18dea0e05f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:34.195320 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-6e862e16-7f79-431b-9915-1d18dea0e05f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:34.197361 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1462/2904] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:21:33 2022] DELETE /identity/v3/projects/102732b85d694c1c87099e71d71e596a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:21:34.202429 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4886480-87e1-4db8-80a5-85aa1c5ef909 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:34.202906 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4886480-87e1-4db8-80a5-85aa1c5ef909 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:34.203164 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4886480-87e1-4db8-80a5-85aa1c5ef909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:34.212187 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:21:34.223990 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-e4886480-87e1-4db8-80a5-85aa1c5ef909 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:21:34.225253 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-e4886480-87e1-4db8-80a5-85aa1c5ef909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:21:34.285899 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1443/2905] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:21:34.294386 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cef50-ed04-4e83-9efa-3a9da0f3c368 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:34.297657 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cef50-ed04-4e83-9efa-3a9da0f3c368 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:34.297657 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cef50-ed04-4e83-9efa-3a9da0f3c368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:34.315396 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-0b4cef50-ed04-4e83-9efa-3a9da0f3c368 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:21:34.316721 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-0b4cef50-ed04-4e83-9efa-3a9da0f3c368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:21:34.324775 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1463/2906] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:21:34.329059 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4886480-87e1-4db8-80a5-85aa1c5ef909 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:34.339036 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4886480-87e1-4db8-80a5-85aa1c5ef909 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:34.343615 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200772e-3c66-4fd7-9565-1bd84131c4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:34.344205 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200772e-3c66-4fd7-9565-1bd84131c4ae admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:34.344483 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200772e-3c66-4fd7-9565-1bd84131c4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:34.344787 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200772e-3c66-4fd7-9565-1bd84131c4ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:34.345430 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200772e-3c66-4fd7-9565-1bd84131c4ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:21:34.345730 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200772e-3c66-4fd7-9565-1bd84131c4ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:34.347322 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200772e-3c66-4fd7-9565-1bd84131c4ae admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:21:34.359382 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1444/2907] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:21:34.363511 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cef50-ed04-4e83-9efa-3a9da0f3c368 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:34.373699 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cef50-ed04-4e83-9efa-3a9da0f3c368 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:34.378542 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b06d57-08af-42a6-bc66-43fff530880d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:34.379127 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b06d57-08af-42a6-bc66-43fff530880d admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:34.379400 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b06d57-08af-42a6-bc66-43fff530880d admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:34.379667 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b06d57-08af-42a6-bc66-43fff530880d admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:34.380285 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b06d57-08af-42a6-bc66-43fff530880d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:34.382222 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b06d57-08af-42a6-bc66-43fff530880d admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:21:34.463371 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1464/2908] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:21:34 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:21:34.467602 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200772e-3c66-4fd7-9565-1bd84131c4ae admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:34.478295 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200772e-3c66-4fd7-9565-1bd84131c4ae admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:34.536495 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e9057-c148-4e8e-be28-2e463ba56abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:34.537073 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e9057-c148-4e8e-be28-2e463ba56abf admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:34.537352 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e9057-c148-4e8e-be28-2e463ba56abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:34.537623 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e9057-c148-4e8e-be28-2e463ba56abf admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:34.538248 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e9057-c148-4e8e-be28-2e463ba56abf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:34.541063 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e9057-c148-4e8e-be28-2e463ba56abf admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:21:34.625859 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1445/2909] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:21:34 2022] POST /identity/v3/users => generated 288 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:21:34.629918 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b06d57-08af-42a6-bc66-43fff530880d admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:34.640850 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b06d57-08af-42a6-bc66-43fff530880d admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:34.645474 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d5967-9159-4479-a332-3f7686732602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:34.646065 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d5967-9159-4479-a332-3f7686732602 admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:34.646344 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d5967-9159-4479-a332-3f7686732602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:34.646619 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d5967-9159-4479-a332-3f7686732602 admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:34.647262 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d5967-9159-4479-a332-3f7686732602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:34.649661 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d5967-9159-4479-a332-3f7686732602 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:21:34.659373 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1465/2910] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:21:34.664460 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e9057-c148-4e8e-be28-2e463ba56abf admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:34.674202 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e9057-c148-4e8e-be28-2e463ba56abf admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:34.678867 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9471a7-8f53-4792-9c93-a92c22ba718f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:34.679465 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9471a7-8f53-4792-9c93-a92c22ba718f admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:34.679744 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9471a7-8f53-4792-9c93-a92c22ba718f admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:34.680021 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9471a7-8f53-4792-9c93-a92c22ba718f admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:34.680693 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9471a7-8f53-4792-9c93-a92c22ba718f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:34.682284 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9471a7-8f53-4792-9c93-a92c22ba718f admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:21:34.692845 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1446/2911] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:21:34.697096 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d5967-9159-4479-a332-3f7686732602 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:34.707027 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d5967-9159-4479-a332-3f7686732602 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:34.712138 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600831e-f590-4a5a-9417-bf630e6974d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:34.712811 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600831e-f590-4a5a-9417-bf630e6974d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:34.713092 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600831e-f590-4a5a-9417-bf630e6974d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:34.713363 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600831e-f590-4a5a-9417-bf630e6974d9 admin admin] PATH_INFO: `/v3/projects/521f2f1c28914f989ae3a33ab9bab0ae/users/a41709059c474472a3d0415a3bf55106/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:34.727996 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600831e-f590-4a5a-9417-bf630e6974d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=521f2f1c28914f989ae3a33ab9bab0ae, user_id=a41709059c474472a3d0415a3bf55106, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:34.730640 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600831e-f590-4a5a-9417-bf630e6974d9 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:21:34.794508 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1466/2912] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:21:34 2022] PUT /identity/v3/projects/521f2f1c28914f989ae3a33ab9bab0ae/users/a41709059c474472a3d0415a3bf55106/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:21:34.860457 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c6be6-5b8b-43d7-ab44-fa8c067949c7 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:34.861064 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c6be6-5b8b-43d7-ab44-fa8c067949c7 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:34.861346 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c6be6-5b8b-43d7-ab44-fa8c067949c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:34.889868 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-4c1c6be6-5b8b-43d7-ab44-fa8c067949c7 None None] MFA Rules not processed for user `a41709059c474472a3d0415a3bf55106`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:21:34.891064 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-4c1c6be6-5b8b-43d7-ab44-fa8c067949c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:21:34.950000 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:21:34.955276 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1447/2913] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:21:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:21:34.969515 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600831e-f590-4a5a-9417-bf630e6974d9 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:34.971339 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-5600831e-f590-4a5a-9417-bf630e6974d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:21:34.994381 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:21:35.050534 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600831e-f590-4a5a-9417-bf630e6974d9 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:35.051591 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62b6e2-fafa-43d7-91a1-fcc96a9a61ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:35.052184 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62b6e2-fafa-43d7-91a1-fcc96a9a61ce service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:35.052460 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62b6e2-fafa-43d7-91a1-fcc96a9a61ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:35.052769 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62b6e2-fafa-43d7-91a1-fcc96a9a61ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:35.061062 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62b6e2-fafa-43d7-91a1-fcc96a9a61ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:35.062621 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62b6e2-fafa-43d7-91a1-fcc96a9a61ce service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:21:35.072153 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1467/2914] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:21:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:21:45.067761 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:21:45.155507 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=26 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:21:52.001370 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c6be6-5b8b-43d7-ab44-fa8c067949c7 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:52.064819 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c6be6-5b8b-43d7-ab44-fa8c067949c7 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:52.069316 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e0b9b-4534-4a9c-bf77-fd9024edcf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:52.069939 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e0b9b-4534-4a9c-bf77-fd9024edcf73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:52.070218 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e0b9b-4534-4a9c-bf77-fd9024edcf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:52.070491 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e0b9b-4534-4a9c-bf77-fd9024edcf73 admin admin] PATH_INFO: `/v3/users/a41709059c474472a3d0415a3bf55106` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:52.071607 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e0b9b-4534-4a9c-bf77-fd9024edcf73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a41709059c474472a3d0415a3bf55106)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:52.073596 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e0b9b-4534-4a9c-bf77-fd9024edcf73 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:21:52.263698 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-b09e0b9b-4534-4a9c-bf77-fd9024edcf73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a41709059c474472a3d0415a3bf55106'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:52.264368 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-b09e0b9b-4534-4a9c-bf77-fd9024edcf73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a41709059c474472a3d0415a3bf55106'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:52.265083 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-b09e0b9b-4534-4a9c-bf77-fd9024edcf73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a41709059c474472a3d0415a3bf55106'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:52.324190 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-b09e0b9b-4534-4a9c-bf77-fd9024edcf73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a41709059c474472a3d0415a3bf55106'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:52.331858 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-b09e0b9b-4534-4a9c-bf77-fd9024edcf73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a41709059c474472a3d0415a3bf55106'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:52.349409 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1448/2915] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:21:52 2022] DELETE /identity/v3/users/a41709059c474472a3d0415a3bf55106 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:21:52.354030 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffacd3-d7f2-4ed5-8a9d-c73081c8a587 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:52.355232 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffacd3-d7f2-4ed5-8a9d-c73081c8a587 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:52.355232 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffacd3-d7f2-4ed5-8a9d-c73081c8a587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:52.374412 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-50ffacd3-d7f2-4ed5-8a9d-c73081c8a587 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:21:52.375609 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-50ffacd3-d7f2-4ed5-8a9d-c73081c8a587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:21:52.433561 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1468/2916] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:21:52.443315 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e0b9b-4534-4a9c-bf77-fd9024edcf73 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:52.444767 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-b09e0b9b-4534-4a9c-bf77-fd9024edcf73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:21:52.502750 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e0b9b-4534-4a9c-bf77-fd9024edcf73 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:52.506371 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90657b87-10ae-49eb-9553-ccc3038cb06a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:52.506963 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90657b87-10ae-49eb-9553-ccc3038cb06a service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:52.507238 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90657b87-10ae-49eb-9553-ccc3038cb06a service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:52.507505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90657b87-10ae-49eb-9553-ccc3038cb06a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:52.517382 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90657b87-10ae-49eb-9553-ccc3038cb06a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:52.518738 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90657b87-10ae-49eb-9553-ccc3038cb06a service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:21:52.528926 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1449/2917] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:21:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:21:52.946898 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ffacd3-d7f2-4ed5-8a9d-c73081c8a587 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:52.949051 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-50ffacd3-d7f2-4ed5-8a9d-c73081c8a587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:21:52.961417 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ffacd3-d7f2-4ed5-8a9d-c73081c8a587 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:52.966740 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb945d4-190d-41b8-9fa2-edb4fd17d5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:52.967461 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb945d4-190d-41b8-9fa2-edb4fd17d5cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:52.967762 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb945d4-190d-41b8-9fa2-edb4fd17d5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:52.968032 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb945d4-190d-41b8-9fa2-edb4fd17d5cb admin admin] PATH_INFO: `/v3/projects/521f2f1c28914f989ae3a33ab9bab0ae` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:52.969930 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb945d4-190d-41b8-9fa2-edb4fd17d5cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=521f2f1c28914f989ae3a33ab9bab0ae)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:52.971985 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb945d4-190d-41b8-9fa2-edb4fd17d5cb admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:21:53.111747 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-6eb945d4-190d-41b8-9fa2-edb4fd17d5cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '521f2f1c28914f989ae3a33ab9bab0ae', 'request_id': 'req-6eb945d4-190d-41b8-9fa2-edb4fd17d5cb'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:53.185296 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-6eb945d4-190d-41b8-9fa2-edb4fd17d5cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '521f2f1c28914f989ae3a33ab9bab0ae', 'request_id': 'req-6eb945d4-190d-41b8-9fa2-edb4fd17d5cb'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:53.191828 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-6eb945d4-190d-41b8-9fa2-edb4fd17d5cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '521f2f1c28914f989ae3a33ab9bab0ae', 'request_id': 'req-6eb945d4-190d-41b8-9fa2-edb4fd17d5cb'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:53.204455 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-6eb945d4-190d-41b8-9fa2-edb4fd17d5cb admin admin] The token cache is being invalidate because project 521f2f1c28914f989ae3a33ab9bab0ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:21:53.204455 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-6eb945d4-190d-41b8-9fa2-edb4fd17d5cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:53.204455 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-6eb945d4-190d-41b8-9fa2-edb4fd17d5cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:21:53.205383 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1469/2918] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:21:52 2022] DELETE /identity/v3/projects/521f2f1c28914f989ae3a33ab9bab0ae => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:21:53.211388 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cd634-e7df-4c79-9567-d8620631bfbb None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:53.211922 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cd634-e7df-4c79-9567-d8620631bfbb None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:53.212025 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cd634-e7df-4c79-9567-d8620631bfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:53.232481 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-4d4cd634-e7df-4c79-9567-d8620631bfbb None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:21:53.233785 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-4d4cd634-e7df-4c79-9567-d8620631bfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:21:53.251834 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:21:53.296206 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1450/2919] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:21:53.303994 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743408b-dad4-46a2-8fe2-8c375a0313ba None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:53.304301 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743408b-dad4-46a2-8fe2-8c375a0313ba None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:53.304575 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743408b-dad4-46a2-8fe2-8c375a0313ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:53.324814 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-8743408b-dad4-46a2-8fe2-8c375a0313ba None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:21:53.327946 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-8743408b-dad4-46a2-8fe2-8c375a0313ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:21:53.334065 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1470/2920] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:21:53.338363 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4cd634-e7df-4c79-9567-d8620631bfbb None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:53.348933 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4cd634-e7df-4c79-9567-d8620631bfbb None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:53.353813 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7aea0-b362-426e-ba43-207042da1352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:53.354471 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7aea0-b362-426e-ba43-207042da1352 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:53.354832 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7aea0-b362-426e-ba43-207042da1352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:53.355121 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7aea0-b362-426e-ba43-207042da1352 admin admin] PATH_INFO: `/v3/domains` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:53.355816 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7aea0-b362-426e-ba43-207042da1352 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81717) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:21:53.356118 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7aea0-b362-426e-ba43-207042da1352 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:53.357748 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7aea0-b362-426e-ba43-207042da1352 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:21:53.369543 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1451/2921] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 24 16:21:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:21:53.374180 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743408b-dad4-46a2-8fe2-8c375a0313ba None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:53.383544 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743408b-dad4-46a2-8fe2-8c375a0313ba None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:53.388922 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1625a2-8647-42cc-b484-10e40f20b037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:53.391014 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1625a2-8647-42cc-b484-10e40f20b037 admin admin] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:53.391014 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1625a2-8647-42cc-b484-10e40f20b037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:53.391014 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1625a2-8647-42cc-b484-10e40f20b037 admin admin] PATH_INFO: `/v3/projects` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:53.391014 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1625a2-8647-42cc-b484-10e40f20b037 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:53.392473 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1625a2-8647-42cc-b484-10e40f20b037 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:21:53.485981 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1471/2922] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 24 16:21:53 2022] POST /identity/v3/projects => generated 397 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:21:53.490219 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7aea0-b362-426e-ba43-207042da1352 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:53.500892 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7aea0-b362-426e-ba43-207042da1352 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:53.558267 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034c0e3-ea66-4046-b110-68e1868decf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:53.558868 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034c0e3-ea66-4046-b110-68e1868decf6 admin admin] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:53.559151 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034c0e3-ea66-4046-b110-68e1868decf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:53.559427 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034c0e3-ea66-4046-b110-68e1868decf6 admin admin] PATH_INFO: `/v3/users` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:53.560043 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034c0e3-ea66-4046-b110-68e1868decf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:53.561994 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034c0e3-ea66-4046-b110-68e1868decf6 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:21:53.638633 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1452/2923] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 24 16:21:53 2022] POST /identity/v3/users => generated 299 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:21:53.642746 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1625a2-8647-42cc-b484-10e40f20b037 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:53.653618 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1625a2-8647-42cc-b484-10e40f20b037 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:53.658215 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6388f7f-feed-4d4d-9b48-5b22210705de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:53.658804 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6388f7f-feed-4d4d-9b48-5b22210705de admin admin] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:53.659082 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6388f7f-feed-4d4d-9b48-5b22210705de admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:53.659350 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6388f7f-feed-4d4d-9b48-5b22210705de admin admin] PATH_INFO: `/v3/roles` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:53.660017 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6388f7f-feed-4d4d-9b48-5b22210705de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:53.661651 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6388f7f-feed-4d4d-9b48-5b22210705de admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:21:53.671634 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1472/2924] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:21:53.675505 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034c0e3-ea66-4046-b110-68e1868decf6 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:53.686077 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034c0e3-ea66-4046-b110-68e1868decf6 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:53.690925 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b728e61-9e60-47f0-954d-d8785c2e0370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:53.691554 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b728e61-9e60-47f0-954d-d8785c2e0370 admin admin] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:53.691839 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b728e61-9e60-47f0-954d-d8785c2e0370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:53.692119 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b728e61-9e60-47f0-954d-d8785c2e0370 admin admin] PATH_INFO: `/v3/roles` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:53.692799 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b728e61-9e60-47f0-954d-d8785c2e0370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:53.694442 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b728e61-9e60-47f0-954d-d8785c2e0370 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:21:53.705976 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1453/2925] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 24 16:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:21:53.709978 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6388f7f-feed-4d4d-9b48-5b22210705de admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:53.719851 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6388f7f-feed-4d4d-9b48-5b22210705de admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:53.724460 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d279d98b-4324-472c-8463-5c31dc7803c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:53.725132 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279d98b-4324-472c-8463-5c31dc7803c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:53.725412 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279d98b-4324-472c-8463-5c31dc7803c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:53.725684 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279d98b-4324-472c-8463-5c31dc7803c9 admin admin] PATH_INFO: `/v3/projects/55c5867cf02548fb943debe70440445d/users/c1fa694894834249859b5e6d9dc4bd87/roles/0ea43d9dfb184e27b48d251fd38463db` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:53.739704 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d279d98b-4324-472c-8463-5c31dc7803c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55c5867cf02548fb943debe70440445d, user_id=c1fa694894834249859b5e6d9dc4bd87, role_id=0ea43d9dfb184e27b48d251fd38463db)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:53.742370 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d279d98b-4324-472c-8463-5c31dc7803c9 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:21:53.867371 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1473/2926] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 24 16:21:53 2022] PUT /identity/v3/projects/55c5867cf02548fb943debe70440445d/users/c1fa694894834249859b5e6d9dc4bd87/roles/0ea43d9dfb184e27b48d251fd38463db => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:21:53.878127 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b73c7-937b-47ba-af6a-4da9fe49cc59 None None] REQUEST_METHOD: `POST` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:53.878440 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b73c7-937b-47ba-af6a-4da9fe49cc59 None None] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:53.878713 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b73c7-937b-47ba-af6a-4da9fe49cc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:53.907163 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.auth.core [None req-097b73c7-937b-47ba-af6a-4da9fe49cc59 None None] MFA Rules not processed for user `c1fa694894834249859b5e6d9dc4bd87`. Rule list: `[]` (Enabled: `True`). {{(pid=81717) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:21:53.908294 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-097b73c7-937b-47ba-af6a-4da9fe49cc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:21:53.972226 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1454/2927] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:21:53 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:21:53.985017 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d279d98b-4324-472c-8463-5c31dc7803c9 admin admin] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:53.986885 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-d279d98b-4324-472c-8463-5c31dc7803c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:21:54.009711 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:21:54.044311 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d279d98b-4324-472c-8463-5c31dc7803c9 admin admin] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:54.048459 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccac0a-4d5e-457b-98af-2026b00c2852 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89d937fedccb484a8a494cd686361fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:54.049137 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccac0a-4d5e-457b-98af-2026b00c2852 service cinder] REQUEST_METHOD: `GET` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:54.054753 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccac0a-4d5e-457b-98af-2026b00c2852 service cinder] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:54.054753 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccac0a-4d5e-457b-98af-2026b00c2852 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:54.057970 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ccac0a-4d5e-457b-98af-2026b00c2852 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:54.060009 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ccac0a-4d5e-457b-98af-2026b00c2852 service cinder] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:21:54.068769 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1474/2928] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:21:53 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:21:59.925325 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b73c7-937b-47ba-af6a-4da9fe49cc59 None None] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:21:59.944485 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:21:59.988269 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b73c7-937b-47ba-af6a-4da9fe49cc59 None None] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:21:59.993069 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1373256-4bd5-4f67-96f2-c27c6e9c6053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:21:59.993693 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1373256-4bd5-4f67-96f2-c27c6e9c6053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:21:59.993973 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1373256-4bd5-4f67-96f2-c27c6e9c6053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:21:59.994247 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1373256-4bd5-4f67-96f2-c27c6e9c6053 admin admin] PATH_INFO: `/v3/users/c1fa694894834249859b5e6d9dc4bd87` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:21:59.995367 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1373256-4bd5-4f67-96f2-c27c6e9c6053 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1fa694894834249859b5e6d9dc4bd87)` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:21:59.997566 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1373256-4bd5-4f67-96f2-c27c6e9c6053 admin admin] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:22:00.160500 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a1373256-4bd5-4f67-96f2-c27c6e9c6053 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1fa694894834249859b5e6d9dc4bd87'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:22:00.161129 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a1373256-4bd5-4f67-96f2-c27c6e9c6053 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1fa694894834249859b5e6d9dc4bd87'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:22:00.161732 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a1373256-4bd5-4f67-96f2-c27c6e9c6053 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1fa694894834249859b5e6d9dc4bd87'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:22:00.221186 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a1373256-4bd5-4f67-96f2-c27c6e9c6053 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1fa694894834249859b5e6d9dc4bd87'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:22:00.228455 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.notifications [None req-a1373256-4bd5-4f67-96f2-c27c6e9c6053 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1fa694894834249859b5e6d9dc4bd87'} {{(pid=81717) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:22:00.245862 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1455/2929] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 24 16:21:59 2022] DELETE /identity/v3/users/c1fa694894834249859b5e6d9dc4bd87 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:22:00.250648 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aed793-caa9-40d5-bedb-3bf810948540 None None] REQUEST_METHOD: `POST` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:22:00.251181 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aed793-caa9-40d5-bedb-3bf810948540 None None] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:22:00.251181 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aed793-caa9-40d5-bedb-3bf810948540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:22:00.270088 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.auth.core [None req-f7aed793-caa9-40d5-bedb-3bf810948540 None None] MFA Rules not processed for user `f3bef6df7d3341a9829325d03a53cc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81716) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:22:00.271354 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-f7aed793-caa9-40d5-bedb-3bf810948540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:22:00.331310 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1475/2930] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 24 16:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:22:00.341200 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1373256-4bd5-4f67-96f2-c27c6e9c6053 admin admin] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:22:00.342669 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-a1373256-4bd5-4f67-96f2-c27c6e9c6053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:22:00.401459 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1373256-4bd5-4f67-96f2-c27c6e9c6053 admin admin] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:22:00.405352 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117b89a-cdb1-4e0d-9f4d-81aff99c4e3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f7e6f1af76404096d4c717cbcf20f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:22:00.405950 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117b89a-cdb1-4e0d-9f4d-81aff99c4e3b service neutron] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:22:00.406227 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117b89a-cdb1-4e0d-9f4d-81aff99c4e3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:22:00.406498 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117b89a-cdb1-4e0d-9f4d-81aff99c4e3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:22:00.416139 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8117b89a-cdb1-4e0d-9f4d-81aff99c4e3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:22:00.418426 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8117b89a-cdb1-4e0d-9f4d-81aff99c4e3b service neutron] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:22:00.429107 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1456/2931] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:22:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:22:00.832460 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aed793-caa9-40d5-bedb-3bf810948540 None None] Authenticating user token {{(pid=81716) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:22:00.833914 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.fernet_utils [None req-f7aed793-caa9-40d5-bedb-3bf810948540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81716) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:22:00.847169 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aed793-caa9-40d5-bedb-3bf810948540 None None] Validating token access rules against request {{(pid=81716) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:22:00.851862 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e350920-145d-407e-bef6-3d0f9df5b8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bef6df7d3341a9829325d03a53cc71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23fb7d167a714e0cb4ca2550c38d5f58', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81716) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:22:00.852513 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e350920-145d-407e-bef6-3d0f9df5b8d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:22:00.852831 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e350920-145d-407e-bef6-3d0f9df5b8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:22:00.853106 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e350920-145d-407e-bef6-3d0f9df5b8d3 admin admin] PATH_INFO: `/v3/projects/55c5867cf02548fb943debe70440445d` {{(pid=81716) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:22:00.854229 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e350920-145d-407e-bef6-3d0f9df5b8d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55c5867cf02548fb943debe70440445d)` {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:22:00.856638 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e350920-145d-407e-bef6-3d0f9df5b8d3 admin admin] RBAC: Authorization granted {{(pid=81716) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:22:00.963954 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-5e350920-145d-407e-bef6-3d0f9df5b8d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55c5867cf02548fb943debe70440445d', 'request_id': 'req-5e350920-145d-407e-bef6-3d0f9df5b8d3'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:22:01.037879 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-5e350920-145d-407e-bef6-3d0f9df5b8d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55c5867cf02548fb943debe70440445d', 'request_id': 'req-5e350920-145d-407e-bef6-3d0f9df5b8d3'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:22:01.045331 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-5e350920-145d-407e-bef6-3d0f9df5b8d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55c5867cf02548fb943debe70440445d', 'request_id': 'req-5e350920-145d-407e-bef6-3d0f9df5b8d3'} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:22:01.056391 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-5e350920-145d-407e-bef6-3d0f9df5b8d3 admin admin] The token cache is being invalidate because project 55c5867cf02548fb943debe70440445d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81716) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:22:01.056708 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-5e350920-145d-407e-bef6-3d0f9df5b8d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:22:01.057341 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG keystone.notifications [None req-5e350920-145d-407e-bef6-3d0f9df5b8d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81716) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:22:01.058829 dv-cinder-849325-3-smb devstack@keystone.service[81716]: [pid: 81716|app: 0|req: 1476/2932] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 24 16:22:00 2022] DELETE /identity/v3/projects/55c5867cf02548fb943debe70440445d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:22:10.424830 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:22:11.053447 dv-cinder-849325-3-smb devstack@keystone.service[81716]: DEBUG dbcounter [-] [81716] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:22:12.457374 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117b89a-cdb1-4e0d-9f4d-81aff99c4e3b service neutron] Authenticating user token {{(pid=81717) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:22:12.458814 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-8117b89a-cdb1-4e0d-9f4d-81aff99c4e3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:22:12.551032 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117b89a-cdb1-4e0d-9f4d-81aff99c4e3b service neutron] Validating token access rules against request {{(pid=81717) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:22:12.609877 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4941f-65d1-4b4a-9983-dbe4b73c6845 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6907dfd3254d3c97d07ca2fb648858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b25a7c01ab540ceae16dd618b848f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81717) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:22:12.610403 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4941f-65d1-4b4a-9983-dbe4b73c6845 service placement] REQUEST_METHOD: `GET` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:22:12.610679 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4941f-65d1-4b4a-9983-dbe4b73c6845 service placement] SCRIPT_NAME: `/identity` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:22:12.610950 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4941f-65d1-4b4a-9983-dbe4b73c6845 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81717) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:22:12.612732 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.fernet_utils [None req-dba4941f-65d1-4b4a-9983-dbe4b73c6845 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81717) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:22:12.624971 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4941f-65d1-4b4a-9983-dbe4b73c6845 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:22:12.626580 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4941f-65d1-4b4a-9983-dbe4b73c6845 service placement] RBAC: Authorization granted {{(pid=81717) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:22:12.636516 dv-cinder-849325-3-smb devstack@keystone.service[81717]: [pid: 81717|app: 0|req: 1457/2933] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 24 16:22:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:22:22.632199 dv-cinder-849325-3-smb devstack@keystone.service[81717]: DEBUG dbcounter [-] [81717] Writing DB stats keystone:SELECT=67 {{(pid=81717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}